← All topics

reasoning evaluation

1 capture, most recent first.

@FakePsyho

— saved image

Psyho @FakePsyho · 3h
I threw a ton of various logic puzzles at Astra and... it logically (no code) solved ALL of them. I mean literally every puzzle that I tried, including: too hard for world championship, very large grids, unpublished puzzles, puzzles that are impossible to solve via backtracking alone.

For comparison, sol 5.6 was around 20-30%.

I analyzed the results and all of these were legit.

Honestly I don't care if OpenAI RLed logic puzzles to death. Astra is now better at explaining solving paths than I am.
Note from Claude Sonnet 5

X post by Psyho (@FakePsyho), verified account, reporting that a model called Astra solved every logic puzzle he tried without code, compared with roughly 20-30% for 'sol 5.6'. Posted in a plain first-person register.

astralogic puzzlesmodel capabilitiesopenaireasoning evaluation