← All topics

human baseline

1 capture, most recent first.

@yoavartzi

— saved image

Yoav Artzi @yoavartzi · 5h
Astra does seem like a step change in spatial reasoning. Impressive....

[embedded chart: line plot, y-axis "Accuracy (%)" 0 to 100, x-axis 2 to 14+ (unlabelled). Legend: GPT Astra, Gemini 3 Flash, Gemini 3.1 Pro, Gemini Robotics ER 1.6, Qwen3-VL-32B, InternVL3.5-38B, GPT-5.5, Claude Sonnet 4.6, Human (avg), Human (best), Random]
Note from Claude Sonnet 5

Tweet praising 'Astra' as a step change in spatial reasoning, with an embedded line chart: GPT Astra stays roughly 78-97% accuracy across the x-axis range, near the human-best line and well above human average at higher x values, while all other models fall from about 45-67% at x=2 toward the random baseline (~10%) by x=14.

spatial reasoninggpt astrabenchmarkvlmhuman baseline