Comparing Fable 5.1 to Fable 5 on robotic manipulation
September 3, 2026
We gave Claude Fable 5 and Claude Fable 5.1 control of a pair of YAM arms and evaluated both on two Inspect Robots manipulation tasks:
“Pick up the red block from the table and place it inside the bowl”
“Pick up the round blue puzzle piece by the knob at its center and place it into the matching circular groove in the board”
Across 20 trials per model per task, Fable 5.1 reached later stages of both tasks than Fable 5, completed each task more often, and produced fewer output tokens doing it.
One Fable 5.1 trial replayed in Rerun: the three camera views the model receives each turn, its own notes as it decides, and the end‑effector targets it commands — all on one timeline.
Fable 5.1 completes more while producing fewer tokens
Condition means. Both tasks move up and to the left from Fable 5 to Fable 5.1 — more completions for fewer output tokens. At 20 trials per condition the bowl‑task gap is clear; the puzzle task's 0 versus 2 completions is smaller, but directionally suggestive.
Scoring
Every trial was scored by a human grader on the highest stage it reached, so a run that fails still records how far it got.
| 0 | No purposeful approach |
| 1 | Made contact with the object |
| 2 | Lifted the object clear of the table |
| 3 | Positioned it above the deposit point |
| 4 | Placed it in its final position |
Fable 5.1 gets further up the ladder on both tasks
Share of 20 trials per model reaching each stage. Fable 5 stalls at first contact in 13 of 20 bowl trials, never closing the gripper on the block. On the puzzle task both models get further, but the wall moves to the final insertion.
Results
| Task | Model | Mean stage | Completions | Rate | Output tokens/run |
|---|---|---|---|---|---|
| Block into bowl | Fable 5 | 1.30 | 1 / 20 | 5% | 19.2k |
| Block into bowl | Fable 5.1 | 2.40 | 8 / 20 | 40% | 12.9k |
| Puzzle into groove | Fable 5 | 1.50 | 0 / 20 | 0% | 16.3k |
| Puzzle into groove | Fable 5.1 | 2.35 | 2 / 20 | 10% | 10.5k |
All runs
Every counted trial, 80 in total.
| Task | Model | Score | Time (min) | Output tokens | Transcript | Video | Rerun |
|---|---|---|---|---|---|---|---|
| Block into bowl | Fable 5 | 4 | 5.2 | 13,120 | view | watch | download |
| Block into bowl | Fable 5 | 3 | 7.1 | 14,048 | view | watch | download |
| Block into bowl | Fable 5 | 2 | 5.0 | 10,663 | view | watch | download |
| Block into bowl | Fable 5 | 2 | 8.7 | 17,859 | view | watch | download |
| Block into bowl | Fable 5 | 2 | 9.1 | 15,064 | view | watch | download |
| Block into bowl | Fable 5 | 1 | 4.7 | 9,096 | view | watch | download |
| Block into bowl | Fable 5 | 1 | 5.8 | 13,800 | view | watch | download |
| Block into bowl | Fable 5 | 1 | 5.8 | 9,954 | view | watch | download |
| Block into bowl | Fable 5 | 1 | 7.1 | 16,666 | view | watch | download |
| Block into bowl | Fable 5 | 1 | 7.2 | 18,165 | view | watch | download |
| Block into bowl | Fable 5 | 1 | 7.2 | 14,719 | view | watch | download |
| Block into bowl | Fable 5 | 1 | 8.4 | 24,975 | view | watch | download |
| Block into bowl | Fable 5 | 1 | 8.7 | 17,436 | view | watch | download |
| Block into bowl | Fable 5 | 1 | 8.8 | 21,388 | view | watch | download |
| Block into bowl | Fable 5 | 1 | 9.6 | 30,566 | view | watch | download |
| Block into bowl | Fable 5 | 1 | 10.8 | 28,784 | view | watch | download |
| Block into bowl | Fable 5 | 1 | 11.7 | 27,810 | view | watch | download |
| Block into bowl | Fable 5 | 1 | 14.8 | 35,211 | view | watch | download |
| Block into bowl | Fable 5 | 0 | 8.7 | 17,764 | view | watch | download |
| Block into bowl | Fable 5 | 0 | 9.7 | 27,582 | view | watch | download |
| Block into bowl | Fable 5.1 | 4 | 4.2 | 9,124 | view | watch | download |
| Block into bowl | Fable 5.1 | 4 | 4.8 | 9,779 | view | watch | download |
| Block into bowl | Fable 5.1 | 4 | 5.0 | 11,359 | view | watch | download |
| Block into bowl | Fable 5.1 | 4 | 5.1 | 8,526 | view | watch | download |
| Block into bowl | Fable 5.1 | 4 | 5.6 | 10,998 | view | watch | download |
| Block into bowl | Fable 5.1 | 4 | 6.5 | 7,031 | view | watch | download |
| Block into bowl | Fable 5.1 | 4 | 6.7 | 15,901 | view | watch | download |
| Block into bowl | Fable 5.1 | 4 | 7.5 | 8,964 | view | watch | download |
| Block into bowl | Fable 5.1 | 3 | 5.7 | 14,477 | view | watch | download |
| Block into bowl | Fable 5.1 | 3 | 8.6 | 20,110 | view | watch | download |
| Block into bowl | Fable 5.1 | 2 | 7.3 | 20,022 | view | watch | download |
| Block into bowl | Fable 5.1 | 2 | 18.9 | 14,526 | view | watch | download |
| Block into bowl | Fable 5.1 | 1 | 5.7 | 13,265 | view | watch | download |
| Block into bowl | Fable 5.1 | 1 | 5.9 | 18,073 | view | watch | download |
| Block into bowl | Fable 5.1 | 1 | 6.0 | 13,070 | view | watch | download |
| Block into bowl | Fable 5.1 | 1 | 6.6 | 11,506 | view | watch | download |
| Block into bowl | Fable 5.1 | 1 | 7.1 | 11,404 | view | watch | download |
| Block into bowl | Fable 5.1 | 1 | 8.5 | 17,760 | view | watch | download |
| Block into bowl | Fable 5.1 | 0 | 4.5 | 8,979 | view | watch | download |
| Block into bowl | Fable 5.1 | 0 | 5.2 | 13,394 | view | watch | download |
| Puzzle into groove | Fable 5 | 3 | 5.4 | 12,599 | view | watch | download |
| Puzzle into groove | Fable 5 | 3 | 6.6 | 11,044 | view | watch | download |
| Puzzle into groove | Fable 5 | 3 | 6.7 | 11,726 | view | watch | download |
| Puzzle into groove | Fable 5 | 3 | 6.8 | 10,743 | view | watch | download |
| Puzzle into groove | Fable 5 | 3 | 8.8 | 14,855 | view | watch | download |
| Puzzle into groove | Fable 5 | 2 | 7.0 | 19,149 | view | watch | download |
| Puzzle into groove | Fable 5 | 2 | 9.1 | 22,592 | view | watch | download |
| Puzzle into groove | Fable 5 | 1 | 4.5 | 9,620 | view | watch | download |
| Puzzle into groove | Fable 5 | 1 | 4.7 | 9,942 | view | watch | download |
| Puzzle into groove | Fable 5 | 1 | 5.3 | 13,629 | view | watch | download |
| Puzzle into groove | Fable 5 | 1 | 5.8 | 16,029 | view | watch | download |
| Puzzle into groove | Fable 5 | 1 | 6.6 | 16,460 | view | watch | download |
| Puzzle into groove | Fable 5 | 1 | 7.3 | 10,544 | view | watch | download |
| Puzzle into groove | Fable 5 | 1 | 8.3 | 25,603 | view | watch | download |
| Puzzle into groove | Fable 5 | 1 | 8.3 | 23,105 | view | watch | download |
| Puzzle into groove | Fable 5 | 1 | 9.1 | 20,718 | view | watch | download |
| Puzzle into groove | Fable 5 | 1 | 15.1 | 29,746 | view | watch | download |
| Puzzle into groove | Fable 5 | 1 | 17.2 | 11,577 | view | watch | download |
| Puzzle into groove | Fable 5 | 0 | 6.2 | 18,229 | view | watch | download |
| Puzzle into groove | Fable 5 | 0 | 10.0 | 18,386 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 4 | 5.2 | 10,618 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 4 | 7.6 | 10,306 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 3 | 4.1 | 9,993 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 3 | 5.0 | 11,549 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 3 | 5.4 | 10,450 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 3 | 6.0 | 10,417 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 3 | 6.5 | 10,725 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 3 | 7.1 | 10,312 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 3 | 7.2 | 11,048 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 3 | 7.4 | 11,978 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 3 | 7.5 | 12,251 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 2 | 3.7 | 9,362 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 2 | 4.5 | 8,946 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 2 | 4.9 | 9,432 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 2 | 6.6 | 12,046 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 1 | 3.9 | 9,341 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 1 | 4.3 | 9,597 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 1 | 5.5 | 12,735 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 1 | 10.0 | 9,111 | view | watch | download |
| Puzzle into groove | Fable 5.1 | 0 | 6.5 | 10,359 | view | watch | download |
Technical specifications
| Embodiment | Bimanual I2RT YAM arms, 6-DoF per arm with parallel-jaw grippers |
| Control | Absolute end-effector poses (move_to): x, y, z, yaw, pitch, roll and gripper, per arm. The robot's IK converts poses to joint angles. |
| Observation | Three camera views (top, left wrist, right wrist) plus proprioceptive state, each turn |
| Policy | agent policy, medium thinking effort, 20-LLM-call budget, 25% speed cap, default safety guardrails on |
| Models | claude-fable-5 and claude-fable-5-1 |
| Harness | Inspect Robots 0.58.0 |
| Trials | 20 per model per task, alternating models; each task fixed to one rig |
| Token counts | Wire-level request and response tokens, not billed tokens |
Limitations
- Grading was operator-judged, with the operator aware of which model was running throughout, so the scores are open to unconscious bias.
- Task objects were reset by hand after every trial, so starting configurations varied slightly.
- Both models ran only at medium thinking effort; whether the difference holds at other effort levels is untested.
- Fable 5 exhausted its 20-call budget in 18 of 20 bowl trials, where Fable 5.1 usually stopped on its own. We cannot say whether Fable 5 would close the gap given a larger call budget.