bijou eval report

generated: 2026-08-06T05:19:25+00:00
data: /home/ubuntu/datasets/mcobzarenco/community_curated_v0
selection: 878 datasets, 4301 episodes, 2082640 frames (103 dropped)
samples: 4301 frames, seed 0
episodes: holdout (holdout fraction 0.1, split seed 0)
checkpoint: outputs/train/bijou_flow_artrunk_h1024_40k_ddp2/step_080000
smolvla: -
sampler: heun-30
target time: t (standard)
noise key: index
state: MASKED to dataset mean (state-reliance probe)
fps filter: [30.0]
camera-count filter: [1, 2]
generate: (fast path)
sample plan: plans/holdout_curated_v0_k4l2_stateprobe_q4.json (plan seed 0, 4301 core + 0 labeled frames; headline metrics = core panel only)

Chunk metrics (raw action units, pad-masked)

Paired comparisons

Q2: chunk MAE by TRUE outcome label

Conditioning & aux diagnostics

Per-motor chunk MAE

Sample predictions (12 of 4301 scored frames)

00ri/so100_battery — episode 4, frame 5 (global index 5)

task: Grasp a battery and put it in the bin.
state: [-2.3, 189.2, 166.6, 77.2, -3.5, 0.4]
chunk MAE — state-copy: 0.28 | state-copy-norm: 0.35 | bijou@80000_state-masked: 32.85

Chojins/chess_game_009_white — episode 308, frame 138 (global index 160570)

task: Move the blue chess pieces to the highlighted squares.
state: [10.6, 92.4, 147.7, 20.3, -131.1, 1.4]
chunk MAE — state-copy: 8.47 | state-copy-norm: 8.35 | bijou@80000_state-masked: 13.82

Hale-Sage/merge_data — episode 2, frame 120 (global index 328610)

task: Grab the cube
state: [2.6, -60.4, -14.4, -84.3, 5.5, 59.5]
chunk MAE — state-copy: 10.99 | state-copy-norm: 11.91 | bijou@80000_state-masked: 9.98

Mohamedal/put_peach_bowl_dis_test2 — episode 21, frame 81 (global index 513769)

task: put the peach in the red bowl .
state: [2.2, 38.5, 38.1, 93.5, 15.6, 58.6]
chunk MAE — state-copy: 3.64 | state-copy-norm: 3.98 | bijou@80000_state-masked: 30.09

akira-sasaki/akabeko_instruct_v1 — episode 67, frame 13 (global index 695009)

task: Pick up the cube and place it in the box.
state: [8.4, 188.4, 166.9, 61.2, -3.6, -0.3]
chunk MAE — state-copy: 19.16 | state-copy-norm: 19.75 | bijou@80000_state-masked: 20.43

danaaubakirova/so100_task_3 — episode 5, frame 76 (global index 855953)

task: Pick up the blue cube and place it in the box.
state: [-7.1, 121.6, 123.8, 74.4, 82.3, 0.2]
chunk MAE — state-copy: 13.78 | state-copy-norm: 14.29 | bijou@80000_state-masked: 7.31

ethanCSL/box_test — episode 24, frame 6 (global index 1024374)

task: Open the drawer pick up the cube and put it in the drawer.
state: [-4.7, 131.8, 140.9, 89.6, 88.0, 31.6]
chunk MAE — state-copy: 31.14 | state-copy-norm: 31.01 | bijou@80000_state-masked: 36.39

juni3227/so100_test_cap02_sideway — episode 53, frame 19 (global index 1190825)

task: Put bottle_cap into a cup
state: [-2.3, 192.0, 181.4, 74.7, -87.6, 0.5]
chunk MAE — state-copy: 31.31 | state-copy-norm: 32.18 | bijou@80000_state-masked: 24.07

lt-s/so100_train_move_two_blocks_tray_to_matching_dishes — episode 16, frame 20 (global index 1375954)

task: move two blocks tray to matching dishes
state: [5.7, 189.3, 173.1, 56.8, 3.3, -0.1]
chunk MAE — state-copy: 22.88 | state-copy-norm: 23.41 | bijou@80000_state-masked: 22.87

psg777/combinedtape — episode 49, frame 259 (global index 1575985)

task: Pick the red roll and drop it in the blue box
state: [-19.0, 4.0, 24.8, 61.1, 86.5, 2.6]
chunk MAE — state-copy: 4.94 | state-copy-norm: 4.26 | bijou@80000_state-masked: 16.02

samsam0510/tooth_extraction_4 — episode 17, frame 32 (global index 1728453)

task: Extarct the molar and put it somewhere.
state: [2.4, 189.8, 170.9, 70.8, -1.1, 0.7]
chunk MAE — state-copy: 19.00 | state-copy-norm: 19.58 | bijou@80000_state-masked: 26.39

siqiLi/so100_test16 — episode 21, frame 74 (global index 1928887)

task: Pick up the spray and put it in a vertical position.
state: [-18.3, 106.4, 101.4, 76.7, -93.2, 84.5]
chunk MAE — state-copy: 16.09 | state-copy-norm: 16.75 | bijou@80000_state-masked: 16.26