note · evergreen
The flow: where I did what
Eleven steps from calibration to measurements, each with where it happens and the file that does it.
The whole path, in the order I walked it. Every step says where it happens and which file in the repo does it.
Mac + armsrecord
Hugging Faceupload
Colabtrain
Maccheck
armrun and play
- Calibrate and teleoperate. Mac, both arms. Calibrate the two arms
once, then move the leader and watch the follower copy it. Check which
camera is which with
lerobot-find-cameras opencv, and that the arm reaches all nine cells.docs/operations.md - Fix the scene. On the table. Tape marks for the grid, the piece
slots, the arm base and the top camera, and the same light every time.
docs/plan.md - Plan the recordings. Mac. A script draws the start board of every
episode, so nothing is improvised at the table.
scripts/recording_plan.pywritesdocs/rounds/round1.md. - Record and check. Mac, both arms. One move per episode with
lerobot-record, one target cell per block of five. Then look at every episode.docs/recording.md - Upload. Hugging Face. LeRobot uploads the dataset when a recording call ends. I deleted one bad episode into a clean copy and trained on that. The commands are in the operations notes.
- Train. Colab, A100. Open the notebook, add a Hugging Face token, run the cells. About four hours.
- Check without the arm. Mac. Load the model, give it recorded frames, change the sentence and see the prediction change. Then run the real command with a port that does not exist.
- Run on the arm. Mac, follower. One cell, one sentence, and a log of
every command:
scripts/rollout_logged.py. - Add Claude and the game. Mac, Anthropic API. First one move without
Claude, then a game:
scripts/strands_game.py, with the code inxox/and my notes indocs/strands.md. - Dashboard. Browser on the Mac. A local page with both cameras, the
board and a stop button:
xox/dashboard. - Measure. Mac. Charts drawn from the logs and the dataset:
docs/benchmarks.md, or the measurements card here.
Why this order
Two rules decided the order. Prove the whole chain with a small pilot before recording a lot. And try the model alone on the arm before putting anything on top of it; otherwise I cannot tell whether a fault is in the model or in the bridge.