note · evergreen

The flow: where I did what

Eleven steps from calibration to measurements, each with where it happens and the file that does it.

The whole path, in the order I walked it. Every step says where it happens and which file in the repo does it.

Mac + armsrecord
Hugging Faceupload
Colabtrain
Maccheck
armrun and play
  1. Calibrate and teleoperate. Mac, both arms. Calibrate the two arms once, then move the leader and watch the follower copy it. Check which camera is which with lerobot-find-cameras opencv, and that the arm reaches all nine cells. docs/operations.md
  2. Fix the scene. On the table. Tape marks for the grid, the piece slots, the arm base and the top camera, and the same light every time. docs/plan.md
  3. Plan the recordings. Mac. A script draws the start board of every episode, so nothing is improvised at the table. scripts/recording_plan.py writes docs/rounds/round1.md.
  4. Record and check. Mac, both arms. One move per episode with lerobot-record, one target cell per block of five. Then look at every episode. docs/recording.md
  5. Upload. Hugging Face. LeRobot uploads the dataset when a recording call ends. I deleted one bad episode into a clean copy and trained on that. The commands are in the operations notes.
  6. Train. Colab, A100. Open the notebook, add a Hugging Face token, run the cells. About four hours.
  7. Check without the arm. Mac. Load the model, give it recorded frames, change the sentence and see the prediction change. Then run the real command with a port that does not exist.
  8. Run on the arm. Mac, follower. One cell, one sentence, and a log of every command: scripts/rollout_logged.py.
  9. Add Claude and the game. Mac, Anthropic API. First one move without Claude, then a game: scripts/strands_game.py, with the code in xox/ and my notes in docs/strands.md.
  10. Dashboard. Browser on the Mac. A local page with both cameras, the board and a stop button: xox/dashboard.
  11. Measure. Mac. Charts drawn from the logs and the dataset: docs/benchmarks.md, or the measurements card here.

Why this order

Two rules decided the order. Prove the whole chain with a small pilot before recording a lot. And try the model alone on the arm before putting anything on top of it; otherwise I cannot tell whether a fault is in the model or in the bridge.

#steps #repo

See this note on the whiteboard →