EVALUATION RECORD
Humanoid-GPT Transformer 216
LAFAN1 × G1 29DoF · Ideal proprioception · no global position
Evaluated by MotionChallenge using the shared protocol.
Results
22 / 40motions passedCompletion 74.79%
Success and completion use the first declared failure. MPBPE measures position errors over the benchmark’s declared body origins, with three alignments over two time ranges.
| Entire motion | Until first failure | ||||
|---|---|---|---|---|---|
| XY only | XY + yaw | No alignment | XY only | XY + yaw | No alignment |
| 234.52 | 171.23 | 3356.49 | 105.58 | 53.40 | 2662.99 |
Entire-motion errors include every frame through the endpoint, including post-failure states. The other range ends at the first failing sample, including that sample.
- Benchmark
- LAFAN1 × G1 29DoF · Ideal proprioception · no global position
- Engine
- MuJoCo 3.17.0 · official CPU batch
- Checkpoint SHA256
82313c76869ca796395abf80ee4288cced424d25087e74e32f9ec739ff59c853- Evaluation code
- MotionChallenge-humanoid-gpt-transformer-216
- Verification
- Both trajectory ranges recomputed · repeatability checked
- Inference comparison
- 160 inputs · 4 resets · Report ↗ · Comparison code ↗
Reproduce this run
git clone --recurse-submodules https://github.com/MotionChallenge-Project/MotionChallenge-humanoid-gpt-transformer-216.git
cd MotionChallenge-humanoid-gpt-transformer-216
uv sync
uv run evaluate.pyRuns the full benchmark and verifies the saved trajectories.
Complete results, source & verification (JSON) ↗