mcMotionChallengeGitHub ↗

EVALUATION RECORD

HoloMotion v1.3.1

LAFAN1 × G1 29DoF · Ideal proprioception · no global position

Evaluated by MotionChallenge using the shared protocol.

Results

10 / 40motions passedCompletion 56.18%

Success and completion use the first declared failure. MPBPE measures position errors over the benchmark’s declared body origins, with three alignments over two time ranges.

Mean per-body position error · MPBPE · mm · lower is better
Entire motionUntil first failure
XY onlyXY + yawNo alignmentXY onlyXY + yawNo alignment
334.46246.322696.42112.3940.321491.17

Entire-motion errors include every frame through the endpoint, including post-failure states. The other range ends at the first failing sample, including that sample.

Benchmark
LAFAN1 × G1 29DoF · Ideal proprioception · no global position
Engine
MuJoCo 3.17.0 · official CPU batch
Checkpoint SHA256
ae28e8e9bf39bc752e82ade5e0ea0436689dafa07af41fa39af696f6f6a2bbfe
Evaluation code
MotionChallenge-holomotion-v1-3-1
Core
MotionChallenge-Core
Verification
Both trajectory ranges recomputed · repeatability checked
Inference comparison
160 inputs · 4 resets · Report ↗ · Comparison code ↗

Reproduce this run

git clone --recurse-submodules https://github.com/MotionChallenge-Project/MotionChallenge-holomotion-v1-3-1.git
cd MotionChallenge-holomotion-v1-3-1
uv sync
uv run evaluate.py

Runs the full benchmark and verifies the saved trajectories.

Complete results, source & verification (JSON) ↗