Robotics evidence guide · automated editorial preparation, not expert review
Identify the model that actually ran
Bind an evaluation to the model artifact, preprocessing and runtime configuration actually used. A model family name or mutable download URL is not an execution identity.
Evidence and interpretation
REP 2004 addresses software version discipline; Maha applies a narrower identity practice to evaluation packages. We propose separate references for weights, tokenizer or feature processor, inference code and configuration. The same weights with different preprocessing can produce different outputs. A byte digest helps compare artifacts but does not establish their training provenance or fitness for purpose. If the artifact cannot be inspected because it is remotely hosted, record the provider’s version statement as a statement, not as locally verified bytes.
Proposed evidence workflow
- Record artifact digests where bytes are available and label provider-declared versions separately.
- Bind preprocessing, inference settings and relevant runtime dependencies.
- Retain old identities when a model is replaced; do not inherit its evaluation results.
Worked illustration
Two hypothetical runs use the same checkpoint but normalize joint observations differently. Maha’s proposed comparison marks two configurations, not a repeat of one experiment. A performance change cannot be attributed to new weights when the weights never changed.
Limits
The local example has deterministic controller code, not a learned robot model. No external model provenance has been verified.
Sources and review
Locator: Level 1 / Package Requirements: Version Policy, Change Control Process, Documentation, Testing
Quality declarations connect package-quality claims to versioning, documented interfaces, review and testing requirements.
Boundary: Package quality is not whole-robot certification. Maha has not been assessed at a ROS quality level.
Inspection and reuse basis
Selected sections inspected 2026-09-14. Original explanation and link; no source redistribution. This is not independent expert review of this article.