使用方法
- 复制安装命令,在自己的智能体环境安装前先检查源码包。
- 从原始文档核对所需工具、凭据和支持的宿主。
- 说明输入材料与期望交付物,并对照来源检查输出。
npx skills add https://github.com/google-deepmind/robotics-antigravity-plugin --skill sim2real-gauntlet开始前需了解
- 安装不包含模型订阅、API 额度或访问文件的权限。
- 仓库星数和安装量反映活跃情况,不等于独立质量或安全测试。
按源仓库内容呈现,保留标题、案例、代码、表格、链接以及原文引用的演示图片。
Sim-to-Real Gauntlet (robosim_gauntlet)
Library and CLI in src/robosim_gauntlet (put src/ on sys.path; cli.ensure_gl_backend() preserves explicit MUJOCO_GL or selects packaged egl/osmesa). Reference consumers: playground_tasks.py and color_blob_ik_controller.py.
Workflow
- Task (
task.Taskprotocol):build_device_layer(mode="sim"|"real", extra_devices)returns(numpy DeviceLayer, reset, close)(Impl.CPPin sim; real homes onreset()and parks onclose()). Alsodeployment_keys(),success(poses, poses0), andsafety(SafetyLimits: 3D contact wrenches + indirect crush, 35 N grasp cap, bimanualarm_prefixes/gripper_tokens/command_to_joint, anddrop_z_tol_m=None/require_release=False/goal_setterfor insertions, hinged fixtures, or tool-in-hand tasks). - Controller: either an out-of-process command driving
proxy.RemoteDeviceLayer(os.environ["GAUNTLET_URL"])(prompt inGAUNTLET_PROMPT, printing{"status": "done"|"abort", "fault": ...}last) or an in-process callablefn(dl) -> dictwrapped inwrappers.AllowlistWrapper(include_latency=Falsedefault). Both see onlydeployment_keys()+<cam>_timestamp(upstream timestamps forwarded/delayed; camera reads tracked vialast_cam_read_tick). - Preflight:
preflight.run(task)audits scene invariants + negative/positive goal controls (safety.goal_setterfor articulated fixtures). - Sweep / CLI:
episode.run_suite([task], cmd_or_fn, episodes=..., mcap_dir=...)orpython -m robosim_gauntlet.cli --task-py=path.py[:fn] --robot=yam --controller="..." --output-json=v1.json --baseline-json=v0.json --mode=sim|real --mcap-log-dir=...(setGAUNTLET_CRN_SECRETfor HMAC CRN). - Debug:
episode.fork(result, task, tick, cmd_or_fn)replays logged commands totickdeterministically, then hands off;McapWrapperwrites.mcaplogs viamujoco_playground.real.create_loggeridentically insimandreal.
Tiers
| Tier | Perturbation |
|---|---|
| T0 | nominal |
| T1 / T2 | moderate / adversarial pose, table, mass, friction, gains, noise, hue |
| T3 | slip, mid-approach push, or post-place knockout (idx % 3) |
| T4 | self-model mismatch + 50% terminal fault: camera_freeze (frozen or restamped) or dead_gripper |
T4 faults must end in {"status": "abort", "fault": <fault>}; aborting without a fault is spurious_abort. Verdicts: BETTER / WORSE / INDISTINGUISHABLE (one-sided exact McNemar, alpha 0.025, >= 6 discordant pairs) with safety veto.