google-deepmind/robotics-antigravity-plugin

sim2real-iteration

Guides disciplined MuJoCo robotics sim-to-real controller iteration using robosimgauntlet verification, preflight scene/goal audits, deterministic episode forking, paired Common Random Numbers, and adversarial robotics critic reviews.

소스 보기

사용 방법

  1. 설치 명령을 복사하고 자신의 에이전트 환경에 설치하기 전에 소스 패키지를 확인하세요.
  2. 필요한 도구, 인증 정보, 지원 환경은 원본 문서에서 확인하세요.
  3. 입력과 원하는 산출물을 설명하고 출처와 결과를 대조하세요.
npx skills add https://github.com/google-deepmind/robotics-antigravity-plugin --skill sim2real-iteration

시작 전 확인

  • 설치에는 모델 구독, API 한도, 파일 접근 권한이 포함되지 않습니다.
  • 별점 수와 설치 수는 활동 지표이며 독립적인 품질·보안 검증이 아닙니다.
원본 Skill 문서

원본 저장소의 제목, 예시, 코드, 표, 링크, 이미지를 유지해 표시합니다.

Sim-to-Real Controller Iteration

Use alongside sim2real-gauntlet (src/robosim_gauntlet on sys.path) when tuning or debugging a manipulation controller for physical deployment. Never claim an improvement from single-seed runs, T0-only checks, or unpaired rollouts. Reference consumers: ../sim2real-gauntlet/examples/playground_tasks.py and ../sim2real-gauntlet/examples/color_blob_ik_controller.py.

Loop

  1. Preflight gate: Audit compiled MjModel physics and positive/negative goal controls (safety.goal_setter for articulated fixtures) before iterating:
bash
   python -m robosim_gauntlet.cli --task-py=../sim2real-gauntlet/examples/playground_tasks.py --robot=yam --tasks=cube_in_bowl --preflight-only

Fix every reported issue (manipuland welds, non-robot actuators, manipuland margin/gap, contact overrides, or vacuous/unsatisfiable task.success).

  1. Unprivileged controller contract: Drive proxy.RemoteDeviceLayer(os.environ["GAUNTLET_URL"]) out of process (or an in-process fn(dl) behind wrappers.AllowlistWrapper) using only task.deployment_keys() and <cam>_timestamp. On T4 terminal faults (camera_freeze or dead_gripper), observe post-onset state and exit with {"status": "abort", "fault": "<fault>"}; aborting without an active fault fails with spurious_abort.
  2. Inner-loop diagnosis (`episode.fork`): Inspect result.grade.violations, result.grade.metrics, and result.log (poses_at, FORCES) to find the earliest causal failure tick, then replay deterministically on the exact seeded T0-T4 plant to tick and hand off to a candidate command or callable:
python
   forked = episode.fork(result, task, tick, candidate_cmd_or_fn)

Confirm fixes on full-episode sweeps after fork debugging.

  1. Paired CRN hill-climbing: Set GAUNTLET_CRN_SECRET (>= 16 bytes) for HMAC-locked evaluation and compare baseline (v0) vs candidate (v1) on identical --task-py, --robot, --tiers=T0,T1,T2,T3,T4, --episodes, and --seed:
bash
   GAUNTLET_CRN_SECRET="$KEY" python -m robosim_gauntlet.cli \
     --task-py=../sim2real-gauntlet/examples/playground_tasks.py --robot=yam \
     --compare-controller="$V0_CMD" --controller="$V1_CMD" \
     --tiers=T0,T1,T2,T3,T4 --episodes=4 --seed=0 --output-json=/tmp/crn.json

Or compare saved runs via --baseline-json=v0.json --candidate-json=v1.json. Verdicts (scorecard.compare): INVALID (fix key/seed/scene_sha256 mismatch), WORSE (revert; safety regressions veto task gains), INDISTINGUISHABLE (keep simpler controller or increase --episodes to reach >= 6 discordant pairs), BETTER (promote only after passing critic_rubric.md, then run --mode=real --mcap-log-dir=...).

같은 저장소의 Skills

더 많은 Skills

모든 Skills
google-deepmind
커뮤니티

blender-creation

Creates physically calibrated, articulated, PBR-textured 3D MuJoCo assets (MJCF model.xml, .mjz, mjSpec) from scratch using headless Blender (bpy, bmesh, blendermeshutils, assetbuildutils), convex collision synthesis, 10-scenario auditing, and Studio preview. Use only when asked to create, model, or build a 3D MuJoCo object from a URL, image, or text description, or when blender-creation is named. Don't use for non-MuJoCo Blender/Cycles/CAD modeling.

1시간 설치 수
2
GitHub Stars
80
업데이트
11월 17일
google-deepmind
커뮤니티

fr3-duo-control

Franka Duo robot only (Franka Research 3 / FR3 Duo dual-arm cell with Robotiq 2F-85 grippers, ZED Mini and RealSense D405 cameras). Brings up, homes, and controls it via pylibfranka on hardware or in MuJoCo sim. Use only when the user names Franka Duo, FR3 Duo, or fr3duo.

1시간 설치 수
2
GitHub Stars
80
업데이트
11월 17일
google-deepmind
커뮤니티

i2rt-yam-bringup

Checks and installs the I2RT YAM SDK (i2rt), configures Linux socketcan or macOS gsusb CAN bringup for I2RT YAM robot arms, and provides a wave smoke test (wave.py). Use only before bringing up or programming a physical or simulated I2RT YAM robot arm, or when asked to run a wave gesture on an I2RT YAM robot. Don't use for non-YAM CAN bus debugging (e.g. automotive OBD-II or industrial PLC CAN networks) or non-robotics tasks.

1시간 설치 수
2
GitHub Stars
80
업데이트
11월 17일
google-deepmind
커뮤니티

i2rt-yam-ik

Solves 6-DOF inverse kinematics for the I2RT YAM and YAM Pro robot arm using Mink + DAQP on combined YAM + gripper MJCF. Use only when computing joint targets or local Cartesian moves on an I2RT YAM or YAM Pro robot arm. Don't use for non-YAM inverse kinematics, general quadratic programming (QP) solvers, or non-robotics tasks.

1시간 설치 수
2
GitHub Stars
80
업데이트
11월 17일