google-deepmind/robotics-antigravity-plugin

sim2real-gauntlet

Verifies a robot manipulation controller in MuJoCo simulation (robosimgauntlet) across perturbation tiers T0-T4 with .mcap logging, physical safety grading, and paired Common Random Numbers before real-robot deployment.

Vedi sorgente

Come usare

  1. Copia il comando e controlla il pacchetto prima di installarlo nel tuo ambiente agente.
  2. Controlla strumenti, credenziali e ambienti richiesti nel documento originale.
  3. Descrivi input e risultato desiderato; confronta l’output con le fonti.
npx skills add https://github.com/google-deepmind/robotics-antigravity-plugin --skill sim2real-gauntlet

Prima di iniziare

  • L’installazione non include abbonamenti, quote API o accesso ai file.
  • Stelle e installazioni indicano attività, non un test indipendente di qualità o sicurezza.
Documento Skill originale

Contenuto dal repository con titoli, esempi, codice, tabelle, link e immagini preservati.

Sim-to-Real Gauntlet (robosim_gauntlet)

Library and CLI in src/robosim_gauntlet (put src/ on sys.path; cli.ensure_gl_backend() preserves explicit MUJOCO_GL or selects packaged egl/osmesa). Reference consumers: playground_tasks.py and color_blob_ik_controller.py.

Workflow

  1. Task (task.Task protocol): build_device_layer(mode="sim"|"real", extra_devices) returns (numpy DeviceLayer, reset, close) (Impl.CPP in sim; real homes on reset() and parks on close()). Also deployment_keys(), success(poses, poses0), and safety (SafetyLimits: 3D contact wrenches + indirect crush, 35 N grasp cap, bimanual arm_prefixes / gripper_tokens / command_to_joint, and drop_z_tol_m=None / require_release=False / goal_setter for insertions, hinged fixtures, or tool-in-hand tasks).
  2. Controller: either an out-of-process command driving proxy.RemoteDeviceLayer(os.environ["GAUNTLET_URL"]) (prompt in GAUNTLET_PROMPT, printing {"status": "done"|"abort", "fault": ...} last) or an in-process callable fn(dl) -> dict wrapped in wrappers.AllowlistWrapper (include_latency=False default). Both see only deployment_keys() + <cam>_timestamp (upstream timestamps forwarded/delayed; camera reads tracked via last_cam_read_tick).
  3. Preflight: preflight.run(task) audits scene invariants + negative/positive goal controls (safety.goal_setter for articulated fixtures).
  4. Sweep / CLI: episode.run_suite([task], cmd_or_fn, episodes=..., mcap_dir=...) or python -m robosim_gauntlet.cli --task-py=path.py[:fn] --robot=yam --controller="..." --output-json=v1.json --baseline-json=v0.json --mode=sim|real --mcap-log-dir=... (set GAUNTLET_CRN_SECRET for HMAC CRN).
  5. Debug: episode.fork(result, task, tick, cmd_or_fn) replays logged commands to tick deterministically, then hands off; McapWrapper writes .mcap logs via mujoco_playground.real.create_logger identically in sim and real.

Tiers

TierPerturbation
T0nominal
T1 / T2moderate / adversarial pose, table, mass, friction, gains, noise, hue
T3slip, mid-approach push, or post-place knockout (idx % 3)
T4self-model mismatch + 50% terminal fault: camera_freeze (frozen or restamped) or dead_gripper

T4 faults must end in {"status": "abort", "fault": <fault>}; aborting without a fault is spurious_abort. Verdicts: BETTER / WORSE / INDISTINGUISHABLE (one-sided exact McNemar, alpha 0.025, >= 6 discordant pairs) with safety veto.

dallo stesso repository

Altri Skills

Tutti gli Skills
google-deepmind
Community

blender-creation

Creates physically calibrated, articulated, PBR-textured 3D MuJoCo assets (MJCF model.xml, .mjz, mjSpec) from scratch using headless Blender (bpy, bmesh, blendermeshutils, assetbuildutils), convex collision synthesis, 10-scenario auditing, and Studio preview. Use only when asked to create, model, or build a 3D MuJoCo object from a URL, image, or text description, or when blender-creation is named. Don't use for non-MuJoCo Blender/Cycles/CAD modeling.

Installazioni / 1h
2
GitHub Stars
80
Aggiornato
17 nov
google-deepmind
Community

fr3-duo-control

Franka Duo robot only (Franka Research 3 / FR3 Duo dual-arm cell with Robotiq 2F-85 grippers, ZED Mini and RealSense D405 cameras). Brings up, homes, and controls it via pylibfranka on hardware or in MuJoCo sim. Use only when the user names Franka Duo, FR3 Duo, or fr3duo.

Installazioni / 1h
2
GitHub Stars
80
Aggiornato
17 nov
google-deepmind
Community

i2rt-yam-bringup

Checks and installs the I2RT YAM SDK (i2rt), configures Linux socketcan or macOS gsusb CAN bringup for I2RT YAM robot arms, and provides a wave smoke test (wave.py). Use only before bringing up or programming a physical or simulated I2RT YAM robot arm, or when asked to run a wave gesture on an I2RT YAM robot. Don't use for non-YAM CAN bus debugging (e.g. automotive OBD-II or industrial PLC CAN networks) or non-robotics tasks.

Installazioni / 1h
2
GitHub Stars
80
Aggiornato
17 nov
google-deepmind
Community

i2rt-yam-ik

Solves 6-DOF inverse kinematics for the I2RT YAM and YAM Pro robot arm using Mink + DAQP on combined YAM + gripper MJCF. Use only when computing joint targets or local Cartesian moves on an I2RT YAM or YAM Pro robot arm. Don't use for non-YAM inverse kinematics, general quadratic programming (QP) solvers, or non-robotics tasks.

Installazioni / 1h
2
GitHub Stars
80
Aggiornato
17 nov