feat(sensors): Add v2 bimanual model for OpenArm 2.0 #17
feat(sensors): Add v2 bimanual model for OpenArm 2.0 #17shubhambaid wants to merge 2 commits intoenactic:masterfrom
Conversation
- Added 'camera-wrist-right' to 'openarm_right_link7' - Added 'camera-wrist-left' to 'openarm_left_link7' - Added 'camera-head' to 'openarm_body_link0' - Added 'camera-ceiling' to 'worldbody' - Note: Used baseline pos/euler approximations. Exact physical offsets will be updated once OpenArm 2.0 measurements are provided.
|
Ah, sorry. Could you create We don't add cameras to |
|
Could you update the PR title and description for the current change? |
|
Hi @shubhambaid, Thanks for the PR! This is extremely helpful as we are currently developing OpenArm 2.0. Regarding the camera setup, we've reviewed the requirements and concluded that the 'front' and 'side' cameras will not be necessary for our current inference dataflow. We'll focus on the four cameras you added (head, ceiling, and both wrists). On our end, we are heavily focused on minimizing the "sim-to-real gap" and are actively working on System Identification (SysID). Because we expect to iteratively update physical parameters (friction, mass, inertia) and camera offsets based on our SysID results, I'd like to refactor the MJCF structure into a more modular format. This will allow us to push updates to specific parameters without touching the core robot structure. Here is my proposed organization: This is just my initial proposal—if you have a better idea for the structure or any other suggestions to facilitate better SysID workflows, I’m very much open to them! I will let you know as soon as the v2 hardware is finalized so we can update the baseline approximations with exact measurements. Looking forward to your thoughts! |
Thanks for the detailed context! I completely agree with dropping the front and side cameras to keep the inference dataflow lean. Your proposed modular structure is spot on for a SysID workflow. One quick suggestion: we can heavily leverage MuJoCo's classes inside physics_defaults.xml so you can globally tune parameters for specific component types (like all arm joints or gripper pads) with a single edit. How would you like to handle the rollout? I can either update this PR to implement the new modular directory structure right now, or we can merge these camera additions as a baseline and tackle the refactor in a follow-up PR. Let me know what works best for your roadmap! |
This PR adds the
v2/openarm_bimanual.xmlMJCF model by adding the camera sensors required by the downstream inference dataflow for OpenArm 2.0. This aligns the simulation's sensor outputs with the expected hardware topics.