Researchers led by Brik Meza have built HandUMI, a hand-worn parallel-jaw gripper interface for recording two-handed demonstrations without a robot, according to a paper on arXiv. Its fingertips can be swapped to match the robot's gripper, Quest or PICO controllers track the hands, and encoders measure how far the jaws open.

The recordings are converted for seven simulated two-armed robots, with a median position error of at most 1.2 mm. On towel folding, 562 demonstrations trained policies for real PiPER arms: ACT succeeded in 12 of 20 attempts and a fine-tuned π0.5 in 7 of 20. ACT trained on only the first 101 demonstrations and the base π0.5 model failed all 20 attempts.

The hardware and software are open source, and a pair costs $557 with a Quest 3S headset, not counting an optional camera and the host computer.

Source: arXiv Robotics (cs.RO)

Background

Brik Meza

Robotics researcher

Robotics researcher.