UMI gripper profile: collecting robot data without a robot
A handheld gripper with a camera. It collects demonstrations faster than teleoperation and cannot control a robot.
Contents
| Type | Handheld capture gripper |
|---|---|
| Founded | Published at RSS 2024 |
| Pricing | Not published |
| Website | umi-gripper.github.io |
Some teams looking for teleoperation hardware need demonstrations, not control. For them the Universal Manipulation Interface, a finalist for the best systems paper award at RSS 2024, removes the robot from data collection altogether1.
Best for: Collecting many gripper demonstrations quickly, in real places, with no robot on site.
Not the right fit for: Live control of a robot: UMI records demonstrations, it does not drive anything.
How it works
The hardware is a handheld parallel-jaw gripper with a GoPro camera mounted on it. A person carries it through the task. The recording captures the visual context, the gripper’s motion and fine changes in gripper width, and the project’s software checks whether each demonstration is feasible for a given robot. The project page links a codebase, a hardware guide and printing and assembly tutorials1.
Published evidence
The authors report about 30 seconds per demonstration. On a cup arrangement task they measured 111 demonstrations an hour with the UMI gripper, 231 with a bare human hand and 35 with space-mouse teleoperation. The same policy ran on UR5e and Franka arms, and the authors state it can run on any robot with a parallel jaw stroke over 85 mm1. These are the authors’ figures.
Strengths and limits
Strengths
- About three times the throughput of space-mouse teleoperation on the authors’ cup task.
- Hardware-agnostic: the authors state the policy can run on any robot with a parallel jaw stroke over 85 mm.
- A demonstration takes about 30 seconds, per the authors, and needs no robot in the room.
Limits
- Not teleoperation. It cannot take over a deployed robot or correct one mid-task.
- Limited to parallel-jaw gripping.
- No price is stated on the project page.
Choose another option if: You need a person to control the robot in real time, for interventions or for data on the robot’s own body (any other option here).
Pricing
Not published on the project page.
Questions to settle before building
- Does the task need live control of the robot at any point, such as taking over a deployed unit?
- Does our gripper meet the stroke requirement?
- Who will carry the gripper, where, and on what protocol?
- How will we check that the collected demonstrations run on our arm?
See how UMI compares with the other options in the rig comparison table.
Sources
- Universal Manipulation Interface: in-the-wild robot teaching without in-the-wild robots. Chi et al. (RSS 2024). Accessed 11 Nov 2026.