Human demonstration data for robot learning
Human demonstration data records a person doing a task so that a robot can learn to do it. We record skilled workers doing real jobs in factories across Gujarat, with whichever setup suits your model: first-person video, wrist cameras, multi-view rigs or teleoperation. You get the data raw or labelled.
How robots learn from demonstrations
Much of the work robotics teams want to automate is hard to write down as rules. Cloth slips, small parts turn in the fingers, and no two pieces behave quite the same. So teams show the work instead of describing it: a model learns from many examples of people doing a task well, including the small corrections they make when something goes wrong.
Demonstrations come in two broad kinds. Human-centric data records a person's own hands, with cameras on or around the worker, and can be collected in quantity. Robot-centric data records a person operating a robot, so it includes the robot's own movements, but it needs the robot on site. Many teams use both.
What matters most is that the demonstrations match the job your robot will do. A task staged on a clean bench can look right and still leave out what makes the real job hard: worn tools, mixed parts, interruptions and the pace of a shift. That's why we record during normal shifts in working factories.
Ways to record a demonstration
Not sure which you need? Tell us about the task and your model, and we'll suggest a setup.
- Egocentric video
- A head or chest camera gives a first-person view of both hands. It's the easiest setup to collect in quantity.
- Wrist cameras
- Close views of fingers and grips, usually added to a head or chest camera for fine work.
- Multi-view rig
- Two to four fixed cameras around a station, for repeatable angles and 3D hand pose.
- Teleoperation
- A worker does the task through your robot, so the data includes the robot's own movements. You send the robot and its controls, and we set it up at a real station.
- Labels
- Task and step boundaries, hand keypoints, objects and a short description of each action, or your own guidelines. A person checks every clip before it ships.
What you can record
This work is done by hand every day in Gujarat. If the task you need isn't listed, ask.
- Textiles and garments
- Deformable objects: folding, sewing and packing cloth with two hands.
- Diamond cutting and polishing
- Fine manipulation: tiny stones, precise grips and constant checking.
- Ceramics
- Handling and inspection: grading and packing tiles, and checking basins.
- Machining and engineering
- Machine tending: loading machines, checking parts and assembly.
- Brass and metal parts
- Small, shiny parts: finishing, sorting and assembly.
- Chemicals and pharma
- Careful handling: filling, sampling, lab work and packing.
- Automotive
- Assembly: kitting, sub-assembly and inspection.
- Food processing
- Food handling: sorting, cutting, packing and sealing.
Consent and privacy
Every worker who appears in the data signs an informed consent form, and every factory signs an agreement covering what we record and how it can be used.
We agree with the owner beforehand what can be filmed, and we can blur faces and anything confidential on the shop floor before delivery.
Common questions
What is human demonstration data?
It's a recording of a person doing a task, captured so that a robot can learn from it. It can be first-person video, multi-view footage or teleoperation data, raw or labelled.
What's the difference between human-centric and robot-centric data?
Human-centric data records a person's own hands, usually with cameras on or around the worker. Robot-centric data records a person operating a robot, so it includes the robot's own movements. The first is easier to collect in quantity, and the second maps more directly onto your robot.
Which kind should we start with?
It depends on the task and on what your model needs. Tell us about both and we'll suggest a setup. A small pilot then lets you check the data before committing to more.
Which tasks can you record?
Work in textiles and garments, diamond cutting and polishing, ceramics, machining, castings, brass parts, chemicals, pharma, automotive and food processing. If a task is done somewhere in Gujarat, we can usually find it.
Do you work with teams outside India?
Yes. You work with us remotely and we handle everything on the ground in Gujarat.
Other kinds of data
Start with a pilot
Tell us which tasks you need recorded, the camera setup and the labels you want. We'll reply with questions and a plan for a pilot: a few hours of footage first, so you can check the quality before committing to more.