Egocentric video data from real factory floors
Egocentric video is footage filmed from the worker's own point of view, with a camera on the head or chest. It shows what a person looks at and what their hands do, from a viewpoint close to a robot's own head camera. We record it in working factories across Gujarat during normal shifts, and deliver it raw or labelled.
Why robotics teams use it
A camera worn by the worker stays on the task. The hands and the object stay in frame as the person moves, so you see how they reach, grip, check and correct, in the order they really do it. Footage shot from across a room can lose all of that behind a shoulder or a machine.
It's also the easiest kind of demonstration data to collect in quantity. No robot has to be on site, and a worker can wear a camera through a normal shift.
Factory footage is different from work filmed at home or in a lab. People repeat the same job all day, with real parts, worn tools, clutter and poor light. That's what a model will meet when it leaves the lab.
Egocentric video has limits, and it helps to plan for them. It shows what a person did, but it doesn't record a robot's movements, and human hands aren't robot grippers. Hand positions have to be worked out from the footage, which is why hand keypoint labels are common. Many teams use egocentric video to learn how a task is done, then add teleoperation data from their own robot.
Capture setups
- Head camera
- Follows the eyes to the work, so you can see what the worker checks as well as what their hands do. It suits close work such as polishing, sewing and inspection.
- Chest camera
- Steadier than a head mount, with a clear view of both hands. It suits people who stand, lift and move around a table or a line.
- Wrist cameras
- Added to a head or chest camera for close views of fingers, grips and small parts, which other cameras often can't see.
- Your own hardware
- Send us your cameras or capture rig with your recording spec, and our crew will run them on site. If you don't have a spec yet, we can help you write one.
- Labels
- Task and step boundaries, hand keypoints, objects and a short description of each action, or your own guidelines. A person checks every clip before it ships.
What you can record
We record egocentric video in all of these industries. Each page explains the work and the towns.
- Textiles and garments
- Sewing, folding, pressing and packing: two hands managing cloth that changes shape.
- Diamond cutting and polishing
- Polishing and sorting tiny stones with tweezers, holders and a loupe.
- Ceramics
- Grading and packing tiles, and finishing and checking basins.
- Machining and engineering
- Loading machines, checking parts and putting them together.
- Brass and metal parts
- Finishing, sorting and assembling small, shiny parts.
- Chemicals and pharma
- Filling, sampling, lab handling and packing.
- Automotive
- Kitting, sub-assembly and inspection.
- Food processing
- Sorting, cutting, packing and sealing, under each plant's hygiene rules.
Consent and privacy
A camera on the worker can also catch the people around them and whatever is on the bench. Every worker who appears in the data signs an informed consent form, and every factory signs an agreement covering what we record and how it can be used.
We can blur faces and anything confidential on the shop floor before delivery.
Common questions
What is egocentric video data?
It's video filmed from the point of view of the person doing the work, usually with a camera on the head or chest. In robotics it's used as training data, because it shows how people handle objects from a viewpoint close to a robot's.
How is egocentric video used to train robots?
Teams use it to teach models how a task is done: what to look at, where the hands go and in what order. It's often used with labels such as hand keypoints and step boundaries, and combined with data from the robot itself.
Do you record in real working conditions?
Yes. Our crew films during normal shifts in working factories, not staged in a lab.
Can we check the footage before ordering more?
Yes. We start with a pilot: a few hours of footage of your task, so you can check the quality before committing to more.
Can you deliver in our format?
Yes. We deliver in batches, in your format, either raw or with the labels you choose.
Other kinds of data
Start with a pilot
Tell us which tasks you need recorded, the camera setup and the labels you want. We'll reply with questions and a plan for a pilot: a few hours of footage first, so you can check the quality before committing to more.