EgoSuite-Open100K: 100,000 hours of egocentric human data for Physical AI. Published August 26, 2026 The first 10,000 hours are live on the Hub now. The rest is coming in stages. Lightwheel has released EgoSuite-Open100K, an open egocentric human activity dataset built for Physical AI, in partnership with Hugging Face. The full dataset will total 100,000 hours of first-person human activity across 15,000+ tasks and 15,000+ real-world collection scenes. The first 10,000 hours are available now. Not sure where to start? EgoDemo is a 50-hour sample covering every annotated subset plus two raw-video variants - a fast way to get a feel for the data before pulling the full release. At a glance. | Total dataset | 100,000 hours | | Available now | 10,000 hours | | Tasks | 15,000+ | | Collection scenes | 15,000+ | | Environmental categories | 7 | | Scene types | 128 | | Task categories | 18 | | Annotations | Hand pose, body pose, plus event-level semantic annotation on select subsets | | Camera setup | Egocentric head-mounted; wrist camera in EgoPro | | Formats | LeRobot v3, MCAP | | Usage | Academic research and commercial training | Why egocentric human data. Robots don't just need to see the world, they need examples of how people act in it: reaching, grasping, sequencing steps, recovering from a fumble, finishing a task start to finish. That's the kind of supervision egocentric human video can provide at a scale robot-only data collection struggles to match. Robot-specific data can then build on top of it rather than carry the whole load alone. There's growing evidence this scales. NVIDIA's EgoScale work found a log-linear scaling relationship across 20,854 hours of egocentric human video, and separate scaling experiments from Dyna Robotics point the same direction: more, and more diverse, human experience keeps improving downstream performance. A big industry problem is that most of the data at the scale these experiments need is private. Hugging Face thought that was worth changing, so Hugging Face has opened this up. Getting to 100,000 hours. At this scale, the hard part isn't recording more video. It's keeping collection consistent. Small differences in capture setup, environment, task definition, or annotation quality add up fast once you're talking about tens of thousands of hours. EgoSuite-Open100K was collected by a globally distributed workforce, with tens of thousands of collectors working within a standardized, continuous collection process. Hugging Face track coverage targets across collector recruitment and geography, the scene library, and task allocation, so growth doesn't come at the cost of consistency. 100,000 hours of the same few environments wouldn't do much for anyone. The full dataset spans: * 7 environmental categories: home, hospitality, retail, sports, logistics, office, industry * 128 scene types: bedrooms, kitchens, retail floors, warehouses, assembly lines, offices, and more * 18 task categories: assembly and installation, cooking, inventory management, tool use, repair and maintenance, packing, and other everyday and professional work From video to structured behavior. Raw egocentric video carries a lot of signal, but most of it isn't directly usable without structure on top. The collection is organized into two capture configurations, each split into sub-SKUs by annotation depth: EgoStandard - the bulk of the dataset, standard egocentric capture. * EgoStand: hand pose (80,000 h planned) * EgoStand-Body: hand pose + full body pose (10,000 h planned) EgoPro - adds a wrist-mounted camera for close-range interaction, contact, and grasping that a head-mounted view alone tends to miss (hands leaving frame, occlusion right at the moment of contact, fine detail that's a few pixels at head height). * EgoProStandard: wrist + hand pose (8,000 h planned) * EgoProStandard-Body: wrist + hand pose + full body pose (2,000 h planned) If you want a taste of all of it before committing to the full download, EgoDemo packages 50 hours pulled from all four sub-SKUs above, plus two raw-video variants. Three annotation types run across the dataset: Hand pose: Hands are the hard part of egocentric data - small in frame, fast-moving, frequently occluded, often interacting with visually cluttered objects. Hugging Face built its hand-pose pipeline specifically around these failure modes. Body pose: Ties hand and arm movement back to the surrounding task and environment. Event-level semantic annotation: On selected subsets, gives higher-level structure over time - what's happening, not just what's moving. Annotation and camera coverage vary by subset - check individual dataset cards on the Hub for exact modality coverage. Formats. It's released in LeRobot v3 so it's training-ready and streamable straight from the Hub, and in MCAP for teams running their own robotics/multimodal data pipelines. Get started. What it's for. Hugging Face released this openly because Hugging Face want to see what people build with it. Some directions Hugging Face expect to be useful: * VLA (vision-language-action) model pretraining * World model pretraining * Human-to-robot behavior transfer * Egocentric representation learning * Hand-object interaction modeling * Action and activity recognition * Task and intent understanding * Long-horizon activity understanding * Human and hand pose estimation * Learning representations of real-world manipulation Hugging Face'd also be surprised if that list covers everything people end up doing with it. A step toward shared standards. Scale isn't the only thing holding egocentric data back - capture conventions, annotation schemas, sensor configs, and storage formats are still fragmented across the field, which makes datasets hard to combine and compare. Through its work with the EgoVerse consortium, Hugging Face is aligning EgoSuite with emerging standards for egocentric data capture, annotation, and sharing, and hoping this contributes to that conversation as much as it contributes more data. This is 10,000 of 100,000. Hugging Face is releasing the rest progressively, and this first batch is also a chance for the community to shape what comes next. If you're training or evaluating on EgoSuite, Hugging Face'd like to know: * Which tasks are most useful to you? * What environments feel underrepresented? * Which annotations matter most? * What additional modalities would help? * Where does the dataset fall short? Open a discussion on the relevant dataset repo on the Hub and tell Hugging Face what you find - it'll help shape the next 90,000 hours. You can also join the Lightwheel Discord to ask questions, share what you're building with the dataset, and talk directly with the team. Licensing. The released subsets are available for academic research and commercial training. For licensing details, modality coverage, and subset-specific structure, see the individual dataset cards on Hugging Face. Resources. This is the first public layer of the data infrastructure Hugging Face is building for Physical AI, not the finished product. The interesting part starts now - what models learn from it, where it holds up, where it doesn't, and what the community finds once human data at this scale is actually in use.

WAIC 2026 | RoboSense officially unveils second-generation all-solid-state perception platform E2. Edited by Betty From Gasgoo | July 17, 2026 19:08 BJT Gasgoo Munich- RoboSense has unveiled its second-generation all-solid-state perception platform, the E2, at the 2026 World Artificial Intelligence Conference (WAIC). Built on the company's in-house "Peacock" SPAD-SoC chip, the platform was showcased alongside a suite of digital LiDAR and fusion sensors powered by both the "Peacock" and "Phoenix" chips. The display maps out a complete technology chain spanning from underlying chips and spatial perception products to the acquisition of real-world data. The E2 platform leverages the in-house "Peacock" SPAD-SoC and 2D VCSEL chips to adopt an all-solid-state architecture, handling everything from signal transceiving to data processing at the chip level. Compared to its predecessor, the E1, the E2 series delivers a wider field of view within a more compact form factor. Precision has tripled, and the point frequency hits the million-level mark, making it suitable for a wide range of applications, including lawn-mowing robots, humanoid robots, quadrupeds, and drones. Image Source: RoboSense The E2 has already secured orders from leading global players in yard robotics, smart hardware, and consumer electronics, moving swiftly into the mass-production phase. RoboSense has also forged partnerships with clients in the physical AI ecosystem, specifically those focused on spatial perception and real-world data acquisition. RoboSense also announced strategic alliances with BeingBeyond, Origen, and Lightwheel. These partnerships will focus on robotic spatial perception, real-world data collection, processing, model training, and application validation. Together, they aim to advance the infrastructure for physical AI perception, extending the reach from the "eye of the robot" to the data entry point for physical AI, accelerating RoboSense's evolution toward a robotics platform company. Centered on three core capabilities - in-house chip development, AI data closed-loops, and automotive-grade mass production - RoboSense is systematically building a robotic technology platform tailored for the physical AI era. At the heart of this evolution lies the chip, serving as the bedrock for continuous advancement in perception technology. On the AI integration front, robots equipped with RoboSense's perception products can generate computable and learnable data assets while moving and operating. This capability creates an efficient closed loop between the perception system and intelligent models, providing the high-quality data support needed for the continuous evolution of physical AI large models. In terms of engineering delivery, RoboSense draws on years of experience in automotive-grade R&D, testing, and manufacturing. The company has established a comprehensive system spanning chip design, product development, and large-scale delivery. This mature engineering capability is now expanding into the robotics sector, ensuring that new technologies transition rapidly from the laboratory to viable, deliverable industrial solutions rather than stalling at the prototype stage. Gasgoo not only offers timely news and profound insight about China auto industry, but also help with business connection and expansion for suppliers and purchasers via multiple channels and methods. Buyer service: [email protected] Seller Service: [email protected]