Head of Design

NVIDIA Omniverse libraries put AI agents to work prepping 3D content for simulation. by Harold Fritts on July 20, 2026 NVIDIA has introduced Omniverse libraries, a set of software components designed to bring physical AI capabilities into existing 3D applications and prepare content for simulation. The libraries are intended to help developers, technical artists, and engineering teams build workflows that inspect scenes, validate assets, model physical behavior, and generate sensor data for robotics, factory automation, and autonomous-system development. Physical AI systems typically require training and validation in simulated environments before deployment. That process depends on more than photorealistic 3D content. Simulation assets must include correct geometry, materials, scale, labels, sensor definitions, and physical properties such as mass, friction, and collision behavior. NVIDIA positions the new libraries as building blocks for AI agents that can assist with these preparation and validation tasks inside established design and content-creation environments. The initial release includes ovrtx, ovphysx, and CAD-to-SimReady skills. The components are available on GitHub, alongside a Blender integration blueprint that demonstrates how developers can add agent-ready simulation features to an existing 3D application. ovrtx provides NVIDIA RTX-based sensor simulation, enabling applications to generate virtual camera, lidar, radar, and other sensor outputs from 3D scenes. This capability allows developers to assess how a physical AI system would perceive a simulated environment before testing hardware in the field. The ovphysx library brings GPU-accelerated physics capabilities to simulation workflows. It supports modeling of collisions, mass, friction, motion, and other physical interactions required to evaluate robotic behavior and industrial processes in a virtual environment. CAD-to-SimReady skills focus on converting CAD data into OpenUSD-based SimReady assets. The workflow is intended to preserve engineering content while adding the structure and simulation attributes needed for physical AI development, including robotics and autonomous-system testing. Early software integrations. SideFX and PTC are among the software providers working with the Omniverse libraries. SideFX is evaluating OpenUSD workflows with ovrtx and ovphysx as part of its Houdini procedural 3D content-creation environment. The effort aims to enable agent-assisted workflows for generating procedural content, evaluating physics, and preparing scenes for simulation, while keeping technical artists in control of the underlying creative process. PTC is integrating OpenUSD and ovrtx into its Onshape CAD and product data management platform. The integration is intended to connect cloud-native design workflows with physical simulation, allowing engineering teams to carry product content across CAD, PDM, collaboration, validation, and simulation processes without repeatedly reworking assets. At SIGGRAPH 2026, NVIDIA demonstrated a SimReady Blender workflow built with the Omniverse libraries and the NVIDIA Nemotron Ultra open model. The reference implementation shows how developers can introduce RTX sensor simulation, physics, and validation into Blender-based workflows while retaining creator control. NVIDIA has made the Blender blueprint publicly available. The company stated that these workflows can run locally across systems ranging from compact NVIDIA RTX Spark devices to NVIDIA GB300-powered DGX Station systems. NVIDIA expects RTX Spark systems from several OEM partners to become available in the fall, while DGX Station systems are available through multiple system providers. Startups build agent-assisted asset pipelines. Several startups are also applying Omniverse components to asset and scene-preparation workflows. Palatial is using CAD-to-SimReady skills to automate the creation and validation of SimReady assets from CAD files at scale. Lightwheel uses NVIDIA Content Agents and OpenUSD in its SimReadyGen technology to generate physically accurate simulation assets from text prompts. ForgeCAD and MoonlakeAI are developing agent-powered 3D workflows built on Omniverse capabilities. Their work focuses on assisting with the creation, enhancement, and preparation of assets for simulations used to train and validate real-world AI systems. Engage with StorageReview Harold Fritts. I have been in the tech industry since IBM created Selectric. My background, though, is writing. So I decided to get out of the pre-sales biz and return to my roots, doing a bit of writing but still being involved in technology.

Moonlake AI unveils 3D world-building agent capable of reconstructing complex scenes from single image input. Published: April 30, 2026 at 5:40 am Updated: April 30, 2026 at 5:40 am Edited and fact-checked: April 30, 2026 at 5:40 am Moonlake AI introduces a 3D Agent that builds and refines complex virtual worlds from images, enabling automated scene generation, asset reconstruction, and integration into creative workflows. Moonlake AI, a research lab focused on data-driven simulation systems, has announced the introduction of a new 3D Agent designed to generate and reconstruct complex virtual environments from minimal visual input. According to the company, the system functions similarly to a technical artist, capable of building articulated assets and large-scale editable scenes containing hundreds of objects from a single image, while continuously refining its outputs over time. The lab described the development as part of a broader shift in AI toward automated world-building, an area that extends beyond conventional text-based or code-based reasoning. While modern AI systems have increasingly been used to automate structured knowledge work through iterative loops of generation, execution, and verification, the company noted that simulation and 3D environment creation introduce additional complexity due to the need for spatial, geometric, and causal understanding that is not explicitly provided in task instructions. This category of work is estimated to represent a multi-billion-dollar segment across industries such as simulation, gaming, animation, film production, and visual effects. Moonlake AI stated that its initial focus is on integration with widely used creative software environments, including Blender, enabling developers and artists to incorporate agent-based workflows into existing production pipelines. The system is designed to operate through long-horizon iterative processes rather than producing single-step outputs. In this framework, the agent refines 3D scenes, reconstructs assets, and manages articulated models through repeated cycles of evaluation and improvement. The optimization process is guided by layered objectives that assess scene quality at multiple levels, including overall visual fidelity and realism, consistency with reference material or concept art, and structural correctness in object placement, alignment, and connectivity. Structural validation is enforced through code-based verification mechanisms intended to detect spatial inconsistencies that may not be captured by vision-language models alone. This approach addresses limitations in existing systems where fine-grained errors in geometry or layout can remain undetected despite visually plausible outputs. The agent is also designed for integration within established production workflows, including digital asset management systems and interactive editing environments such as Blender. It supports incremental modifications and localized adjustments within scenes, allowing for continuous refinement during development processes. In addition, it can learn from expert demonstrations and generalize procedural knowledge across tasks, effectively transforming repetitive production work - such as naming conventions, object state management, camera setup, material consistency, lighting configuration, and export preparation - into automated workflows. Moonlake AI proposes scenario-based benchmarking to improve evaluation of world-building AI systems. The broader research effort also outlines the need for improved benchmarking systems for evaluating world-building models. It argues that virtual environments are governed by implicit structural rules, including spatial coherence, temporal consistency, causal sequencing of events, and persistent object behavior over time, all of which are difficult to measure using existing evaluation frameworks. Current benchmarks, such as GameDevBench, primarily rely on tutorial-based tasks and predefined implementation instructions, which tend to evaluate replication of instructions rather than goal inference or adaptive problem-solving. Similarly, OpenGame-Bench introduces more interactive testing through end-to-end game construction, but still focuses heavily on basic functionality such as compilation, loading, and rendering, while often failing to detect subtle but critical logic errors within game systems. Moonlake AI proposes addressing these limitations by converting real-world development issues into executable scenario-based tests derived from production environments and development logs. These tests are designed to simulate controlled interactions within a virtual world, allowing specific states and actions to be evaluated against expected outcomes. This approach is intended to make otherwise silent failures - such as broken state transitions, inconsistent item behavior, or incorrect interaction logic - explicit and measurable. The evaluation framework mirrors human playtesting methodologies by systematically probing in-game behavior under varied conditions, while maintaining reproducibility for automated assessment. To account for implementation differences across systems, an adaptive grading mechanism is used to align test execution with each candidate environment while preserving the underlying behavioral criteria. Disclaimer. In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, Mpost Media Group suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice. Alisa, a dedicated journalist at the MPost, specializes in crypto, AI, investments, and the expansive realm of Web3. With a keen eye for emerging trends and technologies, she delivers comprehensive coverage to inform and engage readers in the ever-evolving landscape of digital finance. Alisa Davidson Hot Stories by Alisa Davidson April 30, 2026 by Alisa Davidson April 30, 2026 by Alisa Davidson April 30, 2026 by Alisa Davidson April 30, 2026 by Alisa Davidson April 30, 2026 by Alisa Davidson April 30, 2026 by Alisa Davidson April 30, 2026 by Alisa Davidson April 30, 2026