Writing

Physics Engines Are Becoming Trainable Components

A simulator predicts what happens next. A differentiable one can answer which parameter should change to stop the failure.

Notes

For most 3D and game-development work, a physics engine has one basic job: given the current state and some forces, predict what happens next.

That is forward simulation. It is how rigid bodies fall, cloth deforms, vehicles move and characters interact with the world.

Newton 1.0, released at GTC this week, points toward a broader role. The open-source engine from NVIDIA, Google DeepMind and Disney Research is built on Warp and OpenUSD, supports several solver families, and is designed for robot learning as much as conventional simulation. One of its defining features is differentiable physics: the simulation can provide gradients that describe how a result changes when an input, control signal or physical parameter changes.

I think that distinction will matter beyond robotics.

A physics engine is starting to become something an optimiser can reason through, not only something a user can run forward.

Forward simulation answers what happened

A traditional solver takes state at time t and advances it.

Give it positions, velocities, masses, constraints, contacts and forces. It integrates the system and produces the next state. Repeat that process and you have a simulation.

Newton 1.0 is built around that reality rather than one universal solver. NVIDIA describes a modular architecture containing several physics backends and numerical methods. MuJoCo Warp targets fast rigid-body simulation. Kamino handles mechanisms with closed loops. Vertex Block Descent can work with deformable materials such as cloth and cables, while material-point methods can handle granular systems such as sand.

Differentiability adds another dimension.

A differentiable simulator can answer what should change

Suppose a robot arm drops an object.

A normal simulator can reproduce the failure if I give it the same initial conditions. It can tell me where the object moved and when contact occurred.

A differentiable simulator can help answer a different question: which parameters should change to reduce the failure?

If the simulation is differentiable, an objective at the end of the trajectory can propagate information backward through the physical computation. The system can compute how sensitive the outcome was to control inputs, friction, mass, geometry parameters or other variables represented in the simulation.

That turns physics into part of an optimisation graph.

Warp is built for this kind of workflow. NVIDIA's March update shows GPU simulation kernels written in Python, compiled for high-performance execution and differentiated automatically so they can participate in reverse-mode optimisation. The same simulation code can therefore generate a physical trajectory and provide gradients for a learning or design algorithm.

The simulator enters the training loop

This changes the relationship between simulation and AI.

In many reinforcement-learning systems, simulation acts as an environment. An agent performs an action, the simulator returns the next state and a reward, and the learning algorithm gradually discovers a useful policy through repeated experience.

Differentiable physics gives us another path. When the problem allows useful gradients, parts of the learning signal can pass through the physical system itself.

Newton was designed around that connection. NVIDIA describes differentiability as a way to improve policy optimisation, design optimisation and system identification. The engine integrates with Isaac Lab and MuJoCo-based workflows, so physics is no longer an isolated module sitting beside machine learning. It can become one of the computations inside the learning system.

The simulator stops being only the place where we test a policy. It can participate in producing the policy.

System identification may be just as important as control

There is another use that feels immediately practical: recovering physical parameters from observed behaviour.

A simulation is only as useful as its assumptions. If friction, stiffness, damping or mass distribution are wrong, the virtual result can diverge from the real system even when the solver itself is accurate.

System identification works backward from observations. Instead of asking what a known system will do, we ask which physical parameters would produce the behaviour we observed.

With differentiable simulation, that inverse problem can become an optimisation problem. Start with parameter estimates, simulate the system, compare the result with measurements, propagate the error backward, then update the parameters. This is one of the established application areas for differentiable simulators.

Imagine recording a real piece of fabric, soft packaging or a mechanical object, then fitting simulation parameters until the virtual behaviour matches the footage. The artist is no longer tuning stiffness and damping entirely by eye. The simulation can help infer them from reference data.

This could change how simulation is authored in 3D tools

Choose a solver. Set mass. Adjust collision margins. Tune cloth stiffness. Run the result. Look at what failed. Change values. Run it again.

Differentiable simulation suggests a different workflow for some tasks.

The artist defines the target behaviour and the parameters the system is allowed to modify. The optimiser searches for a configuration that produces the desired result.

It could remove a large amount of parameter hunting where the desired target is measurable.

Physics becomes another differentiable layer

Physics traditionally sat outside the learning graph. The model could produce an action and the simulator could evaluate it, but the boundary between them often behaved like a black box.

Frameworks such as Warp reduce that separation. Simulation kernels can exchange data directly with PyTorch and JAX workflows while still expressing the control flow and sparse operations common in physical solvers.

That is a more interesting hybrid than asking a neural model to rediscover all of physics from data.

Differentiability does not make simulation true

A simulator can provide precise gradients of the wrong model.

If the contact model is inaccurate, if the material representation is too simple, or if the real system contains behaviour the simulator does not represent, gradient descent can optimise toward a solution that works beautifully in simulation and fails outside it.

Contact itself is difficult because physical events can be discontinuous. Small changes can create or remove collisions. Friction introduces its own numerical problems. Differentiable simulators make engineering trade-offs around versatility, numerical behaviour and gradient quality.

It is a stronger optimisation interface to a model of reality. The quality of that model still matters.

What this means for production pipelines

For game development, I expect the near-term impact to be stronger in tooling than runtime gameplay.

A studio could optimise character controllers, vehicle parameters, procedural rigs or physically based interactions offline, then ship the resulting parameters into a conventional runtime. The player does not need gradient computation every frame for the training process to improve the final game system.

For Blender and product visualisation, inverse problems may be more useful than autonomous control. Matching physical parameters to captured reference, optimising a deformable setup toward a target shape, or finding design values that satisfy mechanical constraints could turn simulation into a production assistant rather than only a preview system.

The common idea is that simulation output stops being the end of the calculation.

It becomes feedback for the calculation that produced it.

My prediction

I think physics engines will gradually become trainable components in larger computational systems.

More solvers will expose gradients, parameter estimation and optimisation hooks as normal interfaces. Simulation will sit inside loops that tune controllers, infer material properties, optimise designs and train models.

That could blur another boundary in production software. The renderer is becoming part of neural reconstruction. The scene graph is becoming an interface for agents. The physics engine may become part of the learning graph.

I would not expect every game or Blender simulation to become differentiable. Many workloads do not need it, and some physical problems are poorly suited to gradient-based optimisation.

The architectural direction still matters.

A traditional physics engine tells us what the world will do when we change an input.

A differentiable one can begin telling the system how the input should change.

Sources

  1. NVIDIA Developer, Newton Adds Contact-Rich Manipulation and Locomotion Capabilities for Industrial Robotics, 16 March 2026.
  2. NVIDIA Developer, Build Accelerated, Differentiable Computational Physics Code for AI with NVIDIA Warp, 12 March 2026.
  3. NVIDIA Developer, Newton Physics Engine.
  4. Linux Foundation, Contribution of Newton by Disney Research, Google DeepMind and NVIDIA to Accelerate Open Robot Learning, 29 September 2025.
  5. Newbury et al., A Review of Differentiable Simulators, 2024.

More

Other write-ups

15 September 2026 Approval Is Not Publication Thirty seven items in the queue, one approved, nothing published. The last arrow in the diagram is the only one that pays. 2 min read 14 September 2026 Neural Rendering Is Crossing From Reconstruction Into Synthesis Reconstruction filled in what sparse sampling missed. DLSS 5 generates appearance the renderer never computed. 6 min read 14 September 2026 The Renderer Is Becoming a Training Data Engine The renderer used to sit at the end of the pipeline. Physical AI gives the same scene a second job: teaching a model. 6 min read 13 September 2026 Local AI Is Becoming a Compute Fabric Local AI meant one model on one machine. Routing inference across the devices already on a network changes the unit. 6 min read 12 September 2026 Agent Infrastructure Is Becoming a Product Category Every team used to build the loop, the store, the sandbox. That layer is being sold rather than written. 6 min read 12 September 2026 Choosing a local model with a stopwatch, not a benchmark Three models, five hard tasks, code actually executed. The official build was 2.4 times faster and more accurate than a community repack of the same model. 3 min read 12 September 2026 We measured real time lighting against baked light, and baked won A 3D product simulation that had to look like an offline render. The real time version ran at 60 frames per second and looked like clay. Here is the measurement and the architecture that replaced it. 4 min read 12 September 2026 What actually broke in an agency run by agents Three failures from a delivery stack that runs on AI. None of them were the model's fault, and all three reported success while producing nothing. 4 min read 11 September 2026 A Task Without A Check Command Is Not Automated If a task has no command that can fail, the pipeline advances on the appearance of work. 2 min read 10 September 2026 A Gate The Model Writes Is A Gate The Model Loosens Three quality gates returned green while the work behind them was wrong, each for a different reason. 2 min read 8 September 2026 The Scoring Model Was Wrong And It Put The Worst Lead First A weighted sum let one axis substitute for the other, so a company with money and no problem ranked in the top twenty. 2 min read 5 September 2026 Building Software Got Easy. Getting Value Out Of It Did Not Aristo took weeks to build. Everything after the build is still in progress, and that gap is the whole story. 3 min read 4 September 2026 Capability Is Becoming an Operational Risk Surface Safety questions used to be about the text. Once a model can act, the capability itself becomes something to operate. 6 min read 24 July 2026 The Scene Graph Is Becoming an API for AI A scene graph exists for artists and software. Agents are becoming another consumer, and they need structure rather than pixels. 6 min read 23 July 2026 Animation Is Moving From Clips to Motion Priors Authored keyframes and blended clips are giving way to asking which constraints define acceptable motion. 6 min read 22 July 2026 Materials Are Becoming Learned Programs A material is texture maps, parameters and shader code. It is starting to become a small learned program that answers a rendering question. 6 min read 16 July 2026 Procedural Systems Are Expanding Beyond Geometry Geometry Nodes started with a narrow name. Blender 5.2 puts physics, sound and object data through the same graph. 6 min read 29 June 2026 The Unit of AI Work Is Becoming the Task, Not the Turn Chat taught us to think one turn at a time. Long-running agents make the task the thing that is scheduled, resumed and reviewed. 6 min read 24 June 2026 Game Engines Are Becoming Operating Systems for Worlds Engines have been judged on what they render and simulate. The Unreal 6 roadmap points at operating a world rather than drawing one. 6 min read 11 June 2026 The Model Is Becoming a Replaceable Backend Choosing a provider used to mean choosing an architecture. A stable interface makes replacement possible and evaluation makes it safe. 6 min read 17 April 2026 The Harness Is Part of the Capability The same model behaves differently depending on context policy, tool design and execution feedback. That surrounding software is not neutral. 6 min read 13 March 2026 The Agent Needs an Environment, Not Just Tools A search function and a database query were enough for short loops. Longer work needs a place to stand. 6 min read 9 February 2026 Coding Agents Are Becoming General-Purpose Computer Workers Repositories were a friendly environment: text in, terminal actions, checkable results. That was a starting point, not a boundary. 6 min read 11 December 2025 Open Standards Outlive Model Generations A year after the MCP bet, the argument can be checked against what happened rather than what was hoped. 7 min read 20 November 2025 Colour Management Is a Pipeline Contract Blender 5.0 reads as better display options. Giving a file an explicit working colour space is an architectural change. 6 min read 11 August 2025 The Best Model May Be a Router, Not a Model GPT-5 moves model selection inside the system. The interesting unit stops being which model and becomes which compute policy. 6 min read 8 August 2025 World Models Are Not Game Engines Yet Genie 3 generates a navigable 720p world at 24 fps. Production work needs state you can inspect when something goes wrong. 6 min read 26 May 2025 Memory Is Becoming a System Capability A follow-up to the long-context argument. Storing, selecting and expiring facts is turning into a named part of the product. 6 min read 19 May 2025 Coding Agents Change the Unit of Software Work AI coding tools have been judged where code appears on screen. The boundary moves when the agent owns a task instead of a snippet. 6 min read 11 April 2025 Agents Need Protocols Between Each Other, Not Just Tools Tool calling solves the inside of the loop. It says nothing about one agent reaching another built by a different team on another platform. 7 min read 13 March 2025 Agents Need a Runtime, Not a Prompt Loop An agent is no longer well described as a prompt inside a while loop. The useful abstraction owns execution around the model. 6 min read 28 February 2025 Reasoning Is Not the Only Path to Better Models Longer thinking improves maths and code. A model that solves a logic puzzle and misreads ordinary intent is not the better production model. 6 min read 9 January 2025 Rendering Is Becoming a Reconstruction Stack Sparse samples, motion data and lower-resolution frames become a larger final result. Debugging becomes layered when reconstruction sits in the middle. 6 min read 16 December 2024 Agent Reliability Is an Evaluation Problem, Not a Prompting Problem When an agent misses a step, the usual fix is a stricter prompt. The failure is more often in how completion is detected. 6 min read 29 November 2024 MCP Might Matter More Than Another Model Release A model can reason well and still be useless inside a company if it cannot reach the files, repositories and tools where work lives. 6 min read 28 October 2024 Computer Use Is the Missing Layer Between Models and Software Most integrations assume useful software exposes the right API. Much of real software never did. 6 min read 19 September 2024 Inference-Time Compute Is a New Scaling Axis o1 improves when it is allowed to spend longer on a problem. A benchmark score without a compute budget is an incomplete number. 6 min read 15 August 2024 The Final Pixel Won't Come From the Renderer Geometry, camera and scene structure stay reliable ground truth. More of final appearance is moving into learned systems. 6 min read 29 July 2024 Open Models Are Becoming Research Infrastructure Llama 3.1 gets discussed as a benchmark result. The licence terms change which experiments are possible at all. 6 min read 24 June 2024 The Model Is Becoming a Runtime Function calling, code execution and structured output turn inference into a loop. The model stops being a text generator and starts being a control layer. 6 min read 16 May 2024 Multimodality Changes the Architecture, Not Just the Interface GPT-4o is easy to read as a faster interface. Training one model end to end across text, vision and audio is an architectural change. 7 min read 11 March 2024 Benchmark Scores Are Not Model Capability Claude 3 posts 86.8% on MMLU and 50.4% on GPQA Diamond. The chart is useful and it is not the same thing as capability. 6 min read 20 February 2024 Long Context Is Not Memory Gemini 1.5 makes a million tokens usable. A larger working set is not a system that decides what should survive the session. 6 min read