Accelerated physics changed what is possible
Running thousands of simulated robots in parallel on accelerators, rather than one at a time on a processor, turned reinforcement learning for robots from a research curiosity into a practical method. It is the same hardware and the same parallelism as model training, applied to generating experience instead of consuming it.