TorchTPU - A Hybrid Eager/Compiled Architecture for Native PyTorch Execution on TPU

Claudio Basile, Michael Voznesensky, Gunhyun Park, Ben Wilson, Parker Holloway +48

TorchTPU is an open-source collaboration between Google and Meta that introduces a native and principled PyTorch backend for Google TPUs. It enables seamless out-of-the-box model execution and TPU migration while delivering industry-competitive inference and training performance through eager execution optimizations, torch.compile integration, and native hardware acceleration.