DDP/FSDP support (how it works and limitations), and a preview of what's coming.
Check out these links prior to the Q&A session:
https://dev-discuss.pytorch.org/t/torchdynamo-update-9-making-ddp-work-with-torchdynamo/860
https://pytorch.org/get-started/pytorch-2.0/#distributed
Meta
AI Infastructure
Experienced Principal Software Engineer in Deep Learning and Robotics. Full stack, big picture thinker, team player, leader and mentor. Loves to prototype, hack, build, debug, learn and iterate.
Meta
Developer Advocate