pytorch-fsdp

Expert guidance for Fully Sharded Data Parallel (FSDP) training with PyTorch — parameter sharding, mixed precision, CPU offloading, and FSDP2