ZooWork Gitee 注册 / 登录 开始使用
ZooWork

产品

社区

资源

定价

注册 / 登录开始使用
ZooWork Market · Skill

pytorch-fsdp2

Adds PyTorch FSDP2 (fully_shard) to training scripts with correct init, sharding, mixed precision/offload config, and distributed checkpointing. Use when models exceed single-GPU memory or when you need DTensor-based sharding with DeviceMesh.

◇
Orchestra-Research
orchestra-research-ai-research-skills-pytorch-fsdp2 · v1.0.0
分类devops-cloud
安装次数37
更新时间2026-10-22T10:23:06.759Z
校验状态待验证
PyTorchFSDP2Fully Sharded Data ParallelDistributed TrainingDTensorDevice MeshSharded CheckpointingMixed PrecisionOffloadTorch Distributed