Part 6: Loading and saving models with FSDP local state dictionary

preview_player
Показать описание
FSDP lets you load and save even the largest of AI models by leveraging distributed checkpointing with local state dict. This enables you to handle huge models that exceed even CPU memory in size. Learn how in under 8 minutes!
Рекомендации по теме
Комментарии
Автор

I noticed that in the save function, there is no save_policy. Was this by mistake?

BW-zqtu