Hugging Face's logo

Spaces:
Ahmadzei
/
RAG
Runtime error

App Files Community
RAG / chunked /nltk_chunking /main_classes_deepspeed /chunk_1.txt
Ahmadzei's picture
Ahmadzei
added 3 more tables for large emb model
5fa1a76
raw
history blame contribute delete
194 Bytes
 It is available in several ZeRO stages, where each stage progressively saves more GPU memory by partitioning the optimizer state, gradients, parameters, and enabling offloading to a CPU or NVMe.