Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch
Paper
•
2501.18512
•
Published
•
30
Gabriel Teston
Gabriel-Teston
·
AI & ML interests
None yet
Recent Activity
authored
a paper
about 1 month ago
Streaming DiLoCo with overlapping communication: Towards a Distributed
Free Lunch
authored
a paper
about 1 month ago
Communication-Efficient Language Model Training Scales Reliably and
Robustly: Scaling Laws for DiLoCo
upvoted
a
paper
about 1 month ago
Communication-Efficient Language Model Training Scales Reliably and
Robustly: Scaling Laws for DiLoCo
Organizations
Gabriel-Teston's activity
authored
2
papers
about 1 month ago