LLM Training Systems - a BHbean Collection

BHbean 's Collections

LoRA

LLM Training Systems

Survey

MoE LLM Systems

LLM resource-constrained Inference

New LLM Algorithms

LLM Internal Mechanism

Prompt Engineering

KV Cache Compression

LLM reasoning systems

Speculative Decoding

LLM Training Systems

updated Jul 8

NoLoCo: No-all-reduce Low Communication Training Method for Large Models

Paper • 2506.10911 • Published Jun 12 • 8
ZeCO: Zero Communication Overhead Sequence Parallelism for Linear Attention

Paper • 2507.01004 • Published Jul 1 • 10