Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Paper
•
2312.00752
•
Published
•
145
Training
-
-
SparQ Attention: Bandwidth-Efficient LLM Inference
Paper • 2312.04985 • Published • 40 -
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research
Paper • 2402.00159 • Published • 65 -
Neural Network Diffusion
Paper • 2402.13144 • Published • 99 -
FuseChat: Knowledge Fusion of Chat Models
Paper • 2402.16107 • Published • 41 -
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Paper • 2402.17764 • Published • 624 -
ShortGPT: Layers in Large Language Models are More Redundant Than You Expect
Paper • 2403.03853 • Published • 66 -
meta-llama/Llama-3.1-8B
Text Generation • 8B • Updated • 745k • • 1.74k