RWKV-7 "Goose" with Expressive Dynamic State Evolution Paper โข 2503.14456 โข Published Mar 18 โข 141
RWKV-7 "Goose" with Expressive Dynamic State Evolution Paper โข 2503.14456 โข Published Mar 18 โข 141 โข 11
Running 2.5k 2.5k The Ultra-Scale Playbook ๐ The ultimate guide to training LLM on large GPU Clusters
GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression Paper โข 2407.12077 โข Published Jul 16, 2024 โข 57