view article Article Speeding Up LLM Decoding with Advanced Universal Assisted Generation Techniques By jmamou and 8 others ⢠27 days ago ⢠18
view article Article Universal Assisted Generation: Faster Decoding with Any Assistant Model By danielkorat and 7 others ⢠Oct 29, 2024 ⢠55
view article Article Faster Assisted Generation with Dynamic Speculation By jmamou and 6 others ⢠Oct 8, 2024 ⢠46
view article Article Google releases Gemma 2 2B, ShieldGemma and Gemma Scope By Xenova and 3 others ⢠Jul 31, 2024 ⢠58
view article Article Code Llama: Llama 2 learns to code By philschmid and 7 others ⢠Aug 25, 2023 ⢠9
view article Article Assisted Generation: a new direction toward low-latency text generation By joaogante ⢠May 11, 2023 ⢠56