LLM in a flash: Efficient Large Language Model Inference with Limited Memory
Paper
•
2312.11514
•
Published
•
257
llm-local
-
-
95
Transformers to Core ML
⚡ -
enterprise-explorers/Llama-2-7b-chat-coreml
Text Generation • Updated • 1.82k • 138 -
tiiuae/falcon-7b-instruct
Text Generation • 7B • Updated • 154k • 1k -
TheBloke/Mixtral-8x7B-Instruct-v0.1-GGUF
47B • Updated • 43.2k • 631 -
TheBloke/Mistral-7B-Instruct-v0.2-GGUF
Text Generation • 7B • Updated • 61.4k • 447