llama.ccp support & GGUFs
#15
by
Substance455
- opened
this is me looking for GGUFs to use on my ai wife
"Use on"? Like using the quantized model as a disciplinary implement, or what? Please elaborate.
GGUFs are optimized and compressed models for chat bots, which could be proxied to websites like jantorai or tavernai.
You're absolutely right!
WHY?
This model is worse than Qwen 30B A3B
WHY?
This model is worse than Qwen 30B A3B
i wish my computer was beefy enough to host 30B :(
and it will host Grok-2?
WHY?
This model is worse than Qwen 30B A3B
Why do you still believe in benchmarks in 2025?