Any plans for MLX support?
#12 opened about 22 hours ago
by
Alealejandrooo
some problem when I asked the model: 你是谁？
1
#8 opened 2 days ago
by
wenzel94
OOM with vllm==0.10.1 on GPU L40S
2
#7 opened 3 days ago
by
qingfu
GGUF support
❤️
2
3
#4 opened 4 days ago
by
RedEyed
This just trades general performance for domain specific gains.
🔥
👍
13
8
#3 opened 4 days ago
by
phil111