
MLX Models
Models converted to run with MLX
- Text Generation • 8B • Updated • 3
alexgusevski/Reverb-7b-q8-mlx
Text Generation • 2B • Updated • 2alexgusevski/Reverb-7b-q6-mlx
Text Generation • 2B • Updated • 2alexgusevski/Reverb-7b-q4-mlx
Text Generation • 1B • Updated • 2
alexgusevski/Reverb-7b-q3-mlx
Text Generation • 1.0B • Updated • 4Note Reverb 7B
alexgusevski/Dolphin3.0-Qwen2.5-3b-mlx
3B • Updated • 28alexgusevski/Dolphin3.0-Qwen2.5-3b-q8-mlx
0.9B • Updated • 10alexgusevski/Dolphin3.0-Qwen2.5-3b-q6-mlx
0.7B • Updated • 9alexgusevski/Dolphin3.0-Qwen2.5-3b-q4-mlx
0.5B • Updated • 11
alexgusevski/Dolphin3.0-Qwen2.5-3b-q3-mlx
0.4B • Updated • 12Note Dolphin 3.0 Qwen 2.5 3B
alexgusevski/EXAONE-3.5-2.4B-Instruct-mlx
Text Generation • 2B • Updated • 4alexgusevski/EXAONE-3.5-2.4B-Instruct-q8-mlx
Text Generation • 0.7B • Updated • 4alexgusevski/EXAONE-3.5-2.4B-Instruct-q6-mlx
Text Generation • 0.5B • Updated • 5alexgusevski/EXAONE-3.5-2.4B-Instruct-q4-mlx
Text Generation • 0.4B • Updated • 4
alexgusevski/EXAONE-3.5-2.4B-Instruct-q3-mlx
Text Generation • 0.3B • Updated • 2Note Exaone 3.5 2.4B
alexgusevski/EXAONE-3.5-7.8B-Instruct-q3-mlx
Text Generation • 1.0B • Updated • 3Note Exaone 3.5 7.8B
alexgusevski/Lucie-7B-mlx
Text Generation • 7B • Updated • 5alexgusevski/Lucie-7B-q8-mlx
Text Generation • 2B • Updated • 4alexgusevski/Lucie-7B-q6-mlx
Text Generation • 1B • Updated • 2alexgusevski/Lucie-7B-q4-mlx
Text Generation • 1B • Updated • 3
alexgusevski/Lucie-7B-q3-mlx
Text Generation • 0.8B • Updated • 3Note Lucie 7B
alexgusevski/Lucie-7B-Instruct-v1.1-mlx
Text Generation • 7B • Updated • 3alexgusevski/Lucie-7B-Instruct-v1.1-q8-mlx
Text Generation • 2B • Updated • 2alexgusevski/Lucie-7B-Instruct-v1.1-q6-mlx
Text Generation • 1B • Updated • 2alexgusevski/Lucie-7B-Instruct-v1.1-q4-mlx
Text Generation • 1B • Updated • 4
alexgusevski/Lucie-7B-Instruct-v1.1-q3-mlx
Text Generation • 0.8B • Updated • 2Note Lucie 7B Instruct
alexgusevski/Lucie-7B-Instruct-human-data-mlx
Text Generation • 7B • Updated • 4alexgusevski/Lucie-7B-Instruct-human-data-q8-mlx
Text Generation • 2B • Updated • 4alexgusevski/Lucie-7B-Instruct-human-data-q6-mlx
Text Generation • 1B • Updated • 5alexgusevski/Lucie-7B-Instruct-human-data-q4-mlx
Text Generation • 1B • Updated • 8
alexgusevski/Lucie-7B-Instruct-human-data-q3-mlx
Text Generation • 0.8B • Updated • 5Note Lucie 7B Instruct human data
alexgusevski/Qwen2.5-Coder-3B-mlx
Text Generation • 3B • Updated • 18alexgusevski/Qwen2.5-Coder-3B-q8-mlx
Text Generation • 0.9B • Updated • 10alexgusevski/Qwen2.5-Coder-3B-q6-mlx
Text Generation • 0.7B • Updated • 16alexgusevski/Qwen2.5-Coder-3B-q4-mlx
Text Generation • 0.5B • Updated • 9
alexgusevski/Qwen2.5-Coder-3B-q3-mlx
Text Generation • 0.4B • Updated • 3Note Qwen 2.5 Coder 3B
alexgusevski/Qwen2.5-Coder-7B-mlx
Text Generation • 8B • Updated • 22 • 1alexgusevski/Qwen2.5-Coder-7B-q8-mlx
Text Generation • 2B • Updated • 19alexgusevski/Qwen2.5-Coder-7B-q6-mlx
Text Generation • 2B • Updated • 11alexgusevski/Qwen2.5-Coder-7B-q4-mlx
Text Generation • 1B • Updated • 10
alexgusevski/Qwen2.5-Coder-7B-q3-mlx
Text Generation • 1.0B • Updated • 9Note Qwen 2.5 Coder 7B
alexgusevski/Chirp-3B-mlx
3B • Updated • 3alexgusevski/Chirp-3B-q8-mlx
0.9B • Updated • 2alexgusevski/Chirp-3B-q6-mlx
0.7B • Updated • 2alexgusevski/Chirp-3B-q4-mlx
0.5B • Updated • 2
alexgusevski/Chirp-3B-q3-mlx
0.4B • Updated • 2Note Chirp 3B
alexgusevski/UIGEN-T1.1-Qwen-7b-mlx
Text Generation • 8B • Updated • 4alexgusevski/UIGEN-T1.1-Qwen-7b-q8-mlx
Text Generation • 2B • Updated • 5alexgusevski/UIGEN-T1.1-Qwen-7b-q6-mlx
Text Generation • 2B • Updated • 5alexgusevski/UIGEN-T1.1-Qwen-7b-q4-mlx
Text Generation • 1B • Updated • 5
alexgusevski/UIGEN-T1.1-Qwen-7b-q3-mlx
Text Generation • 1.0B • Updated • 41Note UIGEN T1.1 Qwen 7B
alexgusevski/Qwen2.5-Coder-3B-Instruct-mlx
Text Generation • 3B • Updated • 8alexgusevski/Qwen2.5-Coder-3B-Instruct-q8-mlx
Text Generation • 0.9B • Updated • 6alexgusevski/Qwen2.5-Coder-3B-Instruct-q6-mlx
Text Generation • 0.7B • Updated • 11alexgusevski/Qwen2.5-Coder-3B-Instruct-q4-mlx
Text Generation • 0.5B • Updated • 13
alexgusevski/Qwen2.5-Coder-3B-Instruct-q3-mlx
Text Generation • 0.4B • Updated • 5Note Qwen 2.5 Coder 3B Instruct
alexgusevski/Qwen2.5-Coder-7B-Instruct-mlx
Text Generation • 8B • Updated • 10alexgusevski/Qwen2.5-Coder-7B-Instruct-q8-mlx
Text Generation • 2B • Updated • 7alexgusevski/Qwen2.5-Coder-7B-Instruct-q6-mlx
Text Generation • 2B • Updated • 10alexgusevski/Qwen2.5-Coder-7B-Instruct-q4-mlx
Text Generation • 1B • Updated • 7
alexgusevski/Qwen2.5-Coder-7B-Instruct-q3-mlx
Text Generation • 1.0B • Updated • 7Note Qwen 2.5 Coder 7B Instruct
alexgusevski/Arcee-Maestro-7B-Preview-mlx
Text Generation • 8B • Updated • 4alexgusevski/Arcee-Maestro-7B-Preview-q8-mlx
Text Generation • 2B • Updated • 2alexgusevski/Arcee-Maestro-7B-Preview-q6-mlx
Text Generation • 2B • Updated • 3alexgusevski/Arcee-Maestro-7B-Preview-q4-mlx
Text Generation • 1B • Updated • 2
alexgusevski/Arcee-Maestro-7B-Preview-q3-mlx
Text Generation • 1.0B • Updated • 2Note Arcee Maestro 7B Preview
alexgusevski/ReaderLM-v2-mlx
Text Generation • 2B • Updated • 6 • 1alexgusevski/ReaderLM-v2-q8-mlx
Text Generation • 0.4B • Updated • 5alexgusevski/ReaderLM-v2-q6-mlx
Text Generation • 0.3B • Updated • 2alexgusevski/ReaderLM-v2-q4-mlx
Text Generation • 0.2B • Updated • 3
alexgusevski/ReaderLM-v2-q3-mlx
Text Generation • 0.2B • Updated • 5Note ReaderLM V2 (1.5B)
alexgusevski/OpenThinker-7B-mlx
Text Generation • 8B • Updated • 3alexgusevski/OpenThinker-7B-q8-mlx
Text Generation • 2B • Updated • 3alexgusevski/OpenThinker-7B-q6-mlx
Text Generation • 2B • Updated • 3alexgusevski/OpenThinker-7B-q4-mlx
Text Generation • 1B • Updated • 2
alexgusevski/OpenThinker-7B-q3-mlx
Text Generation • 1.0B • Updated • 2Note OpenThinker 7B
alexgusevski/Fino1-8B-mlx
Text Generation • 8B • Updated • 3 • 1alexgusevski/Fino1-8B-q8-mlx
Text Generation • 2B • Updated • 3alexgusevski/Fino1-8B-q6-mlx
Text Generation • 2B • Updated • 3alexgusevski/Fino1-8B-q4-mlx
Text Generation • 1B • Updated • 2
alexgusevski/Fino1-8B-q3-mlx
Text Generation • 1B • Updated • 3Note Fino1 8B
alexgusevski/Ministral-8B-Instruct-2410-mlx
8B • Updated • 9alexgusevski/Ministral-8B-Instruct-2410-q8-mlx
2B • Updated • 5 • 1alexgusevski/Ministral-8B-Instruct-2410-q6-mlx
2B • Updated • 3alexgusevski/Ministral-8B-Instruct-2410-q4-mlx
1B • Updated • 6
alexgusevski/Ministral-8B-Instruct-2410-q3-mlx
1B • Updated • 3Note Ministral 8B Instruct
alexgusevski/LLaMA-Mesh-mlx
Text-to-3D • 8B • Updated • 15 • 1alexgusevski/LLaMA-Mesh-q8-mlx
Text-to-3D • 2B • Updated • 11alexgusevski/LLaMA-Mesh-q6-mlx
Text-to-3D • 2B • Updated • 8alexgusevski/LLaMA-Mesh-q4-mlx
Text-to-3D • 1B • Updated • 9
alexgusevski/LLaMA-Mesh-q3-mlx
Text-to-3D • 1B • Updated • 7Note LLama Mesh (8B)
alexgusevski/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-mlx
Text Generation • 0.5B • Updated • 7alexgusevski/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-q8-mlx
Text Generation • 0.1B • Updated • 5alexgusevski/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-q6-mlx
Text Generation • 0.1B • Updated • 4alexgusevski/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-q4-mlx
Text Generation • 0.1B • Updated • 9
alexgusevski/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-q3-mlx
Text Generation • 0.1B • Updated • 7Note DeepSeek R1 DRAFT Qwen 2.5 0.5B
alexgusevski/Selene-1-Mini-Llama-3.1-8B-mlx
Text Generation • 8B • Updated • 11alexgusevski/Selene-1-Mini-Llama-3.1-8B-q8-mlx
Text Generation • 2B • Updated • 8alexgusevski/Selene-1-Mini-Llama-3.1-8B-q6-mlx
Text Generation • 2B • Updated • 8alexgusevski/Selene-1-Mini-Llama-3.1-8B-q4-mlx
Text Generation • 1B • Updated • 6
alexgusevski/Selene-1-Mini-Llama-3.1-8B-q3-mlx
Text Generation • 1B • Updated • 10Note Selene 1 Mini Llama 3.1 8B
alexgusevski/granite-3.2-2b-instruct-mlx
Text Generation • 3B • Updated • 9alexgusevski/granite-3.2-2b-instruct-q8-mlx
Text Generation • 0.7B • Updated • 8alexgusevski/granite-3.2-2b-instruct-q6-mlx
Text Generation • 0.6B • Updated • 7alexgusevski/granite-3.2-2b-instruct-q4-mlx
Text Generation • 0.4B • Updated • 23 • 1
alexgusevski/granite-3.2-2b-instruct-q3-mlx
Text Generation • 0.3B • Updated • 5Note Granite 3.2 2B Instruct
alexgusevski/Meta-Llama-3.1-8B-SurviveV3-mlx
8B • Updated • 48alexgusevski/Meta-Llama-3.1-8B-SurviveV3-q8-mlx
2B • Updated • 30alexgusevski/Meta-Llama-3.1-8B-SurviveV3-q6-mlx
2B • Updated • 20alexgusevski/Meta-Llama-3.1-8B-SurviveV3-q4-mlx
1B • Updated • 21
alexgusevski/Meta-Llama-3.1-8B-SurviveV3-q3-mlx
1B • Updated • 22Note Llama 3.1 8B SurviveV3
alexgusevski/Phi-4-mini-instruct-mlx-fp16
Text Generation • 4B • Updated • 23alexgusevski/Phi-4-mini-instruct-Q8-mlx
Text Generation • 1B • Updated • 5alexgusevski/Phi-4-mini-instruct-Q6-mlx
Text Generation • 0.8B • Updated • 4alexgusevski/Phi-4-mini-instruct-Q4-mlx
Text Generation • 0.6B • Updated • 6alexgusevski/Phi-4-mini-instruct-q3-mlx
Text Generation • 0.5B • Updated • 3
alexgusevski/Phi-4-mini-instruct-Q2-mlx
Text Generation • 0.4B • Updated • 7Note Phi 4 mini instruct
alexgusevski/Fallen-Llama-3.3-R1-70B-v1-mlx-fp16
71B • Updated • 16alexgusevski/Fallen-Llama-3.3-R1-70B-v1-Q8-mlx
20B • Updated • 78alexgusevski/Fallen-Llama-3.3-R1-70B-v1-Q6-mlx
15B • Updated • 79alexgusevski/Fallen-Llama-3.3-R1-70B-v1-Q4-mlx
11B • Updated • 55
alexgusevski/Fallen-Llama-3.3-R1-70B-v1-Q3-mlx
9B • Updated • 42Note Fallen Llama 3.3 R1 70B V1
alexgusevski/olmOCR-7B-0225-preview-mlx
Image-to-Text • 8B • Updated • 9alexgusevski/olmOCR-7B-0225-preview-q8-mlx
Image-to-Text • 2B • Updated • 13alexgusevski/olmOCR-7B-0225-preview-q6-mlx
Image-to-Text • 2B • Updated • 13alexgusevski/olmOCR-7B-0225-preview-q4-mlx
Image-to-Text • 1B • Updated • 10
alexgusevski/olmOCR-7B-0225-preview-q3-mlx
Image-to-Text • 1B • Updated • 263Note olmOCR 7B 0225 preview
alexgusevski/QwQ-32B-8bit
Text Generation • 9B • Updated • 4
alexgusevski/QwQ-32B-6bit
Text Generation • 7B • Updated • 5Note QwQ 32B
alexgusevski/Goppa-LogiLlama-mlx
Text Generation • 1B • Updated • 3alexgusevski/Goppa-LogiLlama-8bit
Text Generation • 0.3B • Updated • 4alexgusevski/Goppa-LogiLlama-6bit
Text Generation • 0.3B • Updated • 3alexgusevski/Goppa-LogiLlama-4bit
Text Generation • 0.2B • Updated • 3alexgusevski/Goppa-LogiLlama-3bit
Text Generation • 0.2B • Updated • 3
alexgusevski/Goppa-LogiLlama-mlx-2Bit
Text Generation • 0.1B • Updated • 2Note Goppa LogiLLamaa (Llama 3.2, 1B)
alexgusevski/OlympicCoder-7B-mlx-fp16
Text Generation • 8B • Updated • 3alexgusevski/OlympicCoder-7B-mlx-8Bit
Text Generation • 2B • Updated • 2alexgusevski/OlympicCoder-7B-mlx-6Bit
Text Generation • 2B • Updated • 3alexgusevski/OlympicCoder-7B-mlx-4Bit
Text Generation • 1B • Updated • 2alexgusevski/OlympicCoder-7B-mlx-3Bit
Text Generation • 1.0B • Updated • 2
alexgusevski/OlympicCoder-7B-mlx-2Bit
Text Generation • 0.7B • Updated • 5Note Olympic Coder 7B
alexgusevski/OlympicCoder-32B-mlx-fp16
Text Generation • 33B • Updated • 4alexgusevski/OlympicCoder-32B-mlx-8Bit
Text Generation • 9B • Updated • 5alexgusevski/OlympicCoder-32B-mlx-6Bit
Text Generation • 7B • Updated • 2alexgusevski/OlympicCoder-32B-mlx-4Bit
Text Generation • 5B • Updated • 2alexgusevski/OlympicCoder-32B-mlx-3Bit
Text Generation • 4B • Updated • 3
alexgusevski/OlympicCoder-32B-mlx-2Bit
Text Generation • 3B • Updated • 5Note Olympic Coder 32B
alexgusevski/gemma-3-text-1b-it-fp16-mlx
Text Generation • 1B • Updated • 23alexgusevski/gemma-3-text-1b-it-q8-mlx
Text Generation • 0.4B • Updated • 4alexgusevski/gemma-3-text-1b-it-q6-mlx
Text Generation • 0.3B • Updated • 2alexgusevski/gemma-3-text-1b-it-q4-mlx
Text Generation • 0.2B • Updated • 5
alexgusevski/gemma-3-text-1b-it-q3-mlx
Text Generation • 0.2B • Updated • 6Note Gemma 3 1B, converted with --dtype bfloat16 and working properly in LM studio
alexgusevski/gemma-3-text-4b-it-fp16-mlx
Text Generation • 5B • Updated • 12alexgusevski/gemma-3-text-4b-it-q8-mlx
Text Generation • 1B • Updated • 8alexgusevski/gemma-3-text-4b-it-q6-mlx
Text Generation • 1.0B • Updated • 7alexgusevski/gemma-3-text-4b-it-q4-mlx
Text Generation • 0.7B • Updated • 9
alexgusevski/gemma-3-text-4b-it-q3-mlx
Text Generation • 0.6B • Updated • 7Note Gemma 3 4B Text only
alexgusevski/EXAONE-Deep-2.4B-fp16-mlx
Text Generation • 2B • Updated • 11alexgusevski/EXAONE-Deep-2.4B-q8-mlx
Text Generation • 0.7B • Updated • 4alexgusevski/EXAONE-Deep-2.4B-q6-mlx
Text Generation • 0.5B • Updated • 3alexgusevski/EXAONE-Deep-2.4B-q4-mlx
Text Generation • 0.4B • Updated • 6
alexgusevski/EXAONE-Deep-2.4B-q3-mlx
Text Generation • 0.3B • Updated • 7Note Exaone Deep 2.4B (don't forget to change prompt template according to https://github.com/LG-AI-EXAONE/EXAONE-Deep?tab=readme-ov-file#lm-studio)
alexgusevski/EXAONE-Deep-7.8B-mlx-fp16
Text Generation • 8B • Updated • 3alexgusevski/EXAONE-Deep-7.8B-mlx-8Bit
Text Generation • 2B • Updated • 3alexgusevski/EXAONE-Deep-7.8B-mlx-6Bit
Text Generation • 2B • Updated • 3alexgusevski/EXAONE-Deep-7.8B-mlx-4Bit
Text Generation • 1B • Updated • 6
alexgusevski/EXAONE-Deep-7.8B-mlx-3Bit
Text Generation • 1.0B • Updated • 5Note Exaone Deep 7.8B (don't forget to change prompt template according to https://github.com/LG-AI-EXAONE/EXAONE-Deep?tab=readme-ov-file#lm-studio)
alexgusevski/EXAONE-Deep-32B-mlx-fp16
Text Generation • 32B • Updated • 6alexgusevski/EXAONE-Deep-32B-mlx-8Bit
Text Generation • 9B • Updated • 6alexgusevski/EXAONE-Deep-32B-mlx-6Bit
Text Generation • 7B • Updated • 6alexgusevski/EXAONE-Deep-32B-mlx-4Bit
Text Generation • 5B • Updated • 4
alexgusevski/EXAONE-Deep-32B-mlx-3Bit
Text Generation • 4B • Updated • 5Note Exaone Deep 32B (don't forget to change prompt template according to https://github.com/LG-AI-EXAONE/EXAONE-Deep?tab=readme-ov-file#lm-studio)
alexgusevski/openhands-lm-32b-v0.1-mlx-fp16
Text Generation • 33B • Updated • 11alexgusevski/openhands-lm-32b-v0.1-mlx-8Bit
Text Generation • 9B • Updated • 18 • 1alexgusevski/openhands-lm-32b-v0.1-mlx-6Bit
Text Generation • 7B • Updated • 4alexgusevski/openhands-lm-32b-v0.1-mlx-4Bit
Text Generation • 5B • Updated • 6
alexgusevski/openhands-lm-32b-v0.1-mlx-3Bit
Text Generation • 4B • Updated • 6Note Openhands LM 32B