ethicalabs
/

Kurtis-E1.1-Qwen2.5-0.5B-Instruct-mlx-4Bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

mrs83 commited on 16 days ago

Commit

f3eda0e

·

verified ·

1 Parent(s): fa801f2

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -11,9 +11,9 @@ tags:
 - mlx
 ---
-# mrs83/Kurtis-E1.1-Qwen2.5-0.5B-Instruct-mlx-4Bit
-The Model [mrs83/Kurtis-E1.1-Qwen2.5-0.5B-Instruct-mlx-4Bit](https://huggingface.co/mrs83/Kurtis-E1.1-Qwen2.5-0.5B-Instruct-mlx-4Bit) was converted to MLX format from [ethicalabs/Kurtis-E1.1-Qwen2.5-0.5B-Instruct](https://huggingface.co/ethicalabs/Kurtis-E1.1-Qwen2.5-0.5B-Instruct) using mlx-lm version **0.22.1**.
 ## Use with mlx
@@ -24,7 +24,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("mrs83/Kurtis-E1.1-Qwen2.5-0.5B-Instruct-mlx-4Bit")
 prompt="hello"

 - mlx
 ---
+# ethicalabs/Kurtis-E1.1-Qwen2.5-0.5B-Instruct-mlx-4Bit
+The Model [ethicalabs/Kurtis-E1.1-Qwen2.5-0.5B-Instruct-mlx-4Bit](https://huggingface.co/ethicalabs/Kurtis-E1.1-Qwen2.5-0.5B-Instruct-mlx-4Bit) was converted to MLX format from [ethicalabs/Kurtis-E1.1-Qwen2.5-0.5B-Instruct](https://huggingface.co/ethicalabs/Kurtis-E1.1-Qwen2.5-0.5B-Instruct) using mlx-lm version **0.22.1**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("ethicalabs/Kurtis-E1.1-Qwen2.5-0.5B-Instruct-mlx-4Bit")
 prompt="hello"