README.md

metadata

license: other
license_name: qwen
license_link: https://huggingface.co/Qwen/Qwen2.5-Math-7B-Instruct/blob/main/LICENSE
pipeline_tag: text-generation
base_model: Qwen/Qwen2.5-Math-7B-Instruct
base_model_relation: quantized
tags:
  - math
  - chat
  - 6bit
  - apple
language:
  - en
  - zh
library_name: mlx

Qwen2.5 Math 7B Instruct 6-bit MLX

MLX version of Qwen2.5 Math 7B Instruct

This model was converted to MLX format from https://huggingface.co/Qwen/Qwen2.5-Math-7B-Instruct using mlx-lm version 0.22.5.

Model Details

For more details, please refer to blog post and GitHub repo.

Use with mlx

pip install -U mlx-lm

python -m mlx_lm.generate --model TheCluster/Qwen2.5-Math-7B-Instruct-mlx-6bit --max-tokens 1024 --temperature 0.5 --prompt "Find the value of $x$ that satisfies the equation $4x+5 = 6x+7$."