license: apache-2.0 | |
pipeline_tag: text-generation | |
Source: https://huggingface.co/open-r1/OpenR1-Qwen-7B | |
```python | |
quant_config = { | |
"zero_point": True, | |
"q_group_size": 128, | |
"w_bit": 4, | |
"version": "GEMM", | |
} | |
``` |
license: apache-2.0 | |
pipeline_tag: text-generation | |
Source: https://huggingface.co/open-r1/OpenR1-Qwen-7B | |
```python | |
quant_config = { | |
"zero_point": True, | |
"q_group_size": 128, | |
"w_bit": 4, | |
"version": "GEMM", | |
} | |
``` |