Some GGUF v2 quantizations of the model harborwater/open-llama-3b-v2-wizard-evol-instuct-v2-196k
Prompt template:
### HUMAN:
{prompt}
### RESPONSE:
<leave a newline for the model to answer>
- Downloads last month
- 14
Hardware compatibility
Log In
to view the estimation
4-bit
5-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support