I quanted this but can't get it to run, I tried on A100 which should work with Marlin kernel.
Please let me know if you are able to get it running and how, and I can update the docs
Eric Hartford
- Downloads last month
- 14
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support