Granite GGUF Models
Collection
GGUF-formatted, versions of IBM Granite models. Licensed under the Apache 2.0 license.
•
7 items
•
Updated
This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.
Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-3.3-8b-instruct
- Downloads last month
- 2,223
Hardware compatibility
Log In
to view the estimation
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model authors have turned it off explicitly.
Model tree for ibm-granite/granite-3.3-8b-instruct-GGUF
Base model
ibm-granite/granite-3.3-8b-base
Finetuned
ibm-granite/granite-3.3-8b-instruct