Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
datatab
/
Yugo45A-GPT-Quantized-GGUF
like
0
Transformers
GGUF
Serbian
mistral
text-generation-inference
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
Uploaded model
Uploaded model
Developed by:
datatab
License:
apache-2.0
Finetuned from model :
datatab/AlphaMonarch-7B
Downloads last month
27
GGUF
Model size
7.24B params
Architecture
llama
Chat template
Hardware compatibility
Log In
to view the estimation
3-bit
Q3_K_M
3.52 GB
4-bit
Q4_K_S
4.14 GB
Q4_K_M
4.37 GB
5-bit
Q5_0
5 GB
Q5_K_M
5.13 GB
6-bit
Q6_K
5.94 GB
8-bit
Q8_0
7.7 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
HF Inference deployability: The model has no pipeline_tag.
Collection including
datatab/Yugo45A-GPT-Quantized-GGUF
Yugo-GPT
Collection
Yugo-GPT class of LLM (45, 55, 60)
โข
13 items
โข
Updated
Oct 15, 2024