Hugging Face's logo

ComparisonPO
/
Mistral-Base-7B-DPO-ComPO

Safetensors
mistral
Model card Files Community
README.md exists but content is empty.
Downloads last month
5
Safetensors
Model size
7.24B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ComparisonPO/Mistral-Base-7B-DPO-ComPO

Base model

mistralai/Mistral-7B-v0.1
Finetuned
alignment-handbook/zephyr-7b-sft-full
Finetuned
ComparisonPO/Mistral-Base-7B-DPO_clean
Finetuned
(1)
this model

Dataset used to train ComparisonPO/Mistral-Base-7B-DPO-ComPO

Collection including ComparisonPO/Mistral-Base-7B-DPO-ComPO