Commit
·
84f473e
1
Parent(s):
b2acc97
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
pipeline_tag: text-classification
|
| 6 |
+
tags:
|
| 7 |
+
- pytorch
|
| 8 |
+
- reward_model
|
| 9 |
+
- transformers
|
| 10 |
+
- RLHF
|
| 11 |
+
---
|
| 12 |
+
# Model Card for Model ID
|
| 13 |
+
|
| 14 |
+
This is part of the Chai reward-model series, using the GPT2 architecture with a classification head, optimising for a user accepting the completion generated by the base model.
|
| 15 |
+
|
| 16 |
+
Its training dataset consists of purely user-generated content [retry_and_continue_50m_reward_model](https://huggingface.co/datasets/ChaiML/retry_and_continue_50m_reward_model), where a user has the option to decline the generated response via the retry button or end the conversation.
|
| 17 |
+
|
| 18 |
+
## Model Details
|
| 19 |
+
- Developed by [Chai Research](https://www.chai-research.com/)
|
| 20 |
+
- Model type: Transformer-based Classification Model
|
| 21 |
+
- Language: English
|
| 22 |
+
- Contact: to ask questions about this model, join the [Chai Discord](https://discord.com/invite/4KPHkeG6VX). For general correspondence: [hello@chai-research.com](mailto:hello@chai-research.com?subject=Huggingface%20Model%20Inquiry)
|