metadata
license: cc-by-nc-4.0
I'm honestly too tired to write out a whole model page. I retrained the model using a cleaner dataset and then ran KTO using a previous dataset. Probably can improve performance by generating a KTO set off the same base model.
Next major version I plan to Pretrain -> SFT -> KTO which should improve things further.
Chat Format: ChatML with System Prompt
<im_start>system
Your system prompt.
<|im_end|>
<|im_start>assistant
Some response from the model or some character intro.
<|im_end|>
<|im_start|>user
Your message here.
<|im_end|>
Sampler Settings
- Temp: 1.0 - 1.25
- minP: 0.05 - 0.1