Hi! I need help
Hey, this is currently the best uncensored model that can be run locally on a PC. I only have one problem: the text often includes something like "\n\n" before words. For example: /n"I'm sorry. Oh god, I'm so sorry—" Her knees...*
Could this be due to the Instruct Template? (I'm using yours, I haven't edited anything.)
Thanks! I'm glad you're having fun with it. If you're having some odd issues, try dropping the last_ouput_sequence from the instruct template. It's risky putting stuff there, and sometimes it does more harm than good. Also ensure you're not doing anything too crazy with your sampler settings, which can sometimes produce artifacts.
Here is a modified instruct template without the last_output_message string. Let me know if that helps.
{
"wrap": false,
"system_sequence": "<|start_header_id|>system<|end_header_id|>\\n\\nSystem: ",
"stop_sequence": "<|eot_id|>",
"input_sequence": "<|start_header_id|>user<|end_header_id|>\\n\\n",
"output_sequence": "<|start_header_id|>assistant<|end_header_id|>\\n\\n",
"macro": true,
"system_sequence_prefix": "",
"system_sequence_suffix": "",
"first_output_sequence": "",
"last_output_sequence": "",
"activation_regex": "",
"skip_examples": true,
"output_suffix": "<|eot_id|>",
"input_suffix": "<|eot_id|>",
"system_suffix": "<|eot_id|>",
"user_alignment_message": "",
"last_system_sequence": "",
"system_same_as_user": false,
"first_input_sequence": "",
"last_input_sequence": "",
"names_behavior": "always",
"names_force_groups": true,
"name": "Llama 3"
}
Hey, hey. I can confirm that it is working. Thanks for help.