How to use this model? What settings?

#1
by Varkoyote - opened

Hello! I wanted to know if there were specific settings to use for this model, because I am using it with my default ChatML settings in KoboldCPP and it's just absolutely terrible... I just try it with a simple "Hey" and it starts thinking that I'm asking for a complex Python request or something lmao. Thank you!

Strange, can you try lowering the temperature?

Same here. I'll try lowering the temperature and see what happen.

@bartowski I have tried Q4_K_L, model prints text twice for some reason...

Sign up or log in to comment