does it support <think>?
I've been enjoying the model but I can't get it to do the nice formatted thinking in LM Studio. Using no preset or a "DeepThink AI" preset doesn't seem to change the output at all.
This isn't a problem I can say is specific to this model only since I've got the same results with other models I think should be supporting the response formatting. Several models give my system prompts the cold shoulder.
Again this is only formatting. It does the reasoning steps completely.
Hmm the blog certainly suggests that it should work:
It's possible though that lmstudio isn't parsing the opening think tag appropriately, can you try removing it from the prompt template and see what happens?
On the last lines for this model in particular there was an opening <think> tag placed which didn't exist on other models where the "DeepThink AI" preset did work.
{%- if add_generation_prompt %}
{{- '<|im_start|>assistant\n<think>' }}
{%- endif %}
I removed it and was able to use that "DeepThink AI" preset to make it think in the tag as expected. I am on LM Studio 0.3.15 (Build 6).