Context length capped at 32k

by Zach042 - opened 18 days ago

18 days ago

I noticed that the page for this model mentions that the context length is 128k, but when loading this model into LM studio on my Mac it's capped at 32k as you can see in the screenshot.

The gguf version of this model works perfectly up to 128k.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment