I noticed that the page for this model mentions that the context length is 128k, but when loading this model into LM studio on my Mac it's capped at 32k as you can see in the screenshot.
The gguf version of this model works perfectly up to 128k.
· Sign up or log in to comment
