Quick Rundown on Large REVISED

Access

• OpenRouter: https://openrouter.ai/models/mistralai/mistral-large
• MistralAI: https://mistral.ai
• Aws
• Azure

API

Large doesn't have system messages/prompts.

B-but they're on the API.

Large doesn't have system messages/prompts. The API concatenates all of them and prepends them to the last user message.

https://github.com/mistralai/cookbook/blob/main/concept-deep-dive/tokenization/chat_templates.md

They've been doing this since the old Large. If you use Large with system messages, they will all get prepended to the last user message. That can happen to your entire card or preset.

A voyage of two thousand tokens between the chat history and Large's response. Joy.

Yes, I'm telling you to manually edit your preset to ensure it's all user messages.

Theoretically Large also has prefills but ST doesn't support them, so they're completely irrelevant for 99% of you.

Presets

momoura's presets still exist and still work reasonably well, despite the general conceptual retardation.

mine. Requires https://github.com/SillyTavern/SillyTavern/pull/2872 to be merged or for you to manually git switch into it git pull after this commit: https://github.com/SillyTavern/SillyTavern/commit/5269725f1c4fb51f18384b21e6bf7d03426660c3

kira's largestral prompt. Primarily for risu, doesn't have a ready-made ST json.

Does it really write better now?

Uncherrypicked swipe:

Contact

Email any JBs missing to cognitohazard@riseup.net