Experimental settings for the mysterious new "13b" model on agnai that has replaced Mythomax.

Click on "Presets" on the left, then click "New Preset" on the right. You don't want to just copy these over an existing preset.

Max new tokens 512

Max context length 4090

Memory: Context Limit: 1700

Memory: Chat Embedding Context Limit: 2000

Memory: User-specified Embedding Context Limit: 1

Memory: Chat History Depth: 100

Temp at 100 (you have to type it in, slider doesn't go that high)

min-p at 0.975

Top K at 20

Mirostat Tau at 3

ETA at 0.1

DO sample on

BOS token on

All other samplers off

Edit
Pub: 31 Dec 2023 00:37 UTC
Views: 121