Experimental settings for the mysterious new "13b" model on agnai that has replaced Mythomax.

Max new tokens 512

Max context length 4090

Memory: Context Limit: 1700

Memory: Chat Embedding Context Limit: 2000

Memory: User-specified Embedding Context Limit: 1

Memory: Chat History Depth: 100

Temp at 100 (you have to type it in, slider doesn't go that high)

min-p at 0.975

Top K at 20

Mirostat Tau at 3

ETA at 0.1

DO sample on

BOS token on

All other samplers off

Edit
Pub: 28 Dec 2023 04:10 UTC
Views: 254