Implemented for Claude and GPT only.
Aisu Auto Summarizer condenses Out Of Context chats into a small entry, excluding vast graphic detail and focusing on what is important for the future of the chat. Established facts, actions and reactions characters had to situations, etc.
It first triggers when your chat starts going out of the context of the AI, generating a summary of the chats that won't fit. It then uses that summary to give context to the AI, so that the info that was established isn't lost on him.
But you may ask "There's already a summarizer in extensions!" (There wasn't one when I made it, at least that used Claude/OpenAI API)
Aisu features:
- Formatting the prompt's start, middle, and end, however you want. The default wraps the story in XML tags and explains what the defs mean in general and how they don't need to be included in the summary itself. The default also asks for bullet points, as I found that much better and easier to edit.
- Regex OOC messages out of the summary prompt.
- Uses previous summaries to do revisions, when the summary prompt itself becomes to big to fit in context.
The summarizer will prompt your AI of choice (Claude or GPT only)
- You can see the summary and edit or regen, which you should do if the AI gets things wrong, and not silently ignore like other existing summary solutions.
- The token completions are relatively small, since its a concise summary, though it depends of course on the summary prompt itself and the size of the chat.
- Takes care of managing the summaries for when things get self-reflective.
- The result is insanely good and I'd never chat without this now.
You can customize the 9 prompts that make up the mechanism for AAS, for your specific needs. I say 9, but its technically only 4 and two of them are similar because there are two dimensions to the same prompt, for when it gets self-reflective.
Default prompt looks like this all together with the chat and main prompt. This is including a previous summary, not a first summary (because eventually it will need to use a summary to fit everything in a single prompt):
The caveats:
- You need to use my branch of Tavern which has this implemented.
- Its running on my server and my Tavern fork together with my RPG game card features (and cardJailbreak mentioned on some of my cards).
- So you need to join my server to get a token for it (the server).
- Partial logs are saved if an error occurs, I'll only read them if strictly necessary to fix a bug, I don't want to if I can avoid it since it's a waste of time.
- Only Claude and OpenAI.
https://rentry.org/AisuAutoSummarizer
https://discord.gg/Tzf28GBcvD
(you need to enter above to use it, but you'll just need the SillyTavern fork)
https://github.com/bfs15/SillyTavern/tree/AbsoluteRPGAdventure