Evening-Truth

Home
Back

Chat Memory and Summary

This one was bugging my brain for a loooooong time.
In a long term roleplay certain parts of the plot or the setting can get lost over time. e.g. an important item, a specific story string.... but your interaction with the character went in a different direction for a while and the model is having a hard time picking the topic back up again.
Or your rp starts to lose overal coherency over time. Damn annoying. I know.

The usual summary prompts, such as the standard thingy in SillyTavern, gives you a summary that is nicely readable for you as a human, but it doesn't do anything to help the LLM know what really is important and what is just a nice to know. I often find they even confuse models more than anything.

Me being me... I wanted to find a way to improve that without confusing those who are new to the hobby, and making it usable on a variety of chat platforms.

So, I talked to some other brains about it for some time and here is what we found.

LLM needs data points, not narrative coherency in the summary. It needs specific details to act on. The tone between the characters will mostly be guided by the previous messages in the chat history. Letting the LLM label it in the summary is.... dangerous since it can change the trajectory of interactions negatively (whatever that might mean for your specific case 😉)

To give the LLM a good set of rules to draw from, I wrote this summary prompt:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15

Create a summary in the following format:

[BEGINNING= brief overview of the initial scenario at the beginning of the chat history. If there already is one present, use it unchanged.]
[RECENT= brief bullet point summary of relevant events that haven't been mentioned in BEGINNING.]
[{{char}} = 
- Appearance: current clothing, state. (anything that is not stated in their character description)
- Demeanor: current demeanor. ]
[{{user}} = 
- Appearance: current clothing, state.]
[Side Characters= a brief overview of characters that are either currently present, or relevant-but-absent.]

[IMPORTANT STRINGS=
Such as Setting rules (facts about the world that remain true regardless of scene), possible threats, unresolved threads, objects with significance for the narrative or other details that remain relevant.]

[CURRENTLY — day, date | time | location | weather, temp°C]

You already know me... this is WIP. But I'm really happy with how it works so far.

How to use

Best Practice:

• When you see something in the summary that leads in a direction you don't like, or information that is wrong, misleading, or just irrelevant, change it, delete it. This is YOUR roleplay. YOU are the boss in that world!

SillyTavern:

• Open the Extension Tab - Summarize (It's built-in. No need to download anything special if you don't want to)
• Copy the summary prompt into Summary Prompt under Summary Settings.
  Additional Settings:
• Update Frequency - I suggest not letting too much time pass between updates. 10 to 20 works nicely. Alternatively you can trigger the update after events you feel are of significance.
• Injection Position - Before Main Prompt/ Story String.

Other Platforms:
If possible, set my Summary Prompt as standard. When that is not possible, you can use the prompt as an OOC command and let the model write the summary within the chat.

1
2
3

OOC:
Create a summary in the following format:
.... (paste the entire prompt from above)

Then copy the result into the memory section of your specific platform.

I hope this improves your roleplay experiences.
Have fun babes!

Home
Back