NAI Chatbotting Guide (WIP)
Preamble:
- A guide for using NAI's site as a chatbot. No frontend needed, works from your browser so you can play with it on your cell phone without setup.
- Another anon came up with a Silly Tavern guide. Use his instead! If I come up with anything worthwhile independently I'll go shill it in /aicg/ later: https://rentry.org/SillyNAIGuide
- Why 'Assistant' in the examples? Because I got used to the name, lol. I'm testing the idea out of using a 'narrator' as your chat partner, and defining them in the 'Memory' section. It's not that NAI specifically responds to Assistant like Claude did, as far as I know. Feel free to change the name to whatever your chat partner's name is.
Settings:
- most of this is shamelessly stolen from a random thread I found while googling, edited to be setting-agnostic
- The rest is from NAI's faqs: https://docs.novelai.net/text/chatformat.html
- I'll mark placeholders you should change with ~tildes~, the stuff that isn't wrapped in ~tildes~ just works as-is.
- Feel free to change anything though, if you find it works badly, or something else works better. I'm just figuring this shit out.
Memory:
- This is where I'm sticking 3 things:
- The character description / card, copy-pasted at the top.
- Definition of (You) and the chatbot, written in prose form.
- Style guideline for Kayra to follow, [in square brackets].
- Seperate each of the 3 sections by a triple-asterisk: "***"
- You should change the character name and your name to suit the story. I'm using "Assistant" and "Anon" as placeholders.
Author's note:
- This is instructions for Kayra to follow while writing, written in {instruction format} using curly brackets. That's Kayra's version of OOC or <mod>, basically.
CFG Prompt:
- CFG's still pretty new, so I've got no idea how it all works atm.
- It's a negative prompt, you want to write prompts that would lead the bot to do stuff you want to AVOID.
- I think in theory, adding ~(you) says~ should discourage Kayra from talking for you. Will experiment.
Phrase Bias:
- This part's meant to force Kayra to start writing as ~Assistant~, and end each message with a space for ~Anon~.
- Use curly brackets around each one. Make seperate entries, the ~Assistant~ one first, then the ~Anon~ one.
- For ~Assistant~, make it strength "2", for ~Anon~, make it strength "0". Make sure ~Anon~'s bias has a space after the colon, while ~Assistant~'s shouldn't.
- MAKE SURE All 3 boxes are ticked.
Stop Sequence:
- This tells Kayra to stop writing as ~Assistant~ and leave a line for ~Anon~ to start writing.
- Does not need brackets, but DOES need the space after the colon. (eg \Anon: )
New Chat:
- Paste the first message in as your first prompt. Prefix it with the character's name and colons. eg: (Assistant: It was a dark and stormy night. A figure loomed ahead...)
- The LAST part of the message should be a linebreak with your response. eg: (Anon: "Hey you!" I called out.)
- Then, hit send and the bot will continue from whatever you last wrote.
Presets? Not sure yet... please see side-by-side comparison!
- Not sure which one is best yet.
- Made 10 gens for each of the 5 CFG defaults, the thread one, and a discord one (ProWriter)
Blook | Tesseract | Blended Coffee | Pilotfish |
---|---|---|---|
https://files.catbox.moe/ho1ehf.txt | https://files.catbox.moe/m62cte.txt | https://files.catbox.moe/wa8rlo.txt | https://files.catbox.moe/klo886.txt |
Green Active Writer | ProWriter | thread preset |
---|---|---|
https://files.catbox.moe/mf21j3.txt | https://files.catbox.moe/womhzf.txt | https://files.catbox.moe/mxhdls.txt |
Changelog:
13 Aug: Updated for clarity (I think) and to the latest thread settings. Some anon mentioned the one I found while googling was out of date. Changed URL
12 Aug: First posted. Added a bit for CFG after.
Outtro:
That's about it for now. Will update as I figure shit out.
First attempt at generating a response, Kayra immediately broke the 4th wall. (I thought it was funny.):