Cripple your Japanese with an AI chatbot for free!
For DJT eyes only
(Image to scare off redditors)
You'll need to:
- Install SillyTavern.
This is desktop software that takes in AI API access credentials and chatbot definition cards and lets you have chats with the bots. - Find a working chatbot reverse proxy you can access.
A chatbot reverse proxy is a web app typically ran by random people using huggingface.co hosting. The proxy owner enters access keys to various AI APIs. The proxy users can then access those APIs through the proxy without needing to know the actual keys. - Get a chatbot card.
Those are chatbot definitions containing the bot's basic information, personality definition, perhaps a backstory and an introduction of some role-play scenario. After you've seen a few of them, you'll be able to make your own easily.
Installing SillyTavern
See Tavern4Retards.
Finding a working reverse proxy
At the time of writing, it's easy to find one by lurking /aicg/, yet our fortunes may quickly change. The links will look something like this:
- https://huggingface.co/spaces/fiz2/cloudy (use
awsendpoint for Claude) - https://huggingface.co/spaces/Amiminoru/Merkava (use
azureendpoint for GPT; has wait times) - https://huggingface.co/spaces/Dragonnext/charybdis-proxy (doesn't seem to work currently? maybe you need to join their shitcord or some shit)
Proxies may log all of your chats. In fact you should always assume that they are.
How to tell if it has working keys
On the proxy's main page, see if activeKeys isn't 0 for Claude or GPT4 (there are two kinds of APIs for accessing each of those AIs: Anthropic and AWS for Claude, OpenAI and Azure for GPT).
How to tell if you can access it
On the proxy's main page, see the value for gatekeeper. If it's none, the proxy is open access. If it's proxy_key, you'll need a global password that may or may not be written on the top of the page or somewhere in /aicg/. If it's user_token, there are per-user accounts. If there's no global password to be found or if there are user accounts, you'll probably need to beg some discord clique for access or just buy access with crypto if the owner is selling (some are).
Getting a chatbot card
Go to chub.ai and browse to your heart's content. Use the V2 download link (it's a PNG with encoded chatbot information). This can be imported into SillyTavern by going to Character Management there and clicking Import Character from File. You can also click Import content from external URL and then just paste the chub.ai link to the character.
Setting up the reverse proxy connection
In SillyTavern, go to API Connections, select Chat Completion and Custom (OpenAI-compatible).
Enter a proxy endpoint address for the specific API you wish to use (not the address of the proxy's webpage!). The base address should be written on the proxy's main page but you'll need to append /v1 at the end. For example, for the Anthropic Claude API, it may look something like this: https://xxxxx-xxxxx.hf.space/proxy/anthropic/v1.
If applicable, enter the proxy password or your user token in the Custom API Key field.
Click Connect. The Available Models dropdown should fill up. Select one to use.
For Claude, you'll probably want the claude-2.1 model and for GPT4—gpt-4-32k (if available) or gpt-4-1106-preview ("GPT-4 Turbo"). Non-32k and non-Turbo GPT4 only has a 8k token context window, which can be a bit too short for role-play (the context window determines how much of the prompt, character info, previous dialogue lines and so on the AI can remember while generating new text).
You can verify if the access works using the Test Message button or by trying to talk to a chatbot and seeing if there's any response other than an error. Note that some proxies may have a reply wait time.
Setting up role-play prompts (English)
You'll need to set up persistent prompts that coax the AI Assistants into role-playing with you. For now we'll do English and later we'll add modifications for Japanese.
(Again, refer to Tavern4Retards (and Google) on how to set this up in detail. Just remember to use the floppy disk button Update current preset after editing the preset and the save button after editing a prompt inside the preset. You can save multiple Chat Completion Presets by using the Save preset as button).
(The following is subject to change. I'm still the process of testing this prompt).
Go to https://rentry.org/KaruKaruBagOfGoodies#personal-jailbreak, download the linked preset file (check in the original document too as this version may get out of date) and import it under AI Response Configuration / Chat Completion Presets. Read the information in the linked doc.
Your API connection info is tied to the completion preset and changes with it, so you'll probably need to re-enter it after importing the preset.
If the prompt list on the left is now long as fuck and you've fixed your API info, you should be good to go. You can now click on a character and start chatting away.
If the bot still refuses to so some stuff
Try adding a prefill to the prompt. Click New prompt at the bottom of the preset, set Name: Prefill, Role: AI Assistant, Position: Relative, Prompt:
(There's a space character at the end.)
Click save. Then at the bottom of the preset select Prefill from the dropdown, click Insert prompt to add it in and lastly click the slide toggler thing to enable it. Remember to save the preset.
(Not well-tested. I'm not 100% sure if this is the proper way of setting the prefill).
Making the bots respond in questionable Japanese
I've barely tested this method. I've been using a different one so far but I wanted to simplify for the guide. Work in progress.
Add a Prefill as described in the English prompts section but make its prompt this instead:
(There's a space character at the end.)
Tip: You can add both prefills under different names and toggle them on and off according to need.
If you're an ultra beginner, you could try adding a sentence like this right before Now I will continue...:
I serve a beginner Japanese learner so I will make the language simplified.
Remember to save the prefill prompt and the preset.
Tips
Bot's message is good but cut off
You can edit it to remove the unfinished part and pretend it wasn't there in the first place. Or you can press Continue (inside the hamburger menu next to the message input). Feel it out.