No. 102919860
all of the info in op seems outdated
what is the most straightforward way to get a chat bot going on a 3080?

No. 102920008
Alright you fuckin nerd here it is.

ooba/koboldcpp as your backend
sillytavern as your frontend
go to huggingface and download nemo 12b instruct gguf. Start with Q4.
load into ooba/kobold
in sillytavern, select Mistral v3 tekken context template and instruct template
Temp 0.8
MinP 0.02
Rep Pen 1.2
COOM your brains out

There you go. I recommend starting with the official instruct nemo tune before moving onto other tunes or merges.

No. 102925480
wym anon you literally copy the st repo and launch the .sh/.bat file named start and go to the local address
if not that try kobold lite ig