Silly Tavern Guide
This is a quick guide for Silly Tavern.
Last updated
This is a quick guide for Silly Tavern.
Last updated
First thing you need to do is have Silly Tavern Installed
https://sillytavernai.com/how-to-install-sillytavern/ Once you Install Silly Tavern, this direction is for Mac/Linux Terminal, I start up Silly Tavern:
Choosing Option 1, to get it started will launch a localhost with the Silly Tavern (http://127.0.0.1:8000/)
You will get the hosted page:
Once there you will need to make the connection between Parasail and SillyTavern. You need to connect on the Connection Profile at the top:
When you look at the available models on Serverless at https://saas.parasail.io
When I choose Eva-Qwen 72b, on the right hand side is the ability to see the API Key/Endpoints/ModelNames:
In SillyTavern, Under the connection you parameters you need to select the following:
API = Chat Completions
Chat Completion Source: Custom (Open-AI Api)
Custom Endpoint (Base URL): https://litellm.gw.cloud.saas.parasail.io
Enter a Model ID: "parasail-eva-qwen-72b-02" (Or any model you choose)
Then hit the connect button
Once you set the connection you will be able to choose the available models:
Then you will be able to officially connect:
Then you can start to run the model in the text interface:
You can load personalities as well:
Once you have a personality have fun interacting with it:
I hope this helps with people who want Text vs Chat Completions. There are some minor difference in how the API is setup.
Please let us know if you have any questions . Also please provide feedback at: https://feedback.parasail.io/feature-requests