Silly Tavern Guide
This is a quick guide for Silly Tavern.
Last updated
This is a quick guide for Silly Tavern.
Last updated
First thing you need to do is have Silly Tavern Installed
Once you Install Silly Tavern, this direction is for Mac/Linux Terminal, I start up Silly Tavern:
Choosing Option 1, to get it started will launch a localhost with the Silly Tavern ()
You will get the hosted page:
Once there you will need to make the connection between Parasail and SillyTavern. You need to connect on the Connection Profile at the top:
When you look at the available models on Serverless at https://saas.parasail.io
Or use the API endpoint https://api.parasail.io/v1/models
When I choose Eva-Qwen 72b, on the right hand side is the ability to see the API Key/Endpoints/ModelNames:
Back to SillyTavern. The paramaters you need to select are:
API: Chat Completion
Chat Completion Source: Custom (OpenAI-compatible)
Custom Endpoint (Base URL): https://api.parasail.io/v1
Then, choose your preferred model. (add something here to point the users towards which model to choose)
Lastly, click the connect button.
Once you set the connection you will be able to choose the available models:
Then you will be able to officially connect:
Then you can start to run the model in the text interface:
You can load personalities as well:
Once you have a personality have fun interacting with it:
I hope this helps with people who want Text vs Chat Completions. There are some minor difference in how the API is setup.
Please let us know if you have any questions . Also please provide feedback at: