Parasail
  • Welcome
  • Serverless
    • Serverless
    • Available Parameters
  • Dedicated
    • Dedicated Endpoints
    • Speeding up Dedicated Models with Speculative Decoding
    • Deploying private models through HuggingFace Repos
    • Dedicated Endpoint Management API
    • Rate Limits and Limitations
  • Batch
    • Quick start
    • Batch Processing with Private Models
    • Batch file format
    • API Reference
  • Cookbooks
    • Run and Evaluate Any Model
    • Chat Completions
    • RAG
    • Multi-Modal
    • Text-to-Speech with Orpheus TTS models
  • Billing
    • Pricing
    • Billing And Payments
    • Promotions
    • Batch SLA
  • Security and Account Management
    • Data Privacy and Retention
    • Account Management
    • Compliance
  • Resources
    • Silly Tavern Guide
    • Community Engagement
Powered by GitBook
On this page
  1. Resources

Silly Tavern Guide

This is a quick guide for Silly Tavern.

PreviousComplianceNextCommunity Engagement

Last updated 1 month ago

First thing you need to do is have Silly Tavern Installed

Once you Install Silly Tavern, this direction is for Mac/Linux Terminal, I start up Silly Tavern:

Choosing Option 1, to get it started will launch a localhost with the Silly Tavern ()

You will get the hosted page:

Once there you will need to make the connection between Parasail and SillyTavern. You need to connect on the Connection Profile at the top:

When you look at the available models on Serverless at https://saas.parasail.io

Or use the API endpoint https://api.parasail.io/v1/models

When I choose Eva-Qwen 72b, on the right hand side is the ability to see the API Key/Endpoints/ModelNames:

Back to SillyTavern. The paramaters you need to select are:

  • API: Chat Completion

  • Chat Completion Source: Custom (OpenAI-compatible)

  • Custom Endpoint (Base URL): https://api.parasail.io/v1

Then, choose your preferred model. (add something here to point the users towards which model to choose)

Lastly, click the connect button.

Once you set the connection you will be able to choose the available models:

Then you will be able to officially connect:

Then you can start to run the model in the text interface:

You can load personalities as well:

Once you have a personality have fun interacting with it:

For those Looking for Text-Completions you can set the API and Bypass status check:

I hope this helps with people who want Text vs Chat Completions. There are some minor difference in how the API is setup.

Please let us know if you have any questions . Also please provide feedback at:

https://feedback.parasail.io/feature-requests
https://sillytavernai.com/how-to-install-sillytavern/
http://127.0.0.1:8000/