Parasail
  • Welcome
  • Serverless
    • Serverless
    • Available Parameters
  • Dedicated
    • Dedicated Endpoints
    • Speeding up Dedicated Models with Speculative Decoding
    • Deploying private models through HuggingFace Repos
    • Dedicated Endpoint Management API
    • Rate Limits and Limitations
  • Batch
    • Quick start
    • Batch Processing with Private Models
    • Batch file format
    • API Reference
  • Cookbooks
    • Run and Evaluate Any Model
    • Chat Completions
    • RAG
    • Multi-Modal
    • Text-to-Speech with Orpheus TTS models
  • Billing
    • Pricing
    • Billing And Payments
    • Promotions
    • Batch SLA
  • Security and Account Management
    • Data Privacy and Retention
    • Account Management
    • Compliance
  • Resources
    • Silly Tavern Guide
    • Community Engagement
Powered by GitBook
On this page
  • API Usage:
  • Using 3rd Party Tools Like Cline, AnythingLLM:
  1. Serverless

Serverless

Our Serverless Service offers API based on Token Usage with Popular Models.

PreviousWelcomeNextAvailable Parameters

Last updated 1 month ago

API Usage:

UI API:

All of our serverless models are accessible using our OpenAPI spec API. On the Serverless page you can find example code to get the endpoints. If you click on a serverless model:

Our API Gateway is: https://api.parasail.io/v1

You will get example code like this:

# pip install openai
from openai import OpenAI

client = OpenAI(
    base_url="https://api.parasail.io/v1",
    api_key="<PARASAIL_API_KEY>"
)

chat_completion = client.chat.completions.create(
    model="parasail-deepseek-r1",
    messages=[{"role": "user", "content": "What is the capital of New York?"}]
)

print(chat_completion.choices[0].message.content)

You will need to get an API Key from your profile:

Getting an API Key:

Which will allow you to generate an API Key:

The API Key is displayed one time at creation and is not able to be seen again.

Programmatically Find Models:

You can find the model list by using our /models endpoint. You can find it by:

curl https://api.parasail.io/v1/models \
  -H "Authorization: Bearer YOUR_API_KEY"

The API key can be found through the UI like above.

Using 3rd Party Tools Like Cline, AnythingLLM:

Our serverless OpenAI spec allows you to use 3rd party tools seamlessly just like other popular providers.

Taking the example of Cline, a popular coding tool within Visual Studio:

Find the model you want to use with cline like QwenCoder 32b or DeepSeekR1:

Then head over to your favorite tool like Cline:

Then you could get:

Find the model name, and have your ,

API Key Ready