Limits and Quotas
Rate limits, GPU quotas, and quota increase guidance for Parasail production workloads.
Parasail applies request rate limits and GPU quotas to protect shared capacity and help customers avoid unexpected usage.
Rate limits
Serverless - Free
5
Not currently enforced
Serverless - User
500
Not currently enforced
Elastic Endpoints
Provisioned per endpoint
Set by endpoint agreement
Enterprise
Unlimited
Not currently enforced
Contact Parasail if your workload needs higher request limits.
For Elastic Endpoints, contact sales to confirm model eligibility and set up your endpoint. After setup, use your endpoint's Current capacity, Provisioned capacity, and Request activity to plan traffic rather than assuming product-wide limits. See Elastic Endpoints capacity.
GPU quota
New customer organizations start with a quota of 4 GPUs for Dedicated Instances. The quota applies collectively across GPU types.
Examples:
If a Dedicated deployment can auto-scale from 1 to 6 GPUs and the deployment already uses 4 GPUs, the quota prevents scaling to a fifth GPU.
If the deployment page shows Insufficient quota, the organization has reached its GPU quota.
Request a quota increase
Use the Quota Increase Form to request more GPU capacity. Quota increases up to 8 GPUs are available without additional justification. Requests for more than 8 GPUs require a short explanation of the workload.
Next steps
Last updated