> For the complete documentation index, see [llms.txt](https://docs.parasail.io/parasail-docs/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.parasail.io/parasail-docs/products/overview-1/auto-scaling.md).

# Auto-Scaling

To enable auto-scaling you need to go to the checkbox autoscaling:

The way that auto-scaling works is in conjunction with Max Concurrent requests that is set:

**Max Concurrent Requests**: This is the number of requests per replica that after the number set will begin rejecting requests. The trade off with setting a higher number can be higher latency but a lower number rejecting the requests.

**Target Concurrent Requests:** This is the number of concurrent requests that trigger autoscaling of another replica. This should be set below the Max Concurrent requests.

**Smoothing Factor:** This is the moving average of concurrent requests and how long you the amount of target requests coming in before a new replica is brought up or scaled down.

* Conservative: Responds to changes slowly
* Moderate: Balanced responsiveness
* Aggressive: Quickly react to change

**Auto Scaling Range for Replicas:** This is the minimum to maximum amount of replicas the system will put as the base line and the max it will go up to.

**Note:** Whatever options you have set for hardware selection will be used for autoscaling.

## Next steps

* [Dedicated Instances overview](/parasail-docs/products/overview-1.md)
* [Management API](/parasail-docs/products/overview-1/management-api.md)
* [Speculative Decoding](/parasail-docs/products/overview-1/speculative-decoding.md)
* [FP8 Quantization](/parasail-docs/products/overview-1/fp8-quantization.md)
* [Pricing](/parasail-docs/billing/pricing.md)