What is throttling?

#What is Throttling?

Throttling is a technique used in API design to control the rate at which requests are processed. This is particularly important in systems that serve multiple clients or tenants, each with varying subscription plans.

#Necessary Cookies

#Performance Cookies

Performance Cookies are used to understand and analyze key performance indicators of the website, helping to provide a better user experience for visitors.
No cookies to display.

#Advertising Cookies

Advertising Cookies are used to deliver visitors personalized ads based on the pages they have previously visited and to analyze the effectiveness of advertising campaigns.
No cookies to display.

#Uncategorized Cookies

Uncategorized Cookies are those that are analyzed and have not yet been classified into a category.
No cookies to display.

#User Options

• [Reject]
• [Save my settings]
• [Accept all]

Powered by

#Throttling in HTTP API

In the context of API design, throttling becomes essential when developing a system that works with multiple tenants (clients) who can choose their subscription plans according to their needs.

#The Problem of Noisy Tenants

A typical problem in such systems is Noisy Tenants. Imagine that a client has chosen the maximum subscription plan, but the frequency of requests they make is so high that they consume a significant portion of resources. As a result, other clients experience delays in response or issues with slow data loading.

#Implementing Throttling

In such cases, by using throttling, you can specify that the maximum request rate is 1000 per second. This can potentially relieve your resources and allow all clients to fully utilize the system.