"Stop Rate Limiting! Capacity Management Done Right" by Jon Moore
Strange Loop Conference4 HN recommenders · recommended in 4 months, 2017–2024
talk · intermediate · evergreen · 2017–2024 on HN
Jon Moore's Strange Loop 2017 talk argues that rate limiting is the wrong tool for protecting services from noisy clients. He proposes concurrency-based capacity management and quotas instead.
HN engineers recommend it for its core insight that limiting concurrency naturally yields request-rate limits, and for its link to queueing theory.
Up next
3 mo on HNGSMT - Dan Holohan, Author: "The Lost Art of Steam Heating"
The General Society of Mechanics and Tradesmen
3 HN recommender · 2018–2021
1 mo on HNGuilty until proven innocent.
JCS - Criminal Psychology
1 HN recommend · 2021–2021
3 mo on HNRun containers on bare metal already!
Bryan Cantrill
3 HN recommender · 2015–2025
5 mo on HNGET LAMP: The Text Adventure Documentary
Google TechTalks
5 HN recommender · 2014–2026
5 mo on HNClassic Game Postmortem: Sid Meier's Civilization
GDC Festival of Gaming
4 HN recommender · 2017–2021
8 mo on HNFailing to Fail: The Spiderweb Software Way
GDC Festival of Gaming
11 HN recommender · 2018–2025
3 mo on HN'Oumuamua Is Not Aliens
PBS Space Time
3 HN recommender · 2018–2021
5 mo on HNCan C++ be 10x Simpler & Safer? - Herb Sutter - CppCon 2022
CppCon
6 HN recommender · 2022–2024
14 mo on HNThe Soul of Erlang and Elixir • Sasa Juric • GOTO 2019
GOTO Conferences
16 HN recommender · 2019–2024
11 mo on HN"Testing Distributed Systems w/ Deterministic Simulation" by Will Wilson
Strange Loop Conference
12 HN recommender · 2014–2024
10 mo on HNErlang Factory 2014 - That's 'Billion' with a 'B': Scaling to the Next Level at WhatsApp
Erlang Solutions
6 HN recommender · 2014–2022
9 mo on HN"Turning the database inside out with Apache Samza" by Martin Kleppmann
Strange Loop Conference
9 HN recommender · 2015–2025
4 comments from Hacker News
You will like the Strange Loop 2017 talk about this subject: "Stop Rate Limiting! Capacity Management Done Right" by Jon Moore ▶ this video Concurrent capacity might not be the best metric.
Relevant to queueing theory: "Stop Rate Limiting! Capacity Management Done Right" by Jon Moore ▶ this video
* To Serve The People: Public Interest Technologists. Matt Mitchell is a hacker, security researcher, operational security trainer, and data journalist who founded & leads CryptoHarlem, impromptu workshops teaching basic cryptography tools to the predominately African American community in upper Manhattan. link * Stop Rate Limiting! Capacity Management Done Right. Jon Moore is the Chief Software Architect at Comcast Cable, where he focuses on delivering a core set of scalable, performant, robust software components for the company's varied software product development groups. ▶ this video * Keeping Time in Real Systems. This talk will tour the fascinating timekeeping mechanisms used in real systems. We will explore atomic clocks, NTP and GPS through systems that use them, and logical clocks in the context of systems built on logical time. link * Level Up Your Concurrency Skills With Rust. This talk will show you how Rust will catch many concurrency errors at compile time. link * Diablo: A Classic Game Postmortem. Diablo developer David Brevik returns to the GDC stage to give a classic post-mortem on Blizzard's action RPG hit Diablo in this 2016 talk. link * The Flash Games Postmortem . In this 2017 GDC talk, Kongregate's John Cooney attempts to encapsulate the immense history of Flash games and how it has shaped the current game industry by giving game developers their first chance to build and publish their games quickly to the web. link * Siege Battle AI in Total War:
For a different view on the topic watch "Stop Rate Limiting! Capacity Management Done Right" ▶ this video The basic premise is not do do req/s limiting but rather concurrency limiting which results in req/s limiting by itself. Concurrency limiting is rather simple and doesn't require a lot of code complexity.