Thread Pool Hell


What is a thread pool hell?

Our services spend most of their time calling other services and waiting for I/O. Most server technologies rely on a thread pool to handle I/O. Unfortunately, in high traffic environments, thread pools can be hard to manage. Big thread pools have too much overhead, but small thread pools may run out of threads if there is a spike in latency of traffic. Either case can cause the service's latency to increase, which cascades to the other services that depends on it. Now their thread pools are inadequate, and the problem spread further. This is thread pool hell. See

Unless otherwise stated, the content of this page is licensed under Creative Commons Attribution-ShareAlike 3.0 License