• Cite Icon80
  • https://doi.org/10.1145/346152.346320Copy DOI Icon

Analysis of optimal thread pool size

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The success of e-commerce, messaging middleware, and other Internet-based applications depends in part on the ability of network servers to respond in a timely and reliable manner to simultaneous service requests. Multithreaded systems, due to their efficient use of system resources and the popularity of shared-memory multi-processor architectures, have become the server implementation of choice. However, creating and destroying a thread is far from free, requiring run-time memory allocation and deallocation. These overheads become especially onerous during periods of high load and can be a major factor behind system slowdowns. A thread-pool architecture addresses this problem by prespawning and then managing a pool of threads. Threads in the pool are reused, so that thread creation and destruction overheads are incurred only once per thread, and not once per request. However, efficient thread management for a given system load highly depends on the thread pool size, which is currently determined heuristically. In this paper, we characterize several system resource costs associated with thread pool size. If the thread pool is too large, and threads go unused, then processing and memory resources are wasted maintaining the thread pool. If the thread pool is too small, then additional threads must be created and destroyed on the fly to handle new requests. We analytically determine the optimal thread pool size to maximize the expected gain of using a thread.

Similar Papers
  • Conference Article
  • Citations6

ADAPT-T: An Adaptive Algorithm for Auto-Tuning Worker Thread Pool Size in Application Servers

  • Jun 01, 2019
  • Nilushan Costa +5
  • Conference Article

Machine Learning Based Thread Pool Tuning via Program Analysis

  • Dec 01, 2021
  • Lakindu Akash +4
  • Single Report
  • Citations18

Performance Study and Dynamic Optimization Design for Thread Pool Systems

  • Dec 19, 2004
  • Dongping Xu
  • Book Chapter

Research on Intelligent Optimization Method of Grid Communication Server Based on Support Vector Machine

  • Jan 01, 2021
  • Xiaohui Zhu +3
  • PDF
  • Research Article
  • Citations14

Balancing earliness and tardiness within workload control order release: an assessment by simulation

  • Jan 03, 2022
  • Flexible Services and Manufacturing Journal
  • Stefan Haeussler +2
  • Dissertation

Pre-treatment of dynamically varying waste gas concentrations using activated carbon prior to biofiltration: effect of cycle length on degree of load equalization

  • Mar 26, 2007
  • Kodi Collins
  • Research Article
  • Citations8

From Rio to Iragua--sustainability versus efficiency and equity for preventive health interventions.

  • Jun 01, 1999
  • Tropical medicine & international health : TM & IH
  • C Lengeler
  • Research Article
  • Citations3

Towards optimal thread pool configuration for run-time systems of integration platforms

  • Jan 01, 2020
  • International Journal of Computer Applications in Technology
  • Fabricia Roos Frantz +2
  • Research Article
  • Citations26

Plasma lipid concentrations during episodic occupational stress.

  • Jun 01, 1999
  • Annals of Behavioral Medicine
  • Barbara S Mccann +5
  • PDF
  • Research Article
  • Citations109

“Unifying” the Concept of Resource Use Efficiency in Ecology

  • Jan 14, 2019
  • Frontiers in Ecology and Evolution
  • Dorothee Hodapp +2
  • Research Article
  • Citations170

Mammalian target of rapamycin controls dendritic cell development downstream of Flt3 ligand signaling.

  • Oct 01, 2010
  • Immunity
  • Taheri Sathaliyawala +9
  • Research Article
  • Citations37

Detection of Onchocerca volvulus infection in Simulium ochraceum sensu lato: comparison of a PCR assay and fly dissection in a Mexican hypoendemic community.

  • Dec 01, 1999
  • Parasitology
  • M A Rodríguez-Pérez +4
  • PDF
  • Research Article
  • Citations16

Improved GNSS Localization and Byzantine Detection in UAV Swarms.

  • Dec 17, 2020
  • Sensors
  • Shlomi Hacohen +3
  • Research Article

Optimal pool size and pooled sample size for hypothesis test of critical threshold of infection rates based on fixed sample size and pooled sampling method

  • Feb 03, 2012
  • Academic Journal of Second Military Medical University
  • Qing-Wen Sun +3
  • Conference Article
  • Citations1

A fuzzy channel allocation technique in High Altitude Platforms for emergency telecommunications

  • Sep 01, 2011
  • Behnam Rouzbehani
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.