To Pool or Not to Pool: Queueing Design for Large-Scale Service Systems
Publication in refereed journal
Full Text
Digital Object Identifier (DOI) DOI for CUHK Users |
Times Cited
Altmetrics Information
.
Other information
AbstractThere are two basic queue structures commonly adopted in service systems: the pooled structure, where waiting customers are organized into a single queue served by a group of servers, and the dedicated structure, where each server has her own queue. Although the pooled structure, known to minimize the servers’ idle time, is widely used in large-scale service systems, this study reveals that the dedicated structure, along with the join-the-shortest-queue routing policy, could be more advantageous for improving certain performance measures, such as the probability of a customer’s waiting time being within a delay target. The servers’ additional idleness resulting from the dedicated structure will be negligible when the system scale is large. Using a fluid model substantiated by asymptotic analysis, we provide a performance comparison between the two structures for a moderately overloaded queueing system with customer abandonment. We intend to help service system designers answer the following question: To reach a specified service-level target, which queue structure will be more cost effective? Aside from structure design, our results are of practical value for performance analysis and staffing deployment.
Acceptance Date21/11/2019
All Author(s) ListPing Cao, Shuangchi He, Junfei Huang, Yunan Liu
Journal nameOperations Research
Year2021
Month11
Volume Number69
Issue Number6
PublisherINFORMS
Place of PublicationUnited States
Pages1866 - 1885
ISSN0030-364X
LanguagesEnglish-United States
