Uploaded June 2026 | Updated September 2026, 3 weeks ago
NSDI '26 - CCEval: Accurately and Confidently Evaluating Performance Metrics of Congestion Control Algorithms for Datacenter Networks
Tianfeng Liu, Kaihui Gao, and Li Chen, Zhongguancun Laboratory; Dan Li, Tsinghua University; Jin Guang and Xinyun Chen, The Chinese University of Hong Kong, Shenzhen; Vincent Liu, University of Pennsylvania; Zhiyong Chen and Yiwei Zhang, Tsinghua University; Ni Jin, Zhongguancun Laboratory and Beijing University of Posts and Telecommunications; Ran Zhang, Zhongguancun Laboratory
Congestion control in datacenter networks (DCNs) is a highly active research area. Typical CCA evaluation workflows contain three steps: generate experimental configurations, execute the experiments, and estimate performance metrics using results from multiple trials. However, due to variability brought by random traffic workloads and single-digit trial counts, common experimental methodologies fail to provide enough confidence to properly evaluate CCA performance. We propose CCEval, an evaluation framework for accurately and confidently estimating performance metrics of CCAs in DCNs. The key idea is using confidence intervals and more trials to quantify and improve the accuracy and confidence of performance metrics. To this end, we propose a model-free estimation algorithm to calculate the confidence intervals and forecast the required trial count for a given accuracy, confidence level, metric, and CCA. We further design a model-based tail quantile estimation algorithm to reduce the needed trial counts significantly without losing accuracy and confidence. Extensive experiments on simulators and real-world testbeds with four CCAs on typical topologies and flow distributions show that CCEval can produce estimations of performance metrics accurately and confidently, with 1% relative margin of error and 95% confidence level, and can reduce trial counts by 75%~80% for tail quantile estimation.
View the full NSDI '26 program at usenix.org/conference/nsdi26/technical-sessions
NSDI '26 - CCEval: Accurately and Confidently Evaluating Performance Metrics of Congestion Control Algorithms for Datacenter Networks
Tianfeng Liu, Kaihui Gao, and Li Chen, Zhongguancun Laboratory; Dan Li, Tsinghua University; Jin Guang and Xinyun Chen, The Chinese University of Hong Kong, Shenzhen; Vincent Liu, University of Pennsylvania; Zhiyong Chen and Yiwei Zhang, Tsinghua University; Ni Jin, Zhongguancun Laboratory and Beijing University of Posts and Telecommunications; Ran Zhang, Zhongguancun Laboratory
Congestion control in datacenter networks (DCNs) is a highly active research area. Typical CCA evaluation workflows contain three steps: generate experimental configurations, execute the experiments, and estimate performance metrics using results from multiple trials. However, due to variability brought by random traffic workloads and single-digit trial counts, common experimental methodologies fail to provide enough confidence to properly evaluate CCA performance. We propose CCEval, an evaluation framework for accurately and confidently estimating performance metrics of CCAs in DCNs. The key idea is using confidence intervals and more trials to quantify and improve the accuracy and confidence of performance metrics. To this end, we propose a model-free estimation algorithm to calculate the confidence intervals and forecast the required trial count for a given accuracy, confidence level, metric, and CCA. We further design a model-based tail quantile estimation algorithm to reduce the needed trial counts significantly without losing accuracy and confidence. Extensive experiments on simulators and real-world testbeds with four CCAs on typical topologies and flow distributions show that CCEval can produce estimations of performance metrics accurately and confidently, with 1% relative margin of error and 95% confidence level, and can reduce trial counts by 75%~80% for tail quantile estimation.
View the full NSDI '26 program at usenix.org/conference/nsdi26/technical-sessions
