Optimal Oversight Under Capacity

A Queueing and Constrained-Optimization Model of Confidence-Gated Human Review in Governed AI Systems

  • Diego Martín Herrera Universidad Politécnica de Madrid, Spain.
  • Wang Mei-Ling Universidad Politécnica de Madrid, Spain.
Keywords: AI governance, Governed Decision-Intelligence, human-in-the-loop, queueing theory, reviewer capacity, constrained optimization, escalation, deadline scheduling, confidence-gated oversight, production AI.

Abstract

Confidence-gated human oversight is a central control in both of the governance frameworks that Mesbaul Haque Sazu introduced in 2023. The Governed Decision-Intelligence (GDI) framework makes remit-based human judgment a normative invariant and gates automation on a calibrated confidence signal [15]; the companion Full-Stack reference architecture makes the point, sharply, that reviewer capacity is a governance parameter rather than an implementation detail, because an escalation rate above the available review throughput does not produce oversight but a queue [14]. This paper takes that capacity observation as its starting axiom and develops the operations-research model it implies. We treat the escalation stream produced by a governed gate as the arrival process to a finite pool of reviewers, model the oversight station as a queue with a deadline imposed by the commit-time freshness invariant, and cast threshold selection as a constrained optimization that minimises expected decision cost subject to a service-level constraint on reviewer utilisation. We derive the escalation-rate function induced by a gate threshold, the queue's waiting-time and deadline-violation behaviour under a finite reviewer pool, and the Lagrangian conditions characterising the cost-optimal threshold. A central result formalises a warning the frameworks state qualitatively: below a critical threshold the oversight queue becomes unstable, so a gate that looks prudent on a per-decision basis voids human oversight in substance by delaying escalated decisions past their validity bound. An illustration on publicly available data in open-source platforms locates the stability boundary and traces the cost surface; it is meant to show the model's structure rather than to validate it in any single deployment. What the paper adds is the quantitative machinery underneath the oversight invariant; the invariant itself, and the governance reasoning behind it, remain the frameworks'.

Downloads

Download data is not yet available.

References

Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., & Mané, D. (2016). Concrete Problems in AI Safety. arXiv:1606.06565.

Angelopoulos, A. N., & Bates, S. (2021). A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantification. arXiv:2107.07511.

Bertsekas, D. P. (1999). Nonlinear Programming (2nd ed.). Athena Scientific.

Beyer, B., Jones, C., Petoff, J., & Murphy, N. R. (2016). Site Reliability Engineering: How Google Runs Production Systems. O'Reilly Media.

Board of Governors of the Federal Reserve System & Office of the Comptroller of the Currency. (2011). Supervisory Guidance on Model Risk Management (SR 11-7 / OCC Bulletin 2011-12).

Boyd, S., & Vandenberghe, L. (2004). Convex Optimization. Cambridge University Press.

European Parliament and Council. (2024). Regulation (EU) 2024/1689 Laying Down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act). Official Journal of the European Union.

Gross, D., Shortle, J. F., Thompson, J. M., & Harris, C. M. (2008). Fundamentals of Queueing Theory (4th ed.). John Wiley & Sons.

Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017). On Calibration of Modern Neural Networks. Proceedings of the 34th International Conference on Machine Learning (ICML), 1321-1330.

Kleinrock, L. (1975). Queueing Systems, Volume 1: Theory. John Wiley & Sons.

Lehoczky, J. P. (1996). Real-Time Queueing Theory. Proceedings of the 17th IEEE Real-Time Systems Symposium (RTSS), 186-195. DOI: 10.1109/REAL.1996.563715.

National Institute of Standards and Technology. (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0). NIST AI 100-1. DOI: 10.6028/NIST.AI.100-1.

Paleyes, A., Urma, R.-G., & Lawrence, N. D. (2022). Challenges in Deploying Machine Learning: A Survey of Case Studies. ACM Computing Surveys, 55(6), 1-29. DOI: 10.1145/3533378.

SAZU, M. H. (2023). A Full-Stack Production-Platform Reference Architecture For Governed Agentic And Automated-Action Enterprise Systems. IPHO-Journal Of Advance Research In Science And Engineering, 1(12), 49-58.

SAZU, M. H. (2023). Governed Decision-Intelligence (GDI). Ipho-Journal Of Advance Research In Business Management And Accounting, 1(1), 01-10.

Stidham, S. (2002). Analysis, Design, and Control of Queueing Systems. Operations Research, 50(1), 197-216. DOI: 10.1287/opre.50.1.197.17783

Published
2026-10-24
How to Cite
Herrera, D., & Mei-Ling, W. (2026). Optimal Oversight Under Capacity. GPH-International Journal of Computer Science and Engineering, 9(1), 205-215. https://doi.org/10.5281/zenodo.23623525