The Paradox of Perfection: Hidden Risks of High-Performing AI in Human-in-the-Loop Governance
As AI systems achieve near-perfect accuracy in high-stakes decision-making domains, governance frameworks risk overlooking a critical paradox: superior AI reliability may render human oversight ceremonial rather than functional. This paper presents a theoretically grounded experimental research design to investigate Automation Complacency—the cognitive degradation of human vigilance triggered by sustained streaks of accurate AI outputs. Grounded in Dual-Process Theory and the competency trap lit
