The IBM Finding and What It Actually Tells Us
IBM's recent security research found shadow AI present in 43% of incident reports, a figure now being used by insurers to set exclusion clauses and by EU regulators to impose new board-level disclosure requirements. The business press has framed this as a cybersecurity story. That framing is wrong, or at least incomplete. Shadow AI is not primarily a threat vector. It is evidence of a coordination failure between what organizations formally sanction and what workers actually need to do their jobs effectively.
The distinction matters because the policy response changes entirely depending on which diagnosis you accept. A security framing produces access controls, monitoring software, and insurance riders. A coordination framing produces a different question: why are workers routing around sanctioned tools in the first place, and what does that tell us about the gap between organizational AI governance and actual task environments?
Why Workers Adopt Shadow AI: The Competence Inversion Problem
Classical organizational theory assumes that governance structures are designed for workers who already understand the tools they are being given. The hierarchy provides rules; workers apply them. This assumption breaks down entirely in algorithmically-mediated environments, and shadow AI is one of the clearest demonstrations of that breakdown in recent corporate news.
When workers adopt unsanctioned AI tools, they are not primarily acting recklessly. They are solving a competence problem that the organization has not solved for them. Sanctioned enterprise AI tools frequently arrive with procedural training: here is how to open the interface, here is the prompt structure, here is the approved use case. What that training does not provide is any structural understanding of how the underlying model behaves, where it fails, or how to adapt when the approved procedure produces bad output. Workers who develop that structural understanding independently - often through unsanctioned experimentation with consumer tools - become more capable. The organization then classifies their superior performance as a security risk (Kellogg, Valentine, & Christin, 2020).
This is the competence inversion: the workers with the most accurate mental models of AI tools are frequently the ones operating outside sanctioned boundaries, because sanctioned training did not produce those models.
The Awareness-Capability Gap at the Board Level
The EU disclosure requirements emerging from this insurance data create an interesting pressure on boards. Directors are now required to acknowledge AI-related risks in governance documentation. But acknowledgment is not understanding. This is precisely the awareness-capability gap that algorithmic literacy research has documented at the worker level, now appearing at the governance level (Gagrain, Naab, & Grub, 2024).
A board that discloses "shadow AI risk" without any structural understanding of why shadow AI adoption occurs is performing governance, not exercising it. The disclosure requirement makes the awareness gap visible and official. It does not close it. Boards that treat this as a compliance checkbox will find that their disclosed risk models are wrong in the same way that workers' folk theories about algorithms are wrong: they identify that a system exists without understanding how it actually behaves (Hancock, Naaman, & Levy, 2020).
What Cannot Be Priced Cannot Be Governed
The headline framing - that companies cannot price the shadow AI risk they cannot see - is accurate but points in the wrong direction. The invisibility is not a detection problem. Organizations cannot see shadow AI risk clearly because they have no adequate schema for understanding why AI adoption diverges from sanctioned pathways. Insurance exclusions price the outcome of that ignorance. They do not address the ignorance itself.
Hatano and Inagaki (1986) distinguished routine expertise from adaptive expertise: routine expertise follows procedures effectively within known parameters, while adaptive expertise applies underlying principles to novel configurations. Corporate AI governance, as it currently exists in most organizations, is a routine expertise operation trying to manage an adaptive expertise problem. The EU disclosure mandates and insurer exclusion clauses are procedural responses. They will produce compliance behavior without producing the structural understanding that would actually reduce the underlying risk.
The Organizational Implication
The IBM data, read carefully, suggests that the 43% figure is not a measure of employee recklessness. It is a measure of the distance between how organizations have chosen to govern AI adoption and how workers have actually experienced the task demands that AI tools address. That distance is a coordination failure, and it will not be closed by tighter access controls or better disclosure language in annual reports. It requires organizations to reckon with the fact that sanctioned training has been producing awareness without capability, and that workers have been filling that gap on their own, outside organizational boundaries, in ways that are now showing up in insurance incident reports (Rahman, 2021).
The security framing gives organizations something to monitor and exclude. The coordination framing gives organizations something harder: a structural problem in how they develop and deploy AI competence at scale.
References
Gagrain, A., Naab, T. K., & Grub, J. (2024). Algorithmic media use and algorithm literacy. New Media & Society.
Hancock, J. T., Naaman, M., & Levy, K. (2020). AI-mediated communication: Definition, research agenda, and ethical considerations. Journal of Computer-Mediated Communication, 25(1), 89-100.
Hatano, G., & Inagaki, K. (1986). Two courses of expertise. In H. Stevenson, H. Azuma, & K. Hakuta (Eds.), Child development and education in Japan (pp. 262-272). Freeman.
Kellogg, K. C., Valentine, M. A., & Christin, A. (2020). Algorithms at work: The new contested terrain of control. Academy of Management Annals, 14(1), 366-410.
Rahman, H. A. (2021). The invisible cage: Workers' reactivity to opaque algorithmic evaluations. Administrative Science Quarterly, 66(4), 945-988.
Roger Hunt