The Specific Allegation
A healthcare workers' union has alleged that Kaiser Permanente deployed an algorithmic e-visit tool to screen mental health patients without real-time clinician review, potentially violating California state law. Kaiser has now skipped a public hearing on these allegations for the second consecutive year. This is not a story about AI adoption gone wrong in some abstract sense. It is a story about what happens when an organization uses an algorithm to perform a coordination function that participants - patients seeking mental health care - have no framework to recognize, evaluate, or contest.
The structural detail that matters most here is not the algorithm itself. It is the absence of any visible signal that an algorithm is doing the triage at all. Patients entering a mental health e-visit have no reliable way to know whether a clinician or a decision-tree is determining their care pathway. That asymmetry is the central problem, and it extends well beyond healthcare.
Algorithmic Triage as Coordination Failure
The ALC framework I am developing treats platforms as coordination mechanisms where competency develops endogenously through participation. Classical coordination - markets, hierarchies, professional networks - assumes some baseline of ex-ante competence among participants. A patient entering a physician's office has schema for what that interaction involves. They understand, however imperfectly, the norms, the roles, and the feedback loops. Algorithmic triage removes those schemas without replacing them.
Rahman (2021) describes this dynamic as an "invisible cage" in which workers - and by extension, platform participants generally - are constrained by algorithmic rules they cannot see, audit, or appeal. The Kaiser case materializes this metaphor in a clinical setting. A mental health patient routed away from immediate care by an algorithmic screen has no recourse mechanism because they have no awareness that an algorithmic screen existed. Kellogg, Valentine, and Christin (2020) identify this as a defining feature of algorithmic management: the work of coordination becomes opaque precisely at the moment when transparency would be most consequential.
The Awareness-Capability Gap in High-Stakes Contexts
Research on algorithmic literacy consistently finds that awareness of algorithms does not translate to improved navigation of algorithmic systems (Gagrain, Naab, and Grub, 2024). In low-stakes platform contexts - content recommendation, search ranking, gig work dispatch - this gap produces unequal outcomes across workers with otherwise identical access. In a clinical mental health context, the same gap produces something categorically different: patients who cannot advocate for themselves because they do not know what they are being evaluated by.
This distinction matters for organizational theory. The variance puzzle I examine in my dissertation - why platform participants with identical access show dramatically different outcomes - typically manifests as a performance distribution problem. Some workers capture more value than others. In the Kaiser case, the distribution problem becomes a triage problem. The patients least equipped to articulate their needs through a structured algorithmic interface are, plausibly, the patients with the most acute need for clinical judgment rather than algorithmic routing. The algorithm amplifies initial differences in communicative competence at exactly the moment when those differences should be professionally compensated for.
Governance Structures and the Procedural Substitution Problem
Kaiser's decision to skip the public hearing for a second consecutive year is an organizational choice that deserves analytical attention separate from the algorithm itself. Organizations deploying algorithmic coordination tools frequently treat the algorithm as a procedural solution to a resource constraint - here, a shortage of clinicians available for real-time triage. What the ALC framework would predict, consistent with Hatano and Inagaki's (1986) distinction between routine and adaptive expertise, is that procedural substitution fails specifically in novel or high-variance cases. Algorithmic triage built from historical patient data encodes past distributions of case severity. The patient presenting in ways that deviate from those historical patterns - which is structurally more likely in mental health than in, say, dermatology - is precisely the patient the algorithm is least equipped to handle correctly.
Sundar (2020) argues that machine agency creates a distinct communicative relationship in which human participants implicitly defer to algorithmic outputs as authoritative. In a clinical setting, that deference is not merely a cognitive tendency - it is structurally enforced. The patient has no alternative channel and no visible indicator that deferral is even occurring.
What This Case Reveals
The Kaiser allegation is a concrete instance of what happens when algorithmic coordination replaces professional coordination without corresponding investment in participant schema. The problem is not that algorithms exist in healthcare. The problem is that organizations are deploying algorithmic triage in contexts where the awareness-capability gap is not just an inconvenience but a clinical risk, and where governance structures - as evidenced by two consecutive missed hearings - appear designed to reduce rather than increase accountability. That combination is what makes this case worth watching closely.
References
Gagrain, A., Naab, T. K., and Grub, J. (2024). Algorithmic media use and algorithm literacy. *New Media and Society*.
Hatano, G., and Inagaki, K. (1986). Two courses of expertise. In H. Stevenson, H. Azuma, and K. Hakuta (Eds.), *Child development and education in Japan* (pp. 262-272). Freeman.
Kellogg, K. C., Valentine, M. A., and Christin, A. (2020). Algorithms at work: The new contested terrain of control. *Academy of Management Annals, 14*(1), 366-410.
Rahman, H. A. (2021). The invisible cage: Workers' reactivity to opaque algorithmic evaluations. *Administrative Science Quarterly, 66*(4), 945-988.
Sundar, S. S. (2020). Rise of machine agency: A framework for studying the psychology of human-AI interaction. *Journal of Computer-Mediated Communication, 25*(1), 74-88.
Roger Hunt