AI agents are not your “coworkers”
- company Anthropic
- company Google
- company Microsoft
- company Nvidia
- company OpenAI
- person Daron Acemoglu
- person Emma Wiles
- person Jensen Huang
Framing artificial intelligence agents as digital employees rather than software tools causes human workers to catch fewer errors and offload more accountability, according to new research from Boston University. The findings raise concerns as major technology companies increasingly market agentic AI as autonomous colleagues. Emma Wiles, a Boston University business professor, studied 1,261 managers and found that people caught 18% fewer errors when work was attributed to an agentic "AI employee" rather than a chatbot [1]. Participants also viewed themselves as less responsible for the output when the AI was framed as a subordinate, and they were 44% more likely to escalate questionable work to a manager for further review instead of trusting their own corrections [1]. Nearly a quarter of managers surveyed — 23% — said their companies already list AI agents on organizational charts [1]. The technical capabilities of agentic AI have advanced. These systems are programmed to operate in a loop until they achieve a specified goal, and they have become measurably better at complex tasks [1]. Since April, Microsoft, OpenAI, Anthropic, and Google have all released tools oriented toward managing teams of AI agents, many explicitly advertised as digital colleagues with the flexibility and cognitive power of actual humans [1]. Anthropic, founded in 2021 by former OpenAI members including siblings Daniela and Dario Amodei, has developed the Claude series of large language models with a focus on AI safety [11]. The implications extend beyond office culture. AI agents are being embedded into health care, warfare, education, and government, creating a growing risk that they will become a convenient place to dump blame for failures that are instead the product of bad human decisions, incentives, and oversight [1]. Daron Acemoglu, an MIT economist who won the Nobel Prize in 2024, said the current marketing approach is misguided. "AI agents right now are being marketed as things that can replace humans, and I think that's just a losing proposition," Acemoglu said. "They should instead be optimized so that they can improve human capabilities, which is not what they have been at the moment" [1]. Transformer-based language models have become the default substrate for natural language processing, with post-2023 developments including instruction tuning, reinforcement learning from human feedback, and mixture-of-experts scaling now standard across flagship model families from OpenAI, Anthropic, Google, Meta, Mistral, and DeepSeek [6]. These models are increasingly deployed as automated evaluators for tasks such as reviewing code, moderating content, or scoring outputs [8]. Research on large language model evaluation has identified a phenomenon called the accumulated message effect, in which prior conversation history biases subsequent judgments, with models shifting toward the prevailing polarity of preceding evaluations [8]. A separate effort at Stanford University presented 1,500 workers in 104 jobs with information about what tasks AI could potentially perform in their roles, then asked what would actually be most helpful [1]. Workers did want automation in certain areas — law clerks thought AI could help ensure adequate progress across cases, for example — but often the tasks that technology experts deemed most suitable for AI were precisely what actual workers said they did not want or need an agent to do [1]. Calling an AI tool an employee is a branding exercise that does not make the tool more fit for the job, and as Wiles's research shows, it makes the humans around it worse at theirs [1].
commentary
Background sources we checked (10)
- en.wikipedia.org ↗ Agents of S.H.I.E.L.D. is an American television series created for ABC by Joss Whedon, Jed Whedon, and Maurissa Tancharoen, based on the Marvel Comics organization S.H.I.E.L.D. (Strategic Homeland Intervention, Enforcement and Logistics Division), a fictional peacekeeping and sp…
- en.wikipedia.org ↗ Immigration detentions of U.S. citizens in the second Trump administration were caused by U.S. immigration enforcement actions by agencies including Immigration and Customs Enforcement (ICE) and U.S. Customs and Border Protection (CBP) and involved documented cases in which Ameri…
- en.wikipedia.org ↗ Take Us to Your Chief: and Other Stories is a collection of nine short stories by Canadian author, playwright, and journalist Drew Hayden Taylor published in 2016 by Douglas & McIntyre. Taylor, who is part Caucasian, part Ojibwe, explains in the acknowledgments section of the boo…
- en.wikipedia.org ↗ This is a list of Super Bowl commercials that played during the 2020s. This article does not list advertisements for a local region or station (e.g. promoting local news shows), pre-kickoff and post-game commercials/sponsors, or in-game advertising sponsors and television bumpers…
- arxiv.org ↗ Transformer-based language models have become the default substrate for natural language processing and the pace of new releases has made it hard for practitioners to separate durable ideas from the noise of incremental announcements. This review works at two levels. At the level…
- arxiv.org ↗ Cloze is an open-source web platform for conducting controlled, monitored studies of human-AI conversation in mental health research contexts. Consumer large language model (LLM) products such as ChatGPT, Claude, and Gemini are built for individual productivity, and offer researc…
- arxiv.org ↗ Large language models are routinely used as automated evaluators: to review code, moderate content, or score outputs, often with many items passing through one conversation. We ask whether the polarity of prior conversation history biases subsequent judgments, an effect we call t…
- arxiv.org ↗ As Large Language Models (LLMs) evolve into persistent scientific collaborators, context window saturation has emerged as a critical bottleneck. Scientific workflows involving iterative data analysis and hypothesis refinement rapidly saturate even extended contexts with dense tec…
- arxiv.org ↗ Prompt specifications for multi-agent large language model (LLM) systems carry data contracts and integration logic across interdependent files but are rarely subjected to structured-inspection rigor. We report a single-system case study of iterative, agent-driven auditing applie…
- en.wikipedia.org ↗ Anthropic PBC is an American artificial intelligence (AI) company headquartered in San Francisco, California. It has developed a series of large language models (LLMs) named Claude and has a focus on AI safety. Anthropic was founded in 2021 by former members of OpenAI, including …
Sources
- technologyreview.com — AI agents are not your “coworkers” ↗