Evaluating Large Language Models Abilities for Addressee, Turn-change, and Next Speaker Prediction in Meetings
- lab arXiv
- lab arXivLabs
- location California
Large language models can predict who will speak next in a meeting more accurately than humans, according to a study posted to the arXiv preprint repository on 16 June 2026. The models achieved this despite never being trained on meeting data and without access to audio or visual cues. The research, which has not yet been peer-reviewed, evaluated LLMs on three aspects of conversational turn-taking: detecting whom an utterance is addressed to, predicting whether a speaker change will occur, and identifying the next speaker [1][2]. Experiments used the AMI corpus, a standard dataset of multimodal meeting recordings [1][2]. Text-based LLMs outperformed both supervised models trained specifically for the tasks and human subjects on next speaker prediction [1][2]. The authors noted that the models succeeded even though they lacked domain-specific training and could not process audio or visual information [2]. A multimodal LLM that could access raw audio-visual signals performed better than text-only models on addressee detection and turn-change prediction, but its accuracy remained below that of humans [1][2]. The researchers wrote that this gap indicates the model had difficulty leveraging the additional sensory data [2]. Ablation analyses showed that conversational context was the most important factor for next speaker prediction [1][2]. The study also found that human and LLM prediction patterns were similar, and that both struggled during stretches of conversation with frequent turn changes [2]. The paper appeared on arXiv, an open-access repository that hosts electronic preprints across physics, mathematics, computer science, and other fields [6]. Founded in 1991, arXiv passed the two-million-article milestone by the end of 2021 and now receives roughly 24,000 submissions per month [6]. Submissions are moderated but not peer-reviewed before posting [6]. The study was shared through arXivLabs, a framework launched in 2020 that allows community collaborators to build experimental tools and features on top of the repository’s article pages [4][5]. arXivLabs projects must adhere to the repository’s stated values of openness, community, excellence, and user data privacy [4].
research-paperapplicationinfrastructurebenchmark
Background sources we checked (7)
- arxiv.org ↗ We investigate turn-taking in multimodal multi-party conversations using large language models (LLMs). We construct an evaluation framework for three tasks: addressee detection, turn-change prediction, and next speaker prediction. We compare supervised models trained for these ta…
- info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
- blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
- info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
- en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
- en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
- en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…