Whose hotel does the AI recommend? An algorithm audit of reputation signals in LLM-assisted hotel selection

22d ago · Global · primary source: export.arxiv.org

Large language model assistants that recommend hotels weigh guest rating and price above all other signals, according to a new algorithm audit. The study also found that a hotel’s position in a list — a factor unrelated to quality — causally shifts recommendations by an amount equivalent to roughly $12 per night. The pre-specified audit, posted to the arXiv preprint server, used a randomized choice-based conjoint design across twelve open-weight and proprietary models [1][2]. Researchers independently varied guest rating, review volume and recency, management response, chain affiliation, price, eco-certification, and list position for sets of five hotels, then estimated the average marginal component effect of each signal on the probability of being recommended [2]. A top guest rating raised selection by 31.6 percentage points, while a high price lowered it by 30.0 percentage points [2]. The dominance of valence and price mirrors patterns observed in human decision-making, the authors note, but the models over-weighted eco-certification and ignored management response [2]. List position — a content-free artifact — exerted a causal effect on recommendations worth about $12 per night [2]. The stated reasons the models gave for their choices tracked the revealed weights only imperfectly [2]. The paper, authored by Mirza Samad Ahmed Baig and submitted on 15 June 2026, frames the results as grounding for generative engine optimization and the accountability of AI infomediaries [1][2]. Large language models are a class of machine learning systems trained on vast text corpora for tasks such as language generation, and they have been deployed across sectors including e-commerce and decision-support [3][9]. The audit’s findings arrive as travelers increasingly turn to these assistants for lodging advice, making the systems de facto gatekeepers of property visibility [2]. The study did not examine whether the observed patterns vary across geographic markets or hotel segments. The preprint appears on arXiv, an open-access repository that hosts scientific papers in fields including computer science and statistics before peer review [7]. As of late 2024, the platform was receiving roughly 24,000 new articles per month [7].

research-paperfunding

Background sources we checked (8)
  • arxiv.org ↗ Travelers increasingly ask large language model (LLM) assistants which hotel to book, making these systems gatekeepers of property visibility -- yet what moves their recommendations is undocumented. We conduct a pre-specified algorithm audit using a randomized choice-based conjoi…
  • en.wikipedia.org ↗ Artificial intelligence is the capability of computational systems to perform tasks that are typically associated with human intelligence, such as learning, reasoning, problem-solving, perception, and decision-making. Artificial intelligence has been used in applications througho…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…

Sources

Spot something wrong? Report an issue