PhoneBuddy: Training Open Models for Agentic Phone Use

14d ago · Global · primary source: export.arxiv.org

A team of researchers has introduced PhoneBuddy, an open-model training recipe designed to improve the reliability of artificial intelligence agents operating smartphones, according to a paper submitted to the arXiv preprint server on 22 June 2026 [1]. The system addresses a core difficulty in training phone-based agents: the real-device environments needed for deployment are slow, stateful, and hard to reset, while scalable mock environments only approximate real behavior [1]. To bridge this gap, PhoneBuddy combines a real-app environment with a mock-app environment called PhoneWorld, which reconstructs runnable mock apps from real graphical user interface usage structure [1]. The training pipeline first builds a shared supervised fine-tuning stage from trajectories collected in both environments, then compares reinforcement learning (RL) performed solely on real apps against mixed RL conducted across both environments [1]. In a 150-task human evaluation on real phones spanning apps, mini-apps, and cross-app workflows, the task success rate improved from 36.67% after supervised fine-tuning to 40.67% after real-app RL and 45.33% after mixed RL [1]. On the AndroidWorld benchmark, the same progression rose from 60.3% to 77.2% to 83.2% [1]. The paper, authored by Zhengyang Tang and colleagues, concludes that mock-app training is not a replacement for real-app RL but a complementary source of scalable, resettable, and automatically checked interaction [1]. The gains were strongest on app and mini-app tasks, while long-horizontal cross-app workflows remain an open challenge [1]. The work arrives amid sustained investment in general-purpose AI agents. OpenAI’s ChatGPT, originally released in November 2022, accelerated an AI boom marked by rapid investment and public attention toward artificial intelligence [3]. By February 2026, the service had reached 900 million weekly active users [3]. PhoneBuddy’s focus on open models contrasts with the proprietary systems that dominate consumer deployments, offering a training recipe that other researchers can inspect and extend [1]. arXiv, where the paper was posted, is an open-access repository of electronic preprints that has grown to a submission rate of about 24,000 articles per month as of November 2024 [11]. The repository’s arXivLabs framework allows community collaborators to develop experimental tools that appear on article record pages, such as citation explorers and code finders, under guidelines that emphasize openness and user data privacy [9][10].

research-paperapplication

Background sources we checked (10)
  • arxiv.org ↗ Phones are becoming an important execution surface for general-purpose agents, but training open models for reliable phone use remains difficult because the environment that matters at deployment, real devices running real apps, is slow, stateful, side-effectful, and hard to rese…
  • en.wikipedia.org ↗ ChatGPT is a generative artificial intelligence chatbot developed by OpenAI. Originally released in November 2022, the product uses large language models—specifically generative pre-trained transformers (GPTs)—to generate text, speech, and images in response to user prompts. Chat…
  • en.wikipedia.org ↗ K-tai Investigator 7 (ケータイ捜査官7(セブン, Kētai Sōsakan Sebun; Cell Phone Investigator Seven) is a Japanese television drama that aired from April 2, 2008, to March 18, 2009, on TV Tokyo. It was a joint collaboration between WIZ and Production I.G. Takashi Miike oversaw the project. it…
  • en.wikipedia.org ↗ The United States Navy Sea, Air, and Land (SEAL) Teams, commonly known as Navy SEALs, are the United States Navy's primary special operations force and a component of the United States Naval Special Warfare Command. Among the SEAL's main functions are conducting small-unit specia…
  • en.wikipedia.org ↗ Since the arrival of early social networking sites in the early 2000s, online social networking platforms have expanded exponentially, with the biggest names in social media in the mid-2010s being Facebook, Instagram, Twitter and Snapchat. The massive influx of personal informati…
  • en.wikipedia.org ↗ This is a list of notable individuals who come from the state of Illinois, a state within the larger United States of America.…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…

Sources

Spot something wrong? Report an issue