MosaicLeaks:Privacy Risks in Querying-in-the-Open for Deep Research Agents

36d ago · Global · primary source: export.arxiv.org

Multi-source synthesis by The Embedding Report from 5 sources. Every numeric and quoted claim traces to a cited source body (see methodology).

Researchers have introduced several new benchmarks and frameworks for deep research report generation and mobile GUI agents, addressing privacy risks, multimodal tasks, and evaluation methods.

A series of recent papers on arXiv.org have presented advancements in deep research agents and mobile GUI benchmarking. The MosaicLeaks benchmark, introduced in a paper submitted in 2026[1], evaluates the privacy risks associated with deep research agents that combine private local documents with external tools. It comprises 1,001 multi-hop deep research tasks and assesses leakage at three levels: research intent, answers to private questions, and verifiable claims about enterprise documents. The study found that models frequently leak sensitive information and that zero-shot privacy prompting reduces but does not eliminate leakage[1]. Reinforcement learning for task performance alone was shown to worsen leakage. In a related development, a paper submitted in 2026 proposed the SCORE framework, which improves deep research report generation through a shared-parameter learning process that jointly evolves the evaluator and solver[5]. Meanwhile, the TVIR paper, also submitted in 2026, introduced a benchmark of 100 expert-curated multimodal deep research tasks and a hierarchical multi-agent framework called TVIR-Agent[2]. Experiments across nine deep research systems demonstrated that TVIR-Agent achieves strong overall performance. Another benchmark, ADRA-Bank, was presented in a paper first submitted in 2025 and revised in 2026[3]. It includes 200 human-annotated instances across 10 academic domains and assesses the capabilities of planning, retrieval, and reasoning in academic deep research agents. For mobile GUI agents, the MobiBench framework was introduced in a paper last revised in 2026[4]. MobiBench is the first modular and multi-path aware offline benchmarking framework and achieved 94.72 percent agreement with human evaluators.

applicationresearch-paperbenchmarktool-release

Background sources we checked (1)
  • arxiv.org ↗ Deep research agents increasingly combine private local documents with external tools like web retrieval, creating a privacy risk: an agent's external queries may leak sensitive information from its local context. This risk is amplified by the mosaic effect, where individual quer…

Sources cited (5)

  1. arxiv.org ↗ E
  2. arxiv.org ↗ E
  3. arxiv.org ↗ E
  4. arxiv.org ↗ E
  5. arxiv.org ↗ E
Spot something wrong? Report an issue