LegalWorld: A Life-Cycle Interactive Environment for Legal Agents

20d ago · Global · primary source: export.arxiv.org

A team of researchers has introduced LegalWorld, a life-cycle interactive environment that models Chinese civil litigation as a causally connected state chain of five stages, aiming to address a gap in how legal AI agents are evaluated [1]. The environment, detailed in a paper submitted to arXiv on June 17, 2026, is grounded in 75,309 paired Chinese civil judgments [1][2]. Unlike existing legal benchmarks that evaluate isolated subtasks, LegalWorld simulates the entire litigation process, where actions at one stage constrain what is possible at later stages [2]. The system is paired with reusable infrastructure, including local memory, global case memory, and a Skill/Tool library, to keep each dispute consistent across its full life cycle [1][2]. Building on this environment, the researchers constructed LongJud-Bench, a benchmark designed to evaluate agent capability across all five connected stages [1][2]. To validate the procedural fidelity of the simulations, the team collected 18,992 ratings from 217 evaluators with legal backgrounds [1][2]. These ratings confirmed that the trajectories generated within LegalWorld are procedurally faithful and role-consistent [1][2]. The concept of modeling a legal life cycle mirrors the structure of corporate law, which governs the formation, funding, governance, and dissolution of a corporation [3]. The researchers' approach of creating a causally connected state chain is a departure from prior legal-agent simulators, which typically reinitialize each scenario from a shared ground truth, thereby leaving cross-stage causal dependencies unmodeled [2]. A cross-model evaluation using LongJud-Bench revealed sharp divergences in agent capabilities that aggregate scores could not expose, with no single model backbone leading across the distinct tasks of consultation, drafting, and courtroom advocacy [1][2]. The researchers stated that detailed resources for the project will be released publicly [1][2].

applicationresearch-papermodel-releasebenchmarktool-release

Background sources we checked (10)
  • arxiv.org ↗ Civil litigation is inherently a life-cycle process: what a lawyer drafts on day one constrains what unfolds at trial months later. Yet existing legal benchmarks evaluate isolated subtasks, and prior legal-agent simulators reinitialize each scenario from shared ground truth, leav…
  • en.wikipedia.org ↗ Corporate law (also known as company law or enterprise law) is the body of law governing the rights, relations, and conduct of persons, companies, organizations, and businesses. The term refers to the legal practice of law relating to corporations, or to the theory of corporation…
  • en.wikipedia.org ↗ Second Life is a multi-user virtual world that allows people to create an avatar for themselves and then interact with other users (known as 'Residents') and user-created content within a multi-user online environment. Developed for personal computers by the San Francisco-based f…
  • en.wikipedia.org ↗ The Clandestine HUMINT page adheres to the functions within the discipline, including espionage and active counterintelligence. The page deals with Clandestine HUMINT operational techniques, also known as "tradecraft". It applies to clandestine operations for espionage, and a cla…
  • en.wikipedia.org ↗ Nature is an inherent character or constitution, particularly of the ecosphere or the universe as a whole. In this general sense nature refers to the laws, elements and phenomena of the physical world, including life. Although humans are part of nature, human activity or humans a…
  • en.wikipedia.org ↗ A virtual world (also called a virtual space or spaces) is a computer-simulated environment which may be populated by many simultaneous users who can create a personal avatar and independently explore the virtual world, participate in its activities, and communicate with others. …
  • en.wikipedia.org ↗ Public informatics is an interdisciplinary academic, professional, and applied research field that integrates advanced data science, artificial intelligence, quantitative methods, geographic information systems, governance, and management with areas such as smart cities, socially…
  • en.wikipedia.org ↗ Fermi National Accelerator Laboratory (FNAL; branded as Fermilab) is a national laboratory for high-energy particle physics, located in Batavia, Illinois, United States, near Chicago. It is sponsored by the United States Department of Energy and operated by the University of Chic…
  • en.wikipedia.org ↗ This list compares various energies in joules (J), organized by order of magnitude.…
  • en.wikipedia.org ↗ Bidirectional encoder representations from transformers (BERT) is a language model introduced in October 2018 by researchers at Google. It learns to represent text as a sequence of vectors using self-supervised learning. It uses the encoder-only transformer architecture. BERT dra…

Sources

Spot something wrong? Report an issue