TriageRA-CCF: Source-Side Clinical Confidence and Coverage Signals for Adaptive Rank Budgeting in Medical LLMs
- lab CatalyzeX
- lab DagsHub
- lab GotitPub
- lab Hugging Face
- lab ScienceCast
- lab alphaXiv
- lab arXivLabs
Researchers have proposed TriageRA-CCF, a source-side teacher for adaptive rank-budgeted LoRA, to improve medical question answering. The method combines three signals computed from source training data to achieve better average accuracy on Qwen3-8B and Llama3.1-8B models.
TriageRA-CCF uses base-model answer confidence, metadata-cell clinical coverage, and a counterfactual close-miss proxy to supervise a budget router over active ranks {2,4,8}. This approach achieved the best average accuracy among LoRA, DoRA, and MoELoRA baselines on both models, with a +0.21 point improvement on Qwen3-8B and +0.16 on Llama3.1-8B [1]. Separately, researchers found that memory consolidation in LLM agents can lead to incorrect decisions by turning casual remarks into confident assertions. LLM agents store 'facts' in compressed memory, which can be trusted by later steps without verification [2]. In a different study, a generative social simulation framework called ConsumerSim was introduced to reconstruct Consumer Confidence Index (CCI) dynamics from synthetic populations. ConsumerSim outperformed baseline models on reported reconstruction metrics and improved short-horizon prediction of real activity, particularly for housing outcomes [3].
research-papermodel-release
Background sources we checked (6)
- arxiv.org ↗ Medical large language models are commonly adapted with a fixed low-rank budget, even though medical questions differ substantially in confidence, clinical coverage, and cross-domain difficulty. We study adaptive rank budgeting for parameter-efficient medical question answering: …
- arxiv.org ↗ # A Universal Catalyst for First-Order Optimization ... arXiv (Cornell University), 2015. Preprint. 185 citations. ... We introduce a generic scheme for accelerating first-order optimization methods in the sense of Nesterov, which builds upon a new analysis of the accelerated pro…
- arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) ... DagsHub Toggle ... DagsHub (What is DagsHub?)…
- arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) ... DagsHub Toggle ... DagsHub (What is DagsHub?)…
- en.wikipedia.org ↗ Sustainable Development Goals (abbr. SDGs) were adopted in 2015 by all United Nations (UN) members for the 2030 Agenda for Sustainable Development. The aim of the 17 global goals is "peace and prosperity for people and the planet", tackling climate change, and working to preserv…
- en.wikipedia.org ↗ In molecular biology, a transcription factor (TF) (or sequence-specific DNA-binding factor) is a protein that controls the rate of transcription of genetic information from DNA to messenger RNA, by binding to DNA sequences. Specificity can be due to sequence motifs, or epigenetic…