Curation and Extraction of Drug-Related Entities from Reddit Platform

Medical training on illicit drugs relies heavily on overdose cases, leaving clinicians with a narrow view of real-world substance use, according to a new study that proposes mining social media for patient-curated narratives [1]. The research, posted to arXiv on 8 April 2026, introduces ReDose, a dataset built from 6,435 Reddit posts in which users describe their first-hand experiences with drugs, including dosage and effects [1][2]. A board-certified toxicologist annotated the training and test sets, while two medical science students contributed to the test set by labeling DRUG, DOSE, and EFFECT entities [1][2]. The team benchmarked 6,267 annotations across several model architectures [1][2]. BiomedBERT, a domain-specific variant of the BERT language model, reached an F1-score of 0.843 on the DRUG extraction task [1][2]. Among large language models, Llama-3 70B posted an F1-score of 0.79, outperforming GPT-4, which scored 0.72 [1][2]. Identifying effects proved more difficult: GPT-4 managed a recall of just 0.41 on the EFFECT task [1][2]. The work sits at the intersection of natural language processing and clinical informatics. Sentiment analysis and entity extraction from social media have been applied to healthcare materials for years, though the informal, often coded language of drug forums presents distinct challenges [3]. High-quality labeled datasets remain expensive to produce, a bottleneck that the ReDose team sought to address by enlisting clinical specialists for annotation [5]. Artificial intelligence techniques have accelerated since the 2010s, when deep learning began outperforming earlier methods, and the 2017 introduction of the transformer architecture paved the way for models such as BERT and GPT [4]. The ReDose paper extends that lineage by testing both encoder-only models like BiomedBERT and decoder-only large language models on a specialized corpus [1][2]. The authors argue that the dataset captures perspectives absent from clinical overdose records, potentially giving physicians a more complete picture of how drugs are used outside hospital settings [1][2].