Misinformation in healthcare, from vaccine hesitancy to unproven treatments, poses risks to public health and trust in medical systems. While machine learning and natural language processing have advanced automated fact-checking, validating biomedical claims remains uniquely challenging due to complex terminology, the need for domain expertise, and the critical importance of grounding in scientific evidence. We introduce CER (Combining Evidence and Reasoning), a novel framework for biomedical fact-checking that integrates scientific evidence retrieval, reasoning via large language models, and supervised veracity prediction. By integrating the text-generation capabilities of large language models with advanced retrieval techniques for high-quality biomedical scientific evidence, CER effectively mitigates the risk of hallucinations, ensuring that generated outputs are grounded in verifiable, evidence-based sources. Evaluations on expert-annotated datasets (HealthFC, BioASQ-7b, SciFact) demonstrate state-of-the-art performance and promising cross-dataset generalization. Code and data are released for transparency and reproducibility: https://github.com/PRAISELab-PicusLab/CER.

Combining Evidence and Reasoning for Biomedical Fact-Checking / Barone, M.; Romano, A.; Riccio, G.; Postiglione, M.; Moscato, V.. - (2025), pp. 1087-1097. ( 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025 Padua, Italy July 13-18, 2025) [10.1145/3726302.3729931].

Combining Evidence and Reasoning for Biomedical Fact-Checking

Barone M.;Postiglione M.;Moscato V.
2025

Abstract

Misinformation in healthcare, from vaccine hesitancy to unproven treatments, poses risks to public health and trust in medical systems. While machine learning and natural language processing have advanced automated fact-checking, validating biomedical claims remains uniquely challenging due to complex terminology, the need for domain expertise, and the critical importance of grounding in scientific evidence. We introduce CER (Combining Evidence and Reasoning), a novel framework for biomedical fact-checking that integrates scientific evidence retrieval, reasoning via large language models, and supervised veracity prediction. By integrating the text-generation capabilities of large language models with advanced retrieval techniques for high-quality biomedical scientific evidence, CER effectively mitigates the risk of hallucinations, ensuring that generated outputs are grounded in verifiable, evidence-based sources. Evaluations on expert-annotated datasets (HealthFC, BioASQ-7b, SciFact) demonstrate state-of-the-art performance and promising cross-dataset generalization. Code and data are released for transparency and reproducibility: https://github.com/PRAISELab-PicusLab/CER.
2025
Combining Evidence and Reasoning for Biomedical Fact-Checking / Barone, M.; Romano, A.; Riccio, G.; Postiglione, M.; Moscato, V.. - (2025), pp. 1087-1097. ( 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025 Padua, Italy July 13-18, 2025) [10.1145/3726302.3729931].
File in questo prodotto:
File Dimensione Formato  
3726302.3729931.pdf

accesso aperto

Descrizione: PDF paper
Tipologia: Versione Editoriale (PDF)
Licenza: Copyright dell'editore
Dimensione 1.47 MB
Formato Adobe PDF
1.47 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11588/1044923
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact