Uploaded September 2025 | Updated September 2026, 3 weeks ago
LLMs have been extensively evaluated for general summarization tasks as well as medical research assistance, but they have not been specifically evaluated for the task of summarizing real-world evidence from structured output of RWE studies. This paper introduces RWESummary, a proposed addition to the MedHELM framework (Bedi, Cui, Fuentes, Unell et al., 2025) to enable benchmarking of LLMs for this task.
In this video, the paper's lead author, Arjun Mukerji, PhD, Staff Data Scientist at Atropos Health, walks you through the research and its implications.
Read/listen/learn:
arize.com/blog/atropos-healths-arjun-mukerji-phd-explains-rwesummary-a-framework-and-test-for-choosing-llms-to-summarize-real-world-evidence-rwe-studies
LLMs have been extensively evaluated for general summarization tasks as well as medical research assistance, but they have not been specifically evaluated for the task of summarizing real-world evidence from structured output of RWE studies. This paper introduces RWESummary, a proposed addition to the MedHELM framework (Bedi, Cui, Fuentes, Unell et al., 2025) to enable benchmarking of LLMs for this task.
In this video, the paper's lead author, Arjun Mukerji, PhD, Staff Data Scientist at Atropos Health, walks you through the research and its implications.
Read/listen/learn:
arize.com/blog/atropos-healths-arjun-mukerji-phd-explains-rwesummary-a-framework-and-test-for-choosing-llms-to-summarize-real-world-evidence-rwe-studies
