Uploaded July 2024 | Updated November 2026, 3 hours ago
Institute for Assured Autonomy & Computer Science Seminar Series
February 3, 2022
“Interpretable Neural Networks for Computer Vision: Clinical Decisions That Are Computer-Aided, Not Automated”
Cynthia Rudin, Duke University
Let us consider a difficult computer vision challenge: Would you want an algorithm to determine whether you should get a biopsy, based on an X-ray? That's usually a decision made by a radiologist, based on years of training. We know that algorithms haven't worked perfectly for a multitude of other computer vision applications, and biopsy decisions are harder than just about any other application of computer vision that we typically consider. The interesting question is whether it is possible that an algorithm could be a true partner to a physician, rather than making the decision on its own. To do this, at the very least, we would need an interpretable neural network that is as accurate as its black box counterparts. In this talk, Cynthia Rudin will discuss two approaches to interpretable neural networks: (1) case-based reasoning, where parts of images are compared to other parts of prototypical images for each class, and (2) neural disentanglement using a technique called concept whitening. The case-based reasoning technique is strictly better than saliency maps, and the concept whitening technique provides a strict advantage over the post-hoc use of concept vectors. She will discuss the following papers: "This Looks Like That: Deep Learning for Interpretable Image Recognition," Conference and Workshop on Neural Information Processing Systems spotlight, 2019; "IAIA-BL: A Case-based Interpretable Deep Learning Model for Classification of Mass Lesions in Digital Mammography," 2021;" "Concept Whitening for Interpretable Image Recognition," Nature Machine Intelligence, 2020; "Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead," Nature Machine Intelligence, 2019; and "Interpretable Machine Learning: Fundamental Principles and 10 Grand Challenges," 2021.
Cynthia Rudin is a professor of computer science, electrical and computer engineering, statistical science, mathematics, and biostatistics and bioinformatics at Duke University. She directs the Interpretable Machine Learning Lab, whose goal is to design predictive models with reasoning processes that are understandable to humans. Her lab applies machine learning in many areas, such as health care, criminal justice, and energy reliability. She holds an undergraduate degree from the University at Buffalo and a PhD from Princeton University. Rudin is the recipient of the 2022 Squirrel AI Award for Artificial Intelligence for the Benefit of Humanity from the Association for the Advancement of Artificial Intelligence (the “Nobel Prize of AI”). She is a fellow of the American Statistical Association, the Institute of Mathematical Statistics, and the Association for the Advancement of Artificial Intelligence. Her work has been featured in many news outlets, including The New York Times, The Washington Post, The Wall Street Journal, and The Boston Globe.
Institute for Assured Autonomy & Computer Science Seminar Series
February 3, 2022
“Interpretable Neural Networks for Computer Vision: Clinical Decisions That Are Computer-Aided, Not Automated”
Cynthia Rudin, Duke University
Let us consider a difficult computer vision challenge: Would you want an algorithm to determine whether you should get a biopsy, based on an X-ray? That's usually a decision made by a radiologist, based on years of training. We know that algorithms haven't worked perfectly for a multitude of other computer vision applications, and biopsy decisions are harder than just about any other application of computer vision that we typically consider. The interesting question is whether it is possible that an algorithm could be a true partner to a physician, rather than making the decision on its own. To do this, at the very least, we would need an interpretable neural network that is as accurate as its black box counterparts. In this talk, Cynthia Rudin will discuss two approaches to interpretable neural networks: (1) case-based reasoning, where parts of images are compared to other parts of prototypical images for each class, and (2) neural disentanglement using a technique called concept whitening. The case-based reasoning technique is strictly better than saliency maps, and the concept whitening technique provides a strict advantage over the post-hoc use of concept vectors. She will discuss the following papers: "This Looks Like That: Deep Learning for Interpretable Image Recognition," Conference and Workshop on Neural Information Processing Systems spotlight, 2019; "IAIA-BL: A Case-based Interpretable Deep Learning Model for Classification of Mass Lesions in Digital Mammography," 2021;" "Concept Whitening for Interpretable Image Recognition," Nature Machine Intelligence, 2020; "Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead," Nature Machine Intelligence, 2019; and "Interpretable Machine Learning: Fundamental Principles and 10 Grand Challenges," 2021.
Cynthia Rudin is a professor of computer science, electrical and computer engineering, statistical science, mathematics, and biostatistics and bioinformatics at Duke University. She directs the Interpretable Machine Learning Lab, whose goal is to design predictive models with reasoning processes that are understandable to humans. Her lab applies machine learning in many areas, such as health care, criminal justice, and energy reliability. She holds an undergraduate degree from the University at Buffalo and a PhD from Princeton University. Rudin is the recipient of the 2022 Squirrel AI Award for Artificial Intelligence for the Benefit of Humanity from the Association for the Advancement of Artificial Intelligence (the “Nobel Prize of AI”). She is a fellow of the American Statistical Association, the Institute of Mathematical Statistics, and the Association for the Advancement of Artificial Intelligence. Her work has been featured in many news outlets, including The New York Times, The Washington Post, The Wall Street Journal, and The Boston Globe.










