Uploaded June 2025 | Updated November 2026, 2 hours ago
Abstract: Current Visual Foundation Model (VFM) development typically follows a linear pipeline: data curation, pre-training/modeling, and deployment to downstream use cases. While this streamlined approach has enabled remarkable progress through scale, it faces significant challenges due to increasingly complex use cases and inherent data scarcity. In this talk, I will introduce the VFM Flywheel, a new paradigm designed to address these challenges and foster the next generation of VFMs. Specifically, I propose establishing critical feedback loops connecting three essential stages: 1) domain-specific insights from downstream use cases should directly inform pre-training and model development, 2) pre-training should more effectively leverage existing data, including unlabeled data, 3) downstream use cases should directly guide the data curation practices for pre-training. I will conclude by highlighting future directions and emerging opportunities
enabled by the VFM Flywheel. Ultimately, this paradigm offers a promising path toward developing more capable, efficient, and safer visual intelligence systems.
Bio: Jason Ren is a research scientist at Apple. He received his Ph.D. from the University of Illinois Urbana-Champaign (UIUC), advised by Alex Schwing and Shenlong Wang. His research interests lie at the intersection of Computer Vision and Machine Learning, with a focus on generative modeling, efficient ML, and 3D vision. During his PhD, he interned at NVIDIA Research, Facebook AI Research, Adobe Research, and Apple. He is a recipient of the Yee Fellowship and the Yunni & Maxine Pao Fellowship. For more information, please visit jason718.github.io
Abstract: Current Visual Foundation Model (VFM) development typically follows a linear pipeline: data curation, pre-training/modeling, and deployment to downstream use cases. While this streamlined approach has enabled remarkable progress through scale, it faces significant challenges due to increasingly complex use cases and inherent data scarcity. In this talk, I will introduce the VFM Flywheel, a new paradigm designed to address these challenges and foster the next generation of VFMs. Specifically, I propose establishing critical feedback loops connecting three essential stages: 1) domain-specific insights from downstream use cases should directly inform pre-training and model development, 2) pre-training should more effectively leverage existing data, including unlabeled data, 3) downstream use cases should directly guide the data curation practices for pre-training. I will conclude by highlighting future directions and emerging opportunities
enabled by the VFM Flywheel. Ultimately, this paradigm offers a promising path toward developing more capable, efficient, and safer visual intelligence systems.
Bio: Jason Ren is a research scientist at Apple. He received his Ph.D. from the University of Illinois Urbana-Champaign (UIUC), advised by Alex Schwing and Shenlong Wang. His research interests lie at the intersection of Computer Vision and Machine Learning, with a focus on generative modeling, efficient ML, and 3D vision. During his PhD, he interned at NVIDIA Research, Facebook AI Research, Adobe Research, and Apple. He is a recipient of the Yee Fellowship and the Yunni & Maxine Pao Fellowship. For more information, please visit jason718.github.io



![Explaining Answers with Entailment Trees
Explaining Answers with Entailment Trees
Bhavana Dalvi
https://allenai.org/team/bhavanad
Our goal, in the context of open-domain textual question-answering (QA), is to explain answers by showing the line of reasoning from what is known to the answer, rather than simply showing a fragment of textual evidence (a rationale). If this could be done, new opportunities for understanding and debugging the systems reasoning become possible. Our approach is to generate explanations in the form of entailment trees, namely a tree of multipremise entailment steps from facts that are known, through intermediate conclusions, to the hypothesis of interest (namely the question + answer). To train a model with this skill, we created ENTAILMENTBANK, the first dataset to contain multistep entailment trees. Given a hypothesis (question + answer), we define three increasingly difficult explanation tasks: generate a valid entailment tree given (a) all relevant sentences (b) all relevant and some irrelevant sentences, or (c) a corpus. We show that a strong language model can partially solve these tasks, in particular when the relevant sentences are included in the input (e.g., 35% of trees for (a) are perfect), and with indications of generalization to other domains. This work is significant as it provides a new type of dataset (multistep entailments) and baselines, offering a new avenue for the community to generate richer, more systematic explanations. [ Paper published in EMNLP 2021, https://arxiv.org/abs/2104.08661 ] Explaining Answers with Entailment Trees](https://i.ytimg.com/vi/QPSZQYA1RmA/mqdefault.jpg)






