Test-Time Adaptation: A New Frontier in AI [Dr. Jonas Hübotter] @MachineLearningStreetTalk
Test-Time Adaptation: A New Frontier in AI [Dr. Jonas Hübotter]  @MachineLearningStreetTalk
Uploaded November 2024 | Updated November 2026, 4 days ago
Jonas Hübotter, PhD student at ETH Zurich's Institute for Machine Learning, discusses his groundbreaking research on test-time computation and local learning. He demonstrates how smaller models can outperform larger ones by 30x through strategic test-time computation and introduces a novel paradigm combining inductive and transductive learning approaches.

Using Bayesian linear regression as a surrogate model for uncertainty estimation, Jonas explains how models can efficiently adapt to specific tasks without massive pre-training. He draws an analogy to Google Earth's variable resolution system to illustrate dynamic resource allocation based on task complexity.

The conversation explores the future of AI architecture, envisioning systems that continuously learn and adapt beyond current monolithic models. Jonas concludes by proposing hybrid deployment strategies combining local and cloud computation, suggesting a future where compute resources are allocated based on task complexity rather than fixed model size.

This research represents a significant shift in machine learning, prioritizing intelligent resource allocation and adaptive learning over traditional scaling approaches.

SPONSOR MESSAGES:
CentML offers competitive pricing for GenAI model deployment, with flexible options to suit a wide range of models, from small to large-scale deployments.
centml.ai/pricing

Tufa AI Labs is a brand new research lab in Zurich started by Benjamin Crouzier focussed on ARC and AGI, they just acquired MindsAI - the current winners of the ARC challenge. Are you interested in working on ARC, or getting involved in their events? Goto tufalabs.ai

Transcription, references and show notes PDF download:
dropbox.com/scl/fi/cxg80p388snwt6qbp4m52/JonasFinal.pdf?rlkey=glk9mhpzjvesanlc14rtpvk4r&st=6qwi8n3x&dl=0

Jonas Hübotter
jonhue.github.io
scholar.google.com/citations?user=pxi_RkwAAAAJ

Transductive Active Learning: Theory and Applications (NeurIPS 2024)
arxiv.org/pdf/2402.15898

EFFICIENTLY LEARNING AT TEST-TIME: ACTIVE FINE-TUNING OF LLMS (SIFT)
arxiv.org/pdf/2410.08020

TOC:
1. Test-Time Computation Fundamentals
[00:00:00] Intro
[00:03:10] 1.1 Test-Time Computation and Model Performance Comparison
[00:05:52] 1.2 Retrieval Augmentation and Machine Teaching Strategies
[00:09:40] 1.3 In-Context Learning vs Fine-Tuning Trade-offs

2. System Architecture and Intelligence
[00:15:58] 2.1 System Architecture and Intelligence Emergence
[00:23:22] 2.2 Active Inference and Constrained Agency in AI
[00:29:52] 2.3 Evolution of Local Learning Methods
[00:32:05] 2.4 Vapnik's Contributions to Transductive Learning

3. Resource Optimization and Local Learning
[00:34:35] 3.1 Computational Resource Allocation in ML Models
[00:35:30] 3.2 Historical Context and Traditional ML Optimization
[00:37:55] 3.3 Variable Resolution Processing and Active Inference in ML
[00:43:01] 3.4 Local Learning and Base Model Capacity Trade-offs
[00:48:04] 3.5 Active Learning vs Local Learning Approaches

4. Information Retrieval and Model Interpretability
[00:51:08] 4.1 Information Retrieval and Nearest Neighbor Limitations
[01:03:07] 4.2 Model Interpretability and Surrogate Models
[01:15:03] 4.3 Bayesian Uncertainty Estimation and Surrogate Models

5. Distributed Systems and Deployment
[01:23:56] 5.1 Memory Architecture and Controller Systems
[01:28:14] 5.2 Evolution from Static to Distributed Learning Systems
[01:38:03] 5.3 Transductive Learning and Model Specialization
[01:41:58] 5.4 Hybrid Local-Cloud Deployment Strategies
Test-Time Adaptation: A New Frontier in AI [Dr. Jonas Hübotter]The scientist who coined retrieval augmented generationThe Gap Between Humans and Machines Is   [Dr. Max Bartolo]AI Coding Is a Slot Machine: Loss Disguised as a Win | Jeremy HowardManhattan Project for AI Safety [Connor Leahy]He Co-Invented the Transformer. Now: Continuous Thought Machines [Llion Jones / Luke Darlow]SchmidhuberedDo AI chatbots behave WEIRDLY?When AI Discovers the Next Transformer — Robert LangeTransformers Need Glasses! [Federico Barbero]AI is stuck in Plato’s Cave (Maxwell Ramstead)29.4% ARC-AGI-2 🤯 (TOP SCORE!) - Jeremy Berman
Machine Learning Street Talk |

Test-Time Adaptation: A New Frontier in AI [Dr. Jonas Hübotter]

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER