Uploaded April 2026 | Updated November 2026, 11 hours ago
In this video, we walk through a multi-agent setup of AutoResearch using open source models and OpenCode.
Timestamps
00:00 - Introduction: Multi-agent AutoResearch setup
01:07 - Agent Roles: Researcher, Planner, Worker, and Reporter agents
01:55 - Repository Setup: Exploring the repo structure and files
02:11 - Environment Configuration: Python setup, UVSync, HF Hub login
03:20 - OpenCode Interface: UI walkthrough and agent configuration
03:51 - Running the Experiment: Autonomous research pass execution
05:17 - Sub-agents in Action: Planner and Reviewer agent collaboration
07:08 - Trackio Metrics: Tracking training efficiency and job monitoring
08:23 - Hugging Face Hub: Jobs running on HF infrastructure
08:58 - Conclusion: Try it yourself with OpenCode
Links:
Repo: github.com/burtenshaw/multiautoresearch
Twitter post with learnings: https://x.com/ben_burtenshaw/status/2045085809800356112
In this video, we walk through a multi-agent setup of AutoResearch using open source models and OpenCode.
Timestamps
00:00 - Introduction: Multi-agent AutoResearch setup
01:07 - Agent Roles: Researcher, Planner, Worker, and Reporter agents
01:55 - Repository Setup: Exploring the repo structure and files
02:11 - Environment Configuration: Python setup, UVSync, HF Hub login
03:20 - OpenCode Interface: UI walkthrough and agent configuration
03:51 - Running the Experiment: Autonomous research pass execution
05:17 - Sub-agents in Action: Planner and Reviewer agent collaboration
07:08 - Trackio Metrics: Tracking training efficiency and job monitoring
08:23 - Hugging Face Hub: Jobs running on HF infrastructure
08:58 - Conclusion: Try it yourself with OpenCode
Links:
Repo: github.com/burtenshaw/multiautoresearch
Twitter post with learnings: https://x.com/ben_burtenshaw/status/2045085809800356112









![[Monday evening short video] Summary of two new amazing LLM benchmarking papers: GAIA and GPQA
Sharing a summary of two amazing LLM benchmarking papers published just last week:
- GAIA: the General AI Assistant benchmark (disclaimer: Im a co-author with amazing co-authors)
- GPQA: the Graduate Level Google Proof QA benchmark (disclaimer: the authors are also awesome)
When two teams (covering a diverse range of actors like Anthropic, Cohere, New-York University, Hugging Face, Meta AI) independently come up with benchmarks that share so many aspects (while being really different in goals and approaches), you know the future of LLM benchmarking is basically changing under your eyes.
Both are super difficult with ~30% GPT4 success rate, both are small (450 questions) and carefully hand-crafted question by question, with a single gold answer and a strong interest for the reasoning it-self rather than memorization capabilities. Both very challenging test bed for coming models capabilities
And above all: Im super excited that these are open-source benchmark giving us common ground for comparison of the coming frontier models. On to the future (of open evaluation)!
Papers and more information:
- GAIA: https://huggingface.co/papers/2311.12983
- GPQA: https://huggingface.co/papers/2311.12022 [Monday evening short video] Summary of two new amazing LLM benchmarking papers: GAIA and GPQA](https://i.ytimg.com/vi/e4jOGywUCc4/mqdefault.jpg)
