Hugging Face
The Future of Natural Language Processing
updated
- Image analysis: Reachy Mini can now look at a photo it just took and describe or reason about it
- Face tracking: keeps eye contact and makes interactions feel much more natural
- Motion fusion: [head wobble while speaking] + [face tracking] + [emotions or dances] can now run simultaneously
- Face recognition: runs locally
- Autonomous behaviors when idle: when nothing happens for a while, the model can decide to trigger context-based behaviors
Questions for the community:
• Earlier versions used flute sounds when playing emotions. This one speaks instead (for example the "olala" at the start is an emotion + voice). It completely changes how I perceive the robot (pet? human? kind alien?). Should we keep a toggle to switch between voice and flute sounds?
• How do the response delays feel to you?
Some limitations:
No memory system yet
No voice recognition yet
Strategy in crowds still unclear: the VAD (voice activity detection) tends to activate too often, and we don’t like the keyword approach
More details about Reachy Mini: huggingface.co/blog/reachy-mini
Install Trackio: pip install trackio
Documentation: huggingface.co/docs/trackio/index
This is the unboxing from the Fraunhofer Institute for Industrial Engineering, which is part of the Fraunhofer Society, one of the largest Applied Research organizations in the world!
Try it yourself: https://abidlabs-openapi2mcp.hf.space/?__theme=dark
We’re living in wild times. The “ChatGPT moment” for robotics might be just around the corner. Help shape an open and accessible future!
30+ hours to build, explore, and push the limits of AI Robotics
90+ cities hosting local hackathons
Team up, connect, and make something incredible
🤗 LeRobot Documentation: huggingface.co/docs/lerobot
We’re living in wild times. The “ChatGPT moment” for robotics might be just around the corner. Help shape an open and accessible future!
30+ hours to build, explore, and push the limits of AI Robotics
90+ cities hosting local hackathons
Team up, connect, and make something incredible
🤗 LeRobot Documentation: huggingface.co/docs/lerobot
=========== Contents of this video ===========
00:00 - Intro to the Agents & MCP Hackathon 2025
15:45 - Hackathon details and resources
26:41 - Sponsor section - Sambanova
32:12 - Sponsor section - LlamaIndex
35:52 - Sponsor section - Mistral AI
41:00 - Ending notes
Slides shared in the video:
- Agents & MCP Hackathon : huggingface.co/spaces/Agents-MCP-Hackathon/README/blob/main/Gradio%20x%20Agents%20x%20MCP%20Hackathon.pdf
- LlamaIndex : figma.com/slides/lilUTlaU13TUPIPJyMtmhn/LlamaIndex-Intro---HuggingFace-x-Gradio-Hackathon?node-id=57005-345
- Mistral AI : docs.google.com/presentation/d/10knomfCdcFqXkhEgrumwz6DiN2sz2ndC4CQP8e0Nxvo/edit?usp=sharing
- Sambanova : docs.google.com/presentation/d/1T77TAHXVNYKGHtGYrxwtwTNYMLj9gPKu/edit?usp=sharing&ouid=106575436392015947743&rtpof=true&sd=true
Don't forget to join the course (it's free): huggingface.co/mcp-course
*QUESTIONS* : Drop your questions here or in the chat: huggingface.co/spaces/mcp-course/README/discussions/5
Welcome to the 🤗 Model Context Protocol (MCP) Course Organization!
The Model Context Protocol (MCP) Course is your comprehensive guide to understanding, using, and building cutting-edge AI applications that leverage external data and tools through the latest MCP standards. This free course is designed to take you from beginner to an informed practitioner in the world of MCP.
MCP Course
🚀 Ready to Join? Enroll in the MCP Course!
Join the Course
🚀 What to Expect from This Course?
In this course, you will:
📖 Study Model Context Protocol in theory, design, and practice.
🧑💻 Learn to use established MCP SDKs and frameworks.
💾 Share your projects and explore applications created by the community.
🏆 Participate in challenges and evaluate your MCP implementations.
🎓 Earn a certificate of completion by completing assignments.
Our goal is to help you understand how MCP works and empower you to build your own AI applications.
📚 Course Structure
The course is composed of:
Foundational Units: Learn MCP concepts in theory.
Use Case Assignments: Apply learned concepts to real-world problems.
Collaborations: Featuring the latest MCP implementations and tools from Hugging Face and its partners.
🛠️ Prerequisites
To be able to follow this course, you should have:
Basic understanding of AI and LLM concepts.
Familiarity with software development principles and API concepts.
Experience with at least one programming language (Python or TypeScript examples will be shown).
If you need to brush up on these, the course page suggests these resources:
LLM Course: will guide you through the basics of using and building with LLMs.
Agents Course: will guide you through building AI agents with LLMs. (Please find the links to these specific courses in the main MCP course materials if needed.)
🤝 Contribute
This course is a living project, and contributions are welcome 🤗!
If you've found a bug or want to improve the course content, please open an issue or a Pull Request in the course's GitHub repository (refer to the course documentation for the specific GitHub link).
If you want to add a full section or a new unit, it's best to open an issue first to discuss your ideas with the team.
❓ Questions?
Please open a community discussion on the org page.
Don't forget to sign up for the course (it's free): huggingface.us17.list-manage.com/subscribe?u=7f57e683fa28b51bfc493d048&id=9ed45a3ef6
- Report: github.com/deepseek-ai/DeepSeek-R1
- Models: huggingface.co/collections/deepseek-ai/deepseek-r1-678e1e131c0169c0bc89728d
In this episode, Regis, Ella, Ilyas and Jeff show you how you can accelerate and scale your Gen AI workloads using the latest Intel AI Accelerators, Gaudi 3 and Xeon CPUs, easily with our open source libraries Optimum Intel, Optimum Habana, TGI Gaudi and more.
Last we show you how you can run your own benchmarks easily using Optimum Benchmark.
Useful resources:
github.com/huggingface/optimum-intel
github.com/huggingface/optimum-habana
github.com/huggingface/tgi-gaudi
huggingface.co/docs/optimum/main/en/intel
huggingface.co/docs/optimum/main/en/habana
Discussed examples:
huggingface.co/blog/intel-starcoder-quantization
huggingface.co/blog/cost-efficient-rag-applications-with-intel
huggingface.co/blog/universal_assisted_generation
huggingface.co/blog/setfit-optimum-intel
With over 1 million public models & datasets, Hugging Face has become the standard platform for AI builders. In this workshop we’ll give you a demo of the latest and greatest features of the enterprise platform that thousands of startups and big companies are using including Uber, Meta, Mistral, Sanofi, Cloudflare, Nutanix,...
We will share a special offer to everyone who are attending the workshop.
Recorded by Jess Moss in October 2024
Tutorial: github.com/huggingface/lerobot/blob/main/examples/10_use_so100.md
More information on SO-100 and bill of materials with links to purchase:
github.com/TheRobotStudio/SO-ARM100
Tutorial from LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.com/invite/s3KuuzsPFb
Next, Sannan Nasir from DigitalOcean demos "1-Click Models", a new AI service available with DigitalOcean GPU Droplets, powered by HUGS and H100 GPUs.
Learn more about HUGS in the blog post: hf.co/blog/hugs
HUGS technical documentation: hf.co/docs/hugs
Get HUGS on AWS: aws.amazon.com/marketplace/pp/prodview-bqy5zfvz3wox6
Get HUGS on DigitalOcean: digitalocean.com/blog/one-click-models-on-do-powered-by-huggingface
Get HUGS with HF Enterprise Hub: huggingface.co/contact/sales?from=hugs
Recorded by Jess Moss in October 2024
Tutorial: github.com/huggingface/lerobot/blob/main/examples/11_use_moss.md
More information on Moss v1 and bill of materials with links to purchase:
github.com/jess-moss/moss-robot-arms
Tutorial from LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.com/invite/s3KuuzsPFb
TD-MPC paper: arxiv.org/abs/2203.04955
FOWM paper (this is what's behind the implementation in the LeRobot library): arxiv.org/abs/2310.16029
LeRobot code: github.com/huggingface/lerobot/blob/main/lerobot/common/policies/tdmpc/modeling_tdmpc.py
Many thanks to Nicklas Hansen et. al. for publishing their research and open sourcing their code.
Chapters:
0:00 - Listing the neural networks we need to train
04:53 - What a training batch item looks like
06:09 - Forward passes and losses
13:41 - Why the latent state representation does not collapse
14:24 - Understanding TD Learning
23:42 - TD learning intuition in real experiments
26:58 - Optimizing the Q network using the TD error
30:34 - Offline vs online data collection and training loop
36:20 - Wrapping up
TD-MPC paper: arxiv.org/abs/2203.04955
Many thanks to Nicklas Hansen et. al. for publishing their research and open sourcing their code.
Chapters:
0:00 - Intro
0:54 - Notation and problem formulation
6:20 - High level summary of MPC
11:15 - Why are we optimizing for a fixed horizon?
16:03 - Generalizing to a formulation for CEM
17:38 - CEM with a physics thought experiment
23:32 - CEM applied to action trajectories
25:30 - Summary
We recorded a video walkthrough fixing a real bug issue in Gradio, all the way up to making a pull request!
In the interest of transparency and the spirit of open-source, we are making the full security report public, and more details for each of these issues can be found in the report: github.com/trailofbits/publications/blob/master/reviews/2024-10-huggingface-gradio-securityreview.pdf
Visit https://gradio.app/ to get started with Gradio 5!
Paper: arxiv.org/abs/2407.05530
Project Page: cfeng16.github.io/this-and-that
Organized by LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.gg/8uHu9JqVnm
Chapters:
0:00 - Introduction
1:53 - Recap on ML for robotics to date
12:55 - Visual generative models
23:50 - Language-gesture conditioning of visual generative models
36:50 - Generated video plans to robot action
53:40 - Conclusion and future work
57:57 - Q & A
Presented by Zipeng Fu in August 2024
zipengfu.github.io
This week:
- HumanPlus: Humanoid Shadowing and Imitation from Humans
Paper: huggingface.co/papers/2406.10454
Project page: humanoid-ai.github.io
- MobileAloha: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation
Paper: huggingface.co/papers/2401.02117
Project page: mobile-aloha.github.io
Organized by LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.com/invite/s3KuuzsPFb
Recorded by Jess Moss in July 2024
Koch v1.1 from Jess Moss is a slight modification of the Koch v1.0 from Alexander Koch to cut the cost and make it easier to assemble. It is fully compatible with a Koch v1.0 robot.
Koch v1.1 github includes the bill of materials to order your robot parts and the CAD models if you want to modify it: github.com/jess-moss/koch-v1-1
Koch v1.0 github: github.com/AlexanderKoch-Koch/low_cost_robot
We are thankful to Alexander Koch for open-sourcing his robot and allowing us to build on top.
Alexander Koch's twitter: https://x.com/alexkoch_ai
Tutorial from LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.com/invite/s3KuuzsPFb
Presented by Moo Jin Kim in July 2024
moojink.com
This week: OpenVLA: An Open-Source Vision-Language-Action Model
Paper: huggingface.co/papers/2406.09246
Project page: openvla.github.io
Organized by LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.com/invite/s3KuuzsPFb
Recorded by Simon Alibert in August 2024
Koch v1.1 from Jess Moss is a slight modification of the Koch v1.0 from Alexander Koch to cut the cost and make it easier to assemble. It is fully compatible with a Koch v1.0 robot.
Koch v1.1 github includes the bill of materials to order your robot parts and the CAD models if you want to modify it: github.com/jess-moss/koch-v1-1
Koch v1.0 github: github.com/AlexanderKoch-Koch/low_cost_robot
We are thankful to Alexander Koch for open-sourcing his robot and allowing us to build on top.
Alexander Koch's twitter: https://x.com/alexkoch_ai
Tutorial from LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.gg/s3KuuzsPFb
Recorded by Simon Alibert in August 2024
Koch v1.1 from Jess Moss is a slight modification of the Koch v1.0 from Alexander Koch to cut the cost and make it easier to assemble. It is fully compatible with a Koch v1.0 robot.
Koch v1.1 github includes the bill of materials to order your robot parts and the CAD models if you want to modify it: github.com/jess-moss/koch-v1-1
Koch v1.0 github: github.com/AlexanderKoch-Koch/low_cost_robot
We are thankful to Alexander Koch for open-sourcing his robot and allowing us to build on top.
Alexander Koch's twitter: https://x.com/alexkoch_ai
Tutorial from LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.gg/s3KuuzsPFb
Presented by Nur Muhammad "Mahi" Shafiullah & Sengjae (Jay) Lee in July 2024
https://mahis.life
sjlee.cc
This week: Behavior Generation with Latent Actions
Paper: huggingface.co/papers/2403.03181
Project page: sjlee.cc/vq-bet
Organized by LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.com/invite/s3KuuzsPFb
LeRobot Tutorial #1
Recorded by Jess Moss in July 2024
Koch v1.1 from Jess Moss is a slight modification of the Koch v1.0 from Alexander Koch to cut the cost and make it easier to assemble. It is fully compatible with a Koch v1.0 robot.
Koch v1.1 github includes the bill of materials to order your robot parts and the CAD models if you want to modify it: github.com/jess-moss/koch-v1-1
Koch v1.0 github: github.com/AlexanderKoch-Koch/low_cost_robot
We are thankful to Alexander Koch for open-sourcing his robot and allowing us to build on top.
Alexander Koch's twitter: https://x.com/alexkoch_ai
Tutorial from LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.com/invite/s3KuuzsPFb
Recorded by Remi Cadene in August 2024
Koch v1.1 from Jess Moss is a slight modification of the Koch v1.0 from Alexander Koch to cut the cost and make it easier to assemble. It is fully compatible with a Koch v1.0 robot.
Koch v1.1 github includes the bill of materials to order your robot parts and the CAD models if you want to modify it: github.com/jess-moss/koch-v1-1
Koch v1.0 github: github.com/AlexanderKoch-Koch/low_cost_robot
We are thankful to Alexander Koch for open-sourcing his robot and allowing us to build on top.
Alexander Koch's twitter: https://x.com/alexkoch_ai
Tutorial from LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.gg/s3KuuzsPFb
Recorded by Remi Cadene in August 2024
Koch v1.1 from Jess Moss is a slight modification of the Koch v1.0 from Alexander Koch to cut the cost and make it easier to assemble. It is fully compatible with a Koch v1.0 robot.
Koch v1.1 github includes the bill of materials to order your robot parts and the CAD models if you want to modify it: github.com/jess-moss/koch-v1-1
Koch v1.0 github: github.com/AlexanderKoch-Koch/low_cost_robot
We are thankful to Alexander Koch for open-sourcing his robot and allowing us to build on top.
Alexander Koch's twitter: https://x.com/alexkoch_ai
Tutorial from LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.gg/s3KuuzsPFb
Presented by Nicklas Hansen in June 2024
nicklashansen.com
This week: Temporal Difference Learning for Model Predictive Control
Paper: huggingface.co/papers/2203.04955
Paper: huggingface.co/papers/2310.16828
Project page: nicklashansen.com/td-mpc
Project page: tdmpc2.com
Organized by LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.com/invite/s3KuuzsPFb
Presented by Cheng Chi in April 2024
cheng-chi.github.io
This week: Diffusion Policy
Paper: huggingface.co/papers/2303.04137
Project page: https://diffusion-policy.cs.columbia.edu
Organized by LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.com/invite/s3KuuzsPFb
Presented by Alexander Soare in April 2024
This week: ALOHA and ACT
Paper: huggingface.co/papers/2304.13705
Project page: tonyzhaozh.github.io/aloha
Organized by LeRobot's team at HuggingFace.
Github: github.com/huggingface/lerobot
Twitter: https://x.com/LeRobotHF
Discord: discord.com/invite/s3KuuzsPFb
The application will be free to build and take less than 5 minutes and 100 lines of code!
We will build a Compliment Bot - users upload a photo of themselves or their friends and the bot will say something nice about them! The AI models used in this space will be running on Hugging Face's innovative ZeroGPU cluster - a serverless cluster of A100s that is FREE to use. We'll leverage these spaces in our application using the Gradio javascript client. That way, we can bring AI into our applications instantly without having to host or train anything ourselves.
Resources:
1 - Final App and Code: huggingface.co/spaces/freddyaboulton/compliment-bot-static
2 - SD3 Long Captioner Space: huggingface.co/spaces/gokaygokay/SD3-Long-Captioner
3 - huggingface.co/spaces/hysts/zephyr-7b
4- Blog post going into more depth: details:freddyboulton.com/blog/building-with-zero-gpu
We'll be using Llama.cpp's python bindings to run the LLM on our machine and Gradio to build the webpage.
Resources mentioned in the video:
* Llama.cpp python: github.com/abetlen/llama-cpp-python
* Gradio: github.com/gradio-app/gradio
* Qwen-2 0.5B Instruct Model (GGUF): huggingface.co/Qwen/Qwen2-0.5B-Instruct-GGUF
* Llama.cpp's chat completion API: github.com/abetlen/llama-cpp-python?tab=readme-ov-file#chat-completion
* Gradio Chatbot Guide: https://www.gradio.app/guides/creating-a-chatbot-fast


