Bart Slodyczka | Part 2: How to Build an AI Voice Agent using OpenAI Realtime API: RAG + Function Calling @BartSlodyczka | Uploaded October 2024 | Updated October 2024, 3 hours ago.
Part 2: Upgrading the OpenAI Realtime API Voice Agent
In this tutorial, we enhance our original Voice Agent with:
- RAG (Retrieval-Augmented Generation)
- Function calling
- Caller history
- AI answering the phone first
Watch till the end for valuable insights and unique implementation techniques!
📋 Take This Quick Survey: https://forms.gle/otAr1xUamgyYZE5y7
🛠️ Need this built? Contact: bart@supportlaunchpad.com
🗂️ GitHub Repo: github.com/Barty-Bart/openai-realtime-api-voice-assistant-V2
📺 Watch Part 1: youtu.be/AZ0WziqO_QA?si=H9iNho3yMS6CrVvu
👉 LinkedIn: linkedin.com/in/bartlomiejslodyczka
Learn AI & Coding:
Try Scrimba's AI Engineer course (20% off Pro plan with my link):
v2.scrimba.com/the-ai-engineer-path-c02v?via=BartSlodyczka
Other related videos: youtu.be/ojV5_IKylEM
#openai #realtimeapi #maketutorial #replit
Note: Affiliate links support this channel through commissions.
Timestamps
00:00 Realtime API Call Demo
01:08 Overview Of The Build
5:15 Breakdown of Code And Make.com Automation
08:28 How Twilio API Works
13:48 Main Configuration And Function Calls
16:00 (WATCH THIS) How To Make AI Speak First
18:57 Function Call Breakdown
26:35 Setting Up Replit With Our Code
28:45 Testing Replit And Connecting To Twilio
30:25 Deploying Replit
33:05 Outro
Part 2: Upgrading the OpenAI Realtime API Voice Agent
In this tutorial, we enhance our original Voice Agent with:
- RAG (Retrieval-Augmented Generation)
- Function calling
- Caller history
- AI answering the phone first
Watch till the end for valuable insights and unique implementation techniques!
📋 Take This Quick Survey: https://forms.gle/otAr1xUamgyYZE5y7
🛠️ Need this built? Contact: bart@supportlaunchpad.com
🗂️ GitHub Repo: github.com/Barty-Bart/openai-realtime-api-voice-assistant-V2
📺 Watch Part 1: youtu.be/AZ0WziqO_QA?si=H9iNho3yMS6CrVvu
👉 LinkedIn: linkedin.com/in/bartlomiejslodyczka
Learn AI & Coding:
Try Scrimba's AI Engineer course (20% off Pro plan with my link):
v2.scrimba.com/the-ai-engineer-path-c02v?via=BartSlodyczka
Other related videos: youtu.be/ojV5_IKylEM
#openai #realtimeapi #maketutorial #replit
Note: Affiliate links support this channel through commissions.
Timestamps
00:00 Realtime API Call Demo
01:08 Overview Of The Build
5:15 Breakdown of Code And Make.com Automation
08:28 How Twilio API Works
13:48 Main Configuration And Function Calls
16:00 (WATCH THIS) How To Make AI Speak First
18:57 Function Call Breakdown
26:35 Setting Up Replit With Our Code
28:45 Testing Replit And Connecting To Twilio
30:25 Deploying Replit
33:05 Outro
