Justin Searls | Searls After Dark #9 - Real-time Chat with Turbo Streams @JustinSearls | Uploaded April 2023 | Updated October 2024, 3 hours ago.
It's a big one! We're blowing up how we hit OpenAI's API from a traditional blocking HTTP request/response to an async streaming API that simulates a typing effect in real-time as GPT-4 thinks of what to say.
Ep 8: youtu.be/rsvNC2eQhkg
Ep 10: youtu.be/Z5oWy9PKpAc
Season 1: youtube.com/playlist?list=PLIuJbrOVyGjkRj7UM_whr-CPoqcXTOsZa
Doing this requires all kinds of Ruby & Rails ingredients, like:
• net/http's `response.read_body {}` method, for handling streaming HTTP responses via SSE (server-sent events)
• Turbo Stream to render only the contents of the message on the page as it's arrives
• Itoen Oolong and Nikka whiskey
• ActiveJob to break out of the user's web HTTP request/response dispatch thread and make the streaming HTTP request to Open AI
I'm going to be traveling to RailsConf in Atlanta and RubyKaigi in Japan over the next 4-5 weeks, so this may be the last time I see after dark you until June.
Until then, stay in touch! ✉️ lets@playstupid.games
It's a big one! We're blowing up how we hit OpenAI's API from a traditional blocking HTTP request/response to an async streaming API that simulates a typing effect in real-time as GPT-4 thinks of what to say.
Ep 8: youtu.be/rsvNC2eQhkg
Ep 10: youtu.be/Z5oWy9PKpAc
Season 1: youtube.com/playlist?list=PLIuJbrOVyGjkRj7UM_whr-CPoqcXTOsZa
Doing this requires all kinds of Ruby & Rails ingredients, like:
• net/http's `response.read_body {}` method, for handling streaming HTTP responses via SSE (server-sent events)
• Turbo Stream to render only the contents of the message on the page as it's arrives
• Itoen Oolong and Nikka whiskey
• ActiveJob to break out of the user's web HTTP request/response dispatch thread and make the streaming HTTP request to Open AI
I'm going to be traveling to RailsConf in Atlanta and RubyKaigi in Japan over the next 4-5 weeks, so this may be the last time I see after dark you until June.
Until then, stay in touch! ✉️ lets@playstupid.games
