Art from the MachineI am working on a Skyrim mod which allows for conversations with NPCs via ChatGPT, xVASynth (text-to-speech), and Whisper (speech-to-text). This update introduces Skyrim scripting, which allows for lip syncing of voices and NPC awareness of in-game events.
0:00 Intro 1:16 Feature Showcase 2:20 Conversation Snippets 5:52 Outro
ChatGPT in Skyrim VR | Mantella - Lip Sync & In-Game Awareness UpdateArt from the Machine2023-04-25 | I am working on a Skyrim mod which allows for conversations with NPCs via ChatGPT, xVASynth (text-to-speech), and Whisper (speech-to-text). This update introduces Skyrim scripting, which allows for lip syncing of voices and NPC awareness of in-game events.
0:00 Intro 1:16 Feature Showcase 2:20 Conversation Snippets 5:52 OutroAI NPCs in Fallout 4 | Mantella Release TrailerArt from the Machine2024-04-05 | Download Mantella from Nexus Mods: nexusmods.com/fallout4/mods/79747
Bring Fallout 4 NPCs to life with Mantella. Mantella lets you talk to over 600 NPCs in Fallout 4, each with their own unique backgrounds and memories. Convince NPCs to follow you, or aggro them to attack you. Talk to NPCs one on one or in a group. NPCs can also start conversations with each other.
Talk to over 1,000 NPCs in Skyrim using the latest AI technologies. Mantella allows you to have natural conversations with NPCs using your voice by leveraging Whisper for speech-to-text, ChatGPT for text generation, and xVASynth for text-to-speech. NPCs also have memories of your previous conversations and have awareness of in-game events.
Discord: discord.gg/Q4BJAdtGUEMantella (ChatGPT AI in Skyrim VR) - Improved Voices & Long-Term Memory UpdateArt from the Machine2023-06-18 | Mantella is a Skyrim mod which allows for conversations with NPCs via ChatGPT, xVASynth v3 (text-to-speech), and Whisper (speech-to-text).
Now that responses have been reduced from ~15 to ~5 seconds, this video intends to give a better idea of what conversations look like without cutting and editing. The improved memory system is also demonstrated in this video, so conversations here make references to the previous two videos I have posted. And finally, all NPCs in this video (not including flashbacks) are using the improved xVASynth v3 for text-to-speech.
I am planning to release an early version of the mod via Discord, so if you are interested in taking part or want to stay updated then please find the link below:
Chapters 0:00 Intro 3:56 Farengar 5:50 Danica 10:04 Ysolda 11:59 Jon 13:51 OutroTalking to NPCs in Skyrim VR with ChatGPT and xVASynthArt from the Machine2023-03-26 | I am working on a Python script which allows conversations with Skyrim NPCs via ChatGPT and xVASynth.
Once the script is running, any named vanilla NPC can be loaded by saying "Hello" + NPC name. The relevant voice model is then assigned. The character's background description and any previous conversations with the player are also loaded into memory.
0:00 Intro 0:54 Talk to any NPC 1:11 NPCs know their background 1:28 NPCs remember you 1:48 Conversation examples 3:41 OutroSkyrim VR is a Coziness Simulator | Waiting for a Storm to Pass in VRArt from the Machine2023-03-13 | Spending a relaxed day inside Riverside Lodge. Skyrim VR with the Librum modpackWhat Skyrim in Deep Dream Looks LikeArt from the Machine2023-02-24 | Deep Dream in Skyrim using Pytorch Headtrip