Text-To-Skyrim: The Babysitters Guild [Twitch TTS Mod]

Participate and watch LIVE:   / blurbs   24/7 channel LIVE NOW:   / blurbsalwayson   ALL EPISODES:    • Text-To-Skyrim   VODS:    / @blurbsvods   Discord:   / discord   TikTok:   / blurbstv   Twitter:   / blurbstv   Instagram:   / blurbsttv   HOW THIS WAS MADE: So many people asked if this mod will be available publicly, and honestly I'm not sure. It's not a single "mod", but rather multiple programs running in tandem for it to function properly. Additionally, the code is not only spaghetti, but specific to my information. I will however give as many resources as I can for those of you wanting to attempt this. This works using a mod I created in Skyrim that sends and receives instructions to a node JS server running locally on my machine. The server reads Twitch chat, and when told by Skyrim dialogue is needed, reaches out to ElevenLabs to generate .wav files. Using this audio, the program listed below is run to generate .lip files needed for lip movement. After creating a dummy Topic with placeholder voice lines in the Creation Kit, the server hotswaps the new audio/lip files over the existing ones, giving the illusion of a complex dialogue system. Enjoy the memes! Sources: I used SkyrimPlatform to code the plugin in Typescript (personal preference) https://www.nexusmods.com/skyrimspeci... Program to generate .lip files: https://github.com/Haurrus/FaceFXWrapper Plugin to inject subtitles into Skyrim: https://github.com/swwu/Mantella-Subt... Script extender: https://github.com/skyrim-platform/po... How to convert buffer to .wav blob (gotta do further steps to actually write that to disk however): https://stackoverflow.com/questions/2...