Suggestion: Active Caption Overlay

This is something that I've been looking into doing for streaming purposes.

So you're streaming on Twitch and you have an active caption addon run as you stream so everyone can enjoy your content, but the way it works is by using the sound of just your microphone. this is fine if you're streaming alone, however the same can't be said for if you have a friend in call with you. Suddenly, your stream captions are displaying an oddly one sided conversation and some folks are left in total confusion as to what is going on and what the other party might be saying.

Looking into this issue, I haven't found many solutions to this, and while I'm still looking for options, I thought I may bring this up here to hopefully inspire some ideas on how this could be done or maybe even let folks who know how to do this find me and make this information more accessible.

I'm not a program, but I feel as though I might have a good idea in how it can be done, assuming my wild assumptions could be right, that being that it might be possible to use Discord Overlay to possibly listen to individual mic feeds and actively caption them. I can understand if it doesn't work like that, but I'd at the very least like to put this idea out there and see if someone can get that ball rolling.


This Idea doesn't have to be used just for streaming, but most certainly it can be used to make online interaction that much more inviting to folks. I hope my ramblings here can inspire some action or maybe spread awareness to some good methods of doing just that. Thank you for reading and I hope you're having a nice day!