Separate sound output for users who don't want their voice streamed

I used to stream a lot, however recently I have begun talking with people who do not want their voice streamed. It would be greatly beneficial if there was some way for Discord to ask them if they want their voice to be streamed and separate it out into an audio track that only I can hear and allow everyone else to be heard on the stream.

While it is easy to say "don't talk to them then", I think that's very exclusive and I wish to include them. Something similar has already been in PS4 since the beginning, where users can opt-out of being included in recordings and streams, and this is sorely missed on PC.