The ability to "Whisper" mid-voice chat

Let's be honest, it's super chaotic to have a bunch of people in a single voice channel. One option people have for private conversations is PMing each other or hopping to a separate voice channel temporarily.

What if there was an option to focus chat on one or more people, which will lower the selected parties' volumes to everyone else to almost a whisper, while to you and the selected party, the audio of everyone else is dimmed and you can focus while still being able to hear the rest of the group without disrupting anything. I understand you can lower the volume of individuals, but that gets tedious to lower and raise everyone, then normalize it, especially if there's a TON of people in a channel.

tl;dr I want to talk to my friends in the same channel as others, without disrupting anything, if I want to have a side conversation.