Split incoming voice feed by Users for streaming

Not sure if this is already possible, it would be nice to be able to isolate the feed coming in from certain Users in the same VOIP channel so that I can hear it through my headset but I can filter them out on the OBS studio.

This is because there are times when our server has many people on the same VOIP channel but playing different games. I would like to hear them in VOIP still but would not want them to be recorded in the stream.