Can't mute mic when streaming in dm/groups

When streaming a game with sound in dm or groups (not servers), when you mute your mic, others can still hear you (mic shows as muted)