See Connected Users Permission (Voice)

Add a Permission to Voice Channels which allows you to see current connected users, if you are connected to the channel you can see the Current Users but if you disconnect you can't see them.