You can no see people who are in private chats.

Is there a way to hide that you are in chat? On my server members can now see that I am in a voice chat even though they can't see the voice chat itself because it is set to private. Is there a way to make it so if they can't see the chat then they can't see that I am in chat?