Add options to Server Mute/Deafen when they aren't in a voice channel (or at least unmute/undeafen)

Often times I find myself server muting people as a temporary thing before punishing them elsewhere, and when they leave the voice channel before I get a chance to server unmute them, making it so I can't unmute them. I'm asking if you can make it so you can change it so they don't have to be in a voice channel to do this action.

Thanks :)