Invisible AFK voice channel BUG (Problem)

I set it up a invisible AFK voice channel, the member's can't see the voice channel unless they stay AFK for 15 minutes. But once they are in the AFK voice channel, they can't get back to the channel they were. I mean, they are sent to afk channel and then when they click on other channel, simply doesn't work. They just need to disconnect and re-connect in order to solve the "bug". Anyone who has this problem and maybe know how to fix it?