Channel permissions

Its come to my attention that users can easily bypass permissions that have been placed on them specifically by just leaving and rejoining the server, this seems like a big oversight, as locking specific people that break rules consistently out of certain channels is a good way to keep the server healthy. Could you make it so that those channel permissions stay when they leave?