Set a server specific local avatar for your user profile?

I have an idea about making users be able to set their own local avatar image to be used in just one server while not apply it to the rest of the other server.

Admin and mods of one server can choose to remove the local avatar of one particular user. And set whether their users can use a local avatar in the server or not in place of their default global one.