Allow users to disable Server Discovery

I personally am not interested in joining any server with 50K-400K+ members even if it is relevant to my interests, and I know I can't be the only one. For me it just takes up space in the sidebar and it's especially annoying to think I've been pinged only to find out that no, it's just an addition to the verified servers that I'm never going to join anyways. I think we should be able to toggle the button like we can toggle the Activity Feed.