Block server invites from friends

Hi, I know theres a way to block your server from invites and all, but I wish there was also an option to make your friends unable to drag you into a server, because it automatically plops me in that server then. I can not find any setting for this.