Remove Server Icon Jumps to Right

Hi there, I recently noticed that—given there isn't much text in the translation/you're using English (US)—when removing the server icon, the text block jumps to the right. This is Not a Bug, according to people I've spoken with on DTesters, as this is a translation precaution "minimum size". This doesn't look that good though, so I'd definitely want a fix to this! (Read again, this is apparently intended, so this is a feature request). (Swedish: https://i.imgur.com/1P0Hw0e.gif & English: https://i.imgur.com/zuBwdgC.gif)