Deny Group Chat Button

My friends have a eager response to invite me to group chats rather than talking in a discord server. I would like the option to deny/reject group chats. It clutters my dms pretty fast and starts to look disgusting especially when people constantly leave the group chats.