Mod Queue: A much better way of handling content caught by the explicit content filter
The advent of community servers and the fact that being a community server means enabling the explicit content filter means that a lot more servers are enabling discord's explicit content filter for all members now.
The problem?
The explicit content filter really sucks.
As with any algorithmic filter applied to images and videos, it's not going to catch everything that's sexually explicit, and more importantly, it's going to catch content that is in no way sexually explicit. This isn't a hypothetical; since enabling the filter in my 5.5k member server a week ago, at least five images have been erroneously filtered that I know about, and others that I don't know about may well have also been filtered. This isn't a unique situation either, as reports have been around for years about the filter catching ridiculous false positives ranging from utterly innocuous art to pictures of people's pets and loaves of bread.
Catching false positives should be expected with any sort of algorithm applied to images. However, it should also come with a way of dealing with a false positive. Currently, server administrators have no way of manually allowing filtered content to get through, meaning that the only option for dealing with false positives is to report them to Discord Help & Support, which is slow and highly impractical given the volume of false positives that exist.
The solution?
Introduce a proper modqueue system and give server administrators the ability to manually allow media that violates the explicit content filter.
Warning: Bad photoshop ahead.
Whenever the filter catches an image or video, rather than the upload failing or the embed not displaying, the message would be hidden for all users without Manage Messages permissions in the channel. Additionally, the user who posted it would get a message from Clyde informing them that the message was filtered.
Moderators seeing the message would have the option to either approve the message (posting it at the time the mod approved it while showing the content caught by the filter) or remove it (deleting the message). Removing it would also bring up the pop-up to optionally report the message to discord trust and safety.
Any users in the server with the "manage messages" permission in a channel would get a tab in server settings called "Mod Queue". This would show all filtered messages in channels where the user has manage messages permissions, allowing for easy viewing of them. Messages would be sorted from oldest to newest by default, with options for other ways of sorting them (by channel, by user, by role, etc).
This would also open the door for servers to filter messages into mod queue based on containing banned words, discord invites, etc. This would make moderation of large servers much easier by allowing for potentially problematic messages to be filtered for manual review, rather than making them either instantly seen by everyone on posting or instantly deleted on posting like current bots allow for.
Zaloguj się, aby dodać komentarz.
Komentarze
Komentarze: 0