Members get invisible names

Hello,

When people subscribe to my Twitch channel they automatically get the Twitch Sub role in my server.
I also use role categories that I assign to them. (see screenshot) The role categories are separate roles.

When people aren't subscribed anymore to my Twitch channel they lose the Twitch subscriber role in Discord which is good but the problem is that they don't lose the category role that I manually assigned to them when they were subscribed.
(see screenshot)

That causes their name to become invisible. Because they get the color of the category role that's now on top of all other roles. (see screenshot)

My question is, is it possible to automatically remove the category role when people lose their subscription to my Twitch channel, so their name doesn't become invisible in Discord?