Remember read/unread state of channels without view permission

I use a bot in my server to show and hide specific text channels based on what voice channel a user is in. This is so users can have a text chat channel specifically for their current voice chat group (sending URL links, pics, etc).

This is done by the bot adding and removing a role that has view text channel permissions.

This has the annoying side effect of making these special channels appear highlighted and unread (almost) whenever they gain access to that channel, even if they had read those messages before.