For example, you have 5 separate parties. Each party should have a separate voice channel so they can talk between themselves. Then there can be a special push-to-talk button for everyone in those 5 parties to hear within those 5 voice channels.
This will help a lot in raids, and honestly, it'll just make Discord all the more shiny to gamers. Push to talk priority button is a good start, but it's not enough.