Push to Talk activation noise playing out of wrong device

I have Discord set up to output to a secondary sound device so that I can record game audio without voice chat.    Despite having this second device selected as Discord's output device, it plays push to talk activations and other sound effects out of the Windows primary sound device, and not the device I selected in Discord.