Push to Talk (PTT) configuration

Is it possible to set discord so that there is no requirement to PTT to talk to a specific individual.

I play online games along with my wife, who is sat in the next room. It would be advantages if we did not need to PTT and essentially have a private conversation over discord, but still need to use PTT to communicate with the rest of the group.