Mute self by default at guild level?

On certain Discord servers it would be preferable to open a chat channel muted by default or having the 'push to talk' option defined at the guild level. I didn't see a way to do this.

This is coming from the fact that a few times I found myself with the mic open, when I had just been listening into the channel, not intending to talk right away.