I become super quiet when joining a friends stream in a server

So my friend likes to stream their SAI program sometimes in our server, and when I join the stream, I suddenly become super quiet. I have no idea why this is happening, any help would be necessary.