Streaming audio from application.

When I am streaming certain apps/games with my friends, I want them to hear the game but I want it silent for me. However If I mute it in the audio mixer, It is muted for my friends. The audio mixer only controls your local audio output so why would this effect the stream in any way if the stream is pulling the audio directly from the source application instead of my audio output?