Activity Status-Friends Only Toggle?

I think it'd be really great if there was a toggle that let you have your activity status only be visible to friended users. Sometimes you don't want people in a specific server to see what you're listening to on Spotify but you want to have it there so your friends can join your listening or something. I like being able to share what I'm doing but I don't want to share it with everyone.