Why can I only direct-message people on my friends list?

I wanted to start a private conversation with a couple people on a server so as not to flood the channels without our side talk. But Discord only shows me people on my friends list to do this with. I don't need these people to be on my friends list, I just want to direct-message them both. There is no good reason to require me to clutter my friends list to do this.