Listen Along with Spotify isn't Syncing

So, I'm listening along to Spotify with my friend, and the timestamps aren't the same for both of us. I.E. They're on 1:27 and I'm listening to 1:38. The timestamps of the songs aren't syncing, and i suspect this is because since the feature isn't hugely popular, the issue has never had light shed upon it. Thank you.