High ping in vc late at night

I've been experiencing high ping from around 8-10pm on the weekend including friday sometimes. I live in lesser poland and this has been going on for around 2 months or so now. I havent been able to understand friends or watch a stream without them cutting out or the stream freezing, but my friends on the other hand hear me well and dont hear me in a robotic voice or cutting out. Also my internet during these times are fine, by that I mean i can watch a 4k video on yt without issues but discord will still say I have 5000ms (I am aware that robotic voices can be caused by high packet loss on discord but it says i have none so thats cool :') ). I've read other posts about this kind of stuff but their all 3+ years old and all the things they say to try dont work. If anyone knows how to fix this please help me out thx.