You can probably use a program like pingplotter to check where the connection breaks up between you and the Server.
I think I had similar issue with the World of Tanks servers, random 900 ping and then back to 30 ping.
Took me a billion tickets with wot support and my isp before it got resolved.