|I've played on TF2 myself. And Miller is right.|
To make the best of it, try connecting to a server that is hosted in your country.
Or the closest you can.
If you're in the UK, look for UK servers.
Although it could be due to someone downloading from your internet connection,
Or Applications in the background downloading updates,
Or their server could just struggle to handle the amount of players.