|Pings use the ICMP protocol and doesn't use ports like TCP or UDP.|
You could block all ICMP packets and that would certainly take care of it. It is possible to block only pings, but the way to do that depends on your firewall.
For example, iptables would be
... -p icmp --icmp-type echo-request -j DROP