|It is not the CPU making the noise as CPU is just a silicone chip.|
This is a CPU:
If you are referring the case containing the whole computer then it is expected to hear fan noise. Most computers have at least two fans, sometime three or more. The biggest fan is the one that sits on top of the CPU and another one in the power supply.