Usually a headphone has 2 pins(3.5 mm jack). More often they are of different colours, ie., Green (for the speakers) and Red (for the microphone). Check weather you have connected to the respective audio ports.
Even after if you face the same issue, check with the headphone by connecting it to a different Machine.
Thank You :-)