|I don't think all 4 ports are connected to ONE USB controller. More likely TWO controllers.|
Do you have an internal card reader? If so, that may be a THIRD port on the same controller as #3 USB port. USB controllers do have a finite amount of current that can be used so perhaps the controller is being overloaded.
Perhaps there is something wrong with the flash drive in question.