|Ensure either LLDP, SSDP or Samba are enabled on all machines. I can't remember which but try Samba first.|
How is the wireless router configured? Gateway mode or is it functioning as a NAT device?
Post the output of ifconfig -a from your iMAC and ipconfig /all from one of your Windows machines.