|An IP Phone usually connects into the back of your router or a Wireless Access Point if the phone is too far from the router. Do you have a router? Some IP phones require Power over Ethernet to power the phone. Does your phone have an external power connection like a power box that plugs into 110? If it does not then you need a router that supports Power over Ethernet (PoE).|
Once you have the phone hooked up then configure the phone with a static IP. Once connected you may need to go into your router and port forward your phones IP through the firewall. At least this is the way the phone I worked with worked. If it is a yahoo phone you may need to call their tech support.
"I also have an magic jack and I am wondering if I need to connect these directly to the pc?"
Yep, one end goes into a USB port and the other end goes into a phone or a wall jack. If you are hooking it to a wall jack, be sure it is dead first. If it is hooked up to a phone company you may do damage to the Magic jack.