|Assuming you're using a SOHO Router and when you say, "I need to restart so I can connect again" you mean, recycle the power on the router (ie: unplug it, wait a few seconds, plug it back in and let it reboot) to get it working again, then I would suggest you try updating the firmware on the router. If that doesn't fix the issue, or the firmware is up-to-date, then you can try resetting the router to factory defaults and reconfigure it.|
If that doesn't fix the issue, you should consider replacing the unit.
All the above is assuming this affects all clients equally. If this only affects one client, then you need to troubleshoot that client.
It matters not how straight the gate,
How charged with punishments the scroll,
I am the master of my fate;
I am the captain of my soul.