If you're connecting to your router via Wi-Fi, then maybe it's just your computer that's getting disconnected from the router. Your router is still connected to the Internet.