Try having more that 40-50 devices connected to your home router and you will see devices disconnecting randomly because your router can't keep up with them.
I have more than that on my ordinary consumer router and have never seen a problem. Worst case, it'd be straightforward to dedicate a Wi-Fi router to your smart devices in the same way that you have a hub (and possibly repeaters) for your Zigbee devices.
