Under stand that man. Well, dealing with routers and trying to make them into AP is a pain and you have to remember, making routers into something that they are not really designed for, less you get on that is, can be a hassle. Why recommend to most people, use 1 dedicated router and if you need to extend or add on, use dedicated APs or relay or extender devices to help out. 2 routers trying to do that same thing on the same line is not a good idea in the first place.
As for a switch. I would reconsider using one man. You wouldn't see any drop in rates and would probably help you out. I know I enjoy mine. We Netflix and game and someone works from the home too. I've learned to setup QoS for those devices online at the same time as to give a good balanced bandwidth to those when gaming and online. Switches are good things.