Reddit mentions of 4x4 4:4 HDMI HDTV MATRIX CROSSPOINT ROUTING SWITCHER SELECTOR 3D EDID MANAGER

http://www.amazon.com/4x4-CROSSPOINT-ROUTING-SWITCHER-SELECTOR/dp/B00N9JH840/ref=pd_sim_23_2?ie=UTF8&dpID=41JikD1peYL&dpSrc=sims&preST=_AC_UL160_SR160%2C160_&refRID=0AZPJP7Z83QZ3AHQNVF9

You want this. You dont have to go with this exact one, but its going to be your most reliable matrix switcher you find under $600.

Basically, this would give you 4 inputs and 4 outputs. Your inputs would be, say, chromecast, cable TV, and 2 laptops. Your outputs would be AVR 1, 2 and 3 with each rooms respective display plugged into any HDMI input of your choice on the receiver. Wire the receiver up as you normally would, with the exception of the HDMI sources you would normally plug into your receiver....the matrix switcher handles that now(as previously explained).

Like he said, the easiest remote control(and cheapest) is the harmony remote.

You can put 8x4 matrix switchers(8 inputs, 4 outputs) and beyond, they just get very pricey.

This is my setup, hardwired for audio/video only. You still have to figure out your keyboard/mouse, I like an RF or Bluetooth remote control.

I have a 4x4 HDMI Matrix with 4 inputs and 4 outputs. This allows me to send one of 4 sources (Computer, Xbox, Off Air Tuner, RetroPi) to any of my TVs.

It can also split a single HDMI source, and send it to four TVs at the same time. (If you don't care about multiple sources, the same effect can be achieved with a powered 4-way HDMI splutter). I then use HDMI over Ethernet extenders to bedrooms and office.

I added another TV, so now I have the HDMI matrix feeding an HDMI splitter, which feeds two sets of HDMI extenders. 5 TVs with the same source.

For gaming, I also have a DVI connection straight from PC to my TV, bypassing the HDMI devices to avoid any latency.