Reddit mentions of Lutron, White Caseta Wireless Pico Wall-Mounting Kit, PJ2-WALL-WH-L01, 1 pack

I use a combination of lutron caseta and TP-Link smart switches. The remote is called a peco remote. It doesn't look like your typical toggle switch though.
https://www.amazon.com/Lutron-PJ2-WALL-WH-L01-Remote-Control-Mounting/dp/B00JR202JQ/ref=sr_1_4?ie=UTF8&qid=1506434287&sr=8-4&keywords=pico+remote

By regular, you mean the small “toggle” switch instead of the large flat “decora” switch? You can find some switch plates that mix and match between the styles but I’m not sure if you’d find one decora flanked by two toggle. You could always switch the toggles to decora as well to get a uniform look. Alternately, since you’re hard wiring the one you’re replacing with the pico you could push it to one side so it was toggle-toggle-decora like this one

The pico itself and its wall mount can go anywhere you put a decora. Hell, since you’re not hooking it to power you could put it anywhere you want! Here is a pico/wall mount bundle (though it’s actually $5 cheaper to buy them separately since you wouldn’t use the wall plate in this bundle in favor of the combo one above.)

Caseta does require a hub called smart bridge pro to integrate with HA, as it speaks its own proprietary wireless protocol. The “pro” part is important, a normal bridge won’t report the pico button presses you need to listen for. You can find them around $70 on eBay. A better deal, if you want/need a dimmer to use elsewhere in the house, is this starter kit (note the pro bridge) that you can find for $110-130 as the dimmer runs $50. The msrp for this is about $200 (and it’s seldom on amazon)

Lmk if you go this route and I can send you a config snippet to translate the pico presses to turn off/dim/change color on hue lights. It also requires a custom component that you use instead of the built in one (though there’s been talk of merging them). It’s super simple, you just grab it and drop it in the custom component directory.

I did this exactly in my backyard. I threw one of the more expensive Caseta dimmers INSIDE a weatherproof box outside and hard wired my patio lights into the junction box. It could have just as easily been the cheaper dimmer or the regular 6A switch and not the dimmer and it would have worked just as well. I spent a little more on the more expensive dimmer because the load was so low with the patio lights (20w total) that I didn't want any flickering or weirdness. I hardwired only because I didn't NEED a dimmable outlet, but you could also just as easily put a receptacle after the dimmer/switch.

​

I say all that just to let you know what you are asking for is entirely doable, like cduff77 mentioned, just get the plug-in dimmer, tie off the wall switch so it's always on and replace it with a wall mounted pico pemote. The whole thing will run you about $75 but it is well worth it.

​

Lutron hit it out of the PARK with Caseta, it's the most reliable smart device I have, and I have a ton (Ring Doorbell, August Lock, Philip's Hue, EcoBee Thermostat). All they need is to come out with a multi-speed fan controller and a couple of smart outlets (Controllable with Picos, just like you want) and they will own the game.

You can use the Lutron Caseta for 3 way switches or more. Install the full Lutron Caseta switch in one box, and use remotes for the other boxes. You can put another switch anywhere, even if there isn't wiring there.

Lutron Caseta Wireless In-Wall Dimmer, 600/150-Watt, Single Pole, Works with Amazon Alexa https://www.amazon.com/dp/B00KLAXFQA/ref=cm_sw_r_cp_apa_BazDyb4YRKZ8B

Remote with wall bracket
Lutron PJ2-WALL-WH-L01 Pico Remote Control with Wall Mounting Kit, White https://www.amazon.com/dp/B00JR202JQ/ref=cm_sw_r_cp_apa_ObzDybQ8C594T

You need the hub as well

Hub, 1 switch, and 1 remote
Lutron P-BDG-PKG1W Caseta Wireless Dimmer Kit with Smart Bridge for Amazon Alexa and Selected Models, White https://www.amazon.com/dp/B00MXCRAX8/ref=cm_sw_r_cp_apa_kdzDybXVZ4ZGM

They sell the wall brackets seperate as well
Lutron PICO-WBX-ADAPT Pico Wallplate Bracket https://www.amazon.com/dp/B00JZRAFEA/ref=cm_sw_r_cp_apa_nfzDybQX74B01

Basically you can get a 2way solution for $100, and add a 3rd switch for $20