I think Rustdesk for me as well. My main computer is a Windows laptop, but I use a few Linux laptops around the house to control it and others with Rustdesk. Alt+Tab works on the remote system in Gnome Classic (I think that's what it's called - says X11) but on the other options it performs switches locally only. Tested on Debian and Fedora.
Maybe it's worth keeping a budget mobile phone at home with Rustdesk host running on it? When you have a need for an app that must run on a genuine Android, you just remote into that phone. Since the phone never leaves home, there's less to track.
My $350AU (~$200US) Motorola G84 has been near perfect for the price. Only the camera sucks a bit, and Facebook Messenger notifications are unreliable; but it shits all over the A20.A30 I had before. Of course, Motorola is a gamble itself though - for example with this phone, you can't use the camera if you're connected to 5G on some networks, and they won't fix it.
I have to do it just walking around the house. If I'm not in the room for a minute and suddenly appear my wife gets scared. I'm not intentionally quiet, but I walk gently most of the time. I've joked that I need to get a bell around my neck.
I guess you could skip every other gear or something?