My PC is not on WiFi and I had success. It's on the same network, but hard wired. Which is ideal frankly.
If it works with Windows Firewall disabled, that is where the problem is. There can be no doubt! Almost all recommendations (and common sense) suggest performance will be worsened not using Ethernet for the PC. Every additional device using wifi to communicate with each other will half available bandwidth and double latency, in simple terms.
Tbh there's no big deal having Windows Firewall disabled for a time, unless you are not at home or have unknown / hostile devices inside your own network.
Thanks for the responses, I finally figured out the culprit, for some reason my ethernet connection was set to public, set it to private and now it works flawlessly. That was entirely too much time spent to figure that out xD
But hey it works so I'm happy, and incredibly impressed with how smooth the performance is compared to VRidge. Was thinking my PC was too underpowered to handle it based on my time with the latter, glad that's not the case now. I wonder if anyone has ran Oculus native apps successfully using ALVR? I still need to play Lone Echo and would love to be able to do so with Touch controllers.