So, easiest approach is:
VMWare Player w/ Ubuntu 20.04, use at least 80GB HDD and set USB to 3.1
at least in the created VM, share the Nvidia USB on VMWare player
You can deselect the Host installation and to accompany the setup you can tail ~/.nvsdkm/sdkm.log -f
When Flashed you just need to connect your box to a monitor, keyboard and mouse, setup it's Ethernet and continue in the SDK Manager from the VMPlayer using the Network. Beware that the Jetson Xavier at least is picky with its monitors and doesn't work (asside from the BIOS part) in an LG TV connected via HDMI, but an older VGA monitor with an HDMI adapter worked for me.
Afer you're all setup you can continue working from Windows, to Access your NVIDIA device remotely from Windows:
Install VcXsrv
Run xlaunch.exe
Use the Defaults and Disable
access control
Run export DISPLAY=192.168.1.100:0 on remote bash and run any window command (e.g. gnome-calculator), the window will appear on your Windows PC, where it belongs :)