I’m not sure how that setup would work.
I have not tested Xubuntu. So, The Xorg vre/config may not work well or at all as you have stated.
This has been tested and proved working on:
Ubuntu 14, 16, 18 Lubuntu 16, 18 Arch Linux with Xorg + LXDE
Not working or partially working: Fedora - switching does not always work and revolutions look odd when switching does work.
I think after your report I will be adding Xubuntu to the not working list. I believe this is an issue with the windowing environment XFCE