GCN adapter with vJoy driver: Button mapping is wrong, can't fix

Hi, I have the gamecube controller adapter (nintendo branded, the one that was released for the switch) and have gotten it to somewhat work. vJoy properly installed and running, no issues in that config; however retroarch will not allow me to configure the button mapping. Tried everything I can think of (I personally don’t find the UI user friendly) and nothing works. A is mapped to B, and B is mapped to Y. However, in the “port 1” button options, I’ve redone it numerous times and everything is mapped right in there. again, in the actual config of vJoy everything is correct, it’s an issue with retroarch. DS4 and xbox works fine, but I don’t like those controllers, hence why I’m trying to get this to work.