Can’t switch controllers while retroarch is running

So I’m running retroarch on android with an ayn thor device. This device can connect to a hub that has hdmi out and 3 use ports. This means that sometimes I play with the built in controller and other times when connect to the tv I play with a usb controller. So if I want to switch controllers I have to change the device index in the retropad binds but the problem is that the new device index only transfers the over the dpad and nothing else. I try rebind the new controller after changing the device index but nothing only the dpad works, all the face buttons will only work with the original controller that was used when I first booted up retroarch. The only way to solve this is the go back to the original controller or do a full reboot of retroarch and start with the controller I want. But there is no way to switch controllers while retroarch is running.