A way to have an Arcade Stick configured just for a specific game in Retroarch?

Hey guys, I have an Hori Real Arcade Pro 4 and want to configure it in Retroarch. I am aware that the latest releases of Retroarch give you the ability to change controls for a specific game and also autoload them but at least to my knowledge that only works for the current active controller (in my case a Dualshock 4), since you can’t choose what gamepad you want to control/change within the game specific options.

So while my Arcade Stick is recognized just fine, I’d have to change my main controller from the DS4 to the Hori core wide, which would mean that I’d have to change them everytime I would play a game that would require a normal gamepad.

Is there anyway to bypass this maybe by creating a control file or so which I would then be able to load within the game specific menu (but without changing the general settings of the core)?

Hope you guys can help me here, thanks!