Type-C earset disturbs overlay button and menu control

Though said earset are actually a standard earset with 3.5mm plug, plugged into a 3.5mm-to-type-c adaptor. After the earset is connected to the phone (with type-c port),

  1. with the menu, everything in menu ----busttons on the menu and on the panel---- does not respond, I can only swipe to scroll, and nothing else can be done.
  2. with the overlay buttons, the overlay buttons can be pressed. But once pressed-down, the pressed-down button is stuck pressed, until another button is pressed, then it returned unpressed, and the newly pressed-down button stuck pressed-down instead.

This only happens when the type-c easet is connected to the phone, and everything go backs to normal when unconnected.

My guess is that Retroarch take the eaarset as a controller. Is there a way to let the earset act only as earset when using RA? Or is there a way to let RA reject every input signal from the earset?