Dolphin core slows to a crawl when I turn my controller on

As the title says, when I load up a game with my controller turned off, games run at full speed.
As soon as I turn on the controller emulation slows down to at least half speed, along with horrible sound stuttering.

System:

Windows 10
I7 6700k
Geforce 1080
16gb DDR ram
NVME m.2 drive
Xbox One controller via bluetooth

All other cores work perfectly. What could cause an issue like this?

Log file

I’m having the same issue, is it just in Wii games for you?