Yuzu up to this point had an issue with its audio implementation causing game performance to stutter pretty regularly. Now that asynchronous audio has been added, those performance issues are gone and it largely runs at full speed now. So far it's currently only available through Yuzu's paid early access builds, but I'd guess it'd be out to the public within the week.
There is a workaround for the public versions of Yuzu. Someone made a mod to disable the audio in the game altogether which basically gives the same performance benefit. That mod is available on their github wiki https://github.com/yuzu-emu/yuzu/wiki/Switch-Mods