Make zoom ignore certain audio output

Zoom on Mac. When I connect to a docking station, it installs new audio device which I never use and will never use. The problem is, that this becomes default audio device, without any microphone or headphone connected to it. So the typical scenario is, that I connect to docking station, audio becomes routed to it, I join a zoom call and no one hears me and I can hear no one, I need to manually change the audio device. Always. That's stupid in MacOS, in Windows IIRC there is a possibility to make device inactive on a system level, but MacOS is not that advanced.

Is there a possibility in Zoom to always ignore certain device?