How to stop computer audio going weird when joining zoom meetings

When I join a zoom meeting, if I have the same device I joined the meeting with playing sound from other apps, the audio from other apps (especially music) ends up sounding super weird, I think it's being played in mono. How can I stop this from happening without affecting the audio for the zoom call?