Can't hear audio on apps outside zoom

I can't hear audio outside of the zoom app during meetings. I need to be able to hear notifications outside the meeting. I tried adjusting the setting in the volume mixer and changing the background noise suppression settings. Using different headphones doesn't change anything. I can't change the output audio settings without muting everything. I'm on Windows 10.