Same issue. Comparing to the privacy concern, I'm more annoyed because Mac will switch my AirPods Pro back when I'm actually using my phone. Mac thinks that as long as zoom requires microphone, I'm in a meeting. But I'm in a phone call on my iPhone.