Seeing the same thing here (Zoom starting to listen without any user input).

I've left an OBS window open without a recording running, and am seeing the orange dot, presumably as OBS is monitoring audio to be able to update its onscreen audio levels display. I wonder if Zoom is doing something similar.