I am having the same problem, though Zoom was using the mic when I thought the application wasn't even running. After reading this thread I did the following:

1. Quit Zoom

2. Opened Activity Monitor

Once Activity Monitor was opened I saw that the Zoom app was "Not Responding" (even though I icon had disappeared from my Dock). I force quit the app and the orange dot in Control Centre went away.