Zoom Chrome Extension with Multiple Accounts

Because of my different jobs and companies, I have several Zoom and Google accounts. Using the Zoom Scheduler Chrome Extension, I need to link each Google calendar to its corresponding Zoom account.

No matter which Google calendar I'm in, the scheduler (the little button that says "make it a zoom meeting") seems to choose AT RANDOM, in which zoom account it will schedule the meeting.  The calendar invitation says, "So & So invited you to a zoom meeting".  Most of the time, it's the wrong account.

Not only that, I'm constantly showing up to other people's meetings as "the wrong me".

Is there a way to fix this or a workaround so I can make the experience more predictable? 

Is this a limitation of the Chrome Extension, Google Calendar, or Zoom? 

I'm not even sure where to start.