Help with ending up in a different meeting from my invitee

[NSP22]

I'm having an issue where I join a meeting that I've scheduled and invited another person to and we end up in different places. I thought initially that this had to do with being in back to back meetings, but I'm not sure that's the case. Here's an example of it happening. 

I see an email pop up that my guest has joined the meeting. I haven't joined yet. I go to my calendar and click on the Zoom link in the invite and end up in a meeting room...and the guest isn't there. I've waited up to 10 minutes and it never shows them. If I end the meeting and then go back to the Zoom link in the calendar invite and re-join, I end up in the meeting room by myself and then shortly thereafter I get a notification that my guest is in the waiting room. What they tell me is they were in the meeting, got kicked out (when I ended the meeting) and then had to rejoin. 

Why am I not ending up in the same meeting as my guest to start with?