Other users' screens freeze when one user leaves a meeting. Host's screen doesn't freeze

I am the host, and I allow my users to join the meeting before me.  When one person who joins before me leaves before me, the screen freezes for the others users.  They need to leave the meeting and join again.  How can I prevent this?