Forcing users into a breakout room

Is there a way to force users into a breakout room without them needing to click the "join" button? No matter what setting I change it doesn't seem to affect if that message appears or not. Some of my meeting attendees are automatically moved, while others still receive the dialogue box. 

To expand on that - if the suer doesn't accept the invitation to the first breakout room I am unable to assign them to another. There is no option to move them around if they don't accept the first one.

Overall - how do I turn off their ability to accept and just force them into the room?

Thanks!