Remote control closes shared window

My screen sharing works fine and I can use all the tools to annotate. But as soon as I give remote control to another participant and they click on my screen (using any of the annotation tools) - the window I'm sharing collapses.  It happens randomly with different participants. Sometimes it doesn't happen in one meeting but happens in the next one with the same person.