Voice Broadcast Message Challenges..

I am wondering if someone can help me?  In my last two meetings I have broadcasted a message to the groups while in breakouts.  I then stopped the message and closed the breakout window, however even though I am no longer broadcasting,   people in the breakouts can still hear me.  This seems to be a new issue and unclear as to why.   In one scenario a participant was sharing something private with me in the main session and everyone could hear it.  Can someone help me to make sure this doesn't happen again? Thanks! Version: 6.1.0 (41135)