Getting a notice to close breakouts 2 minutes before they are due to close

As a host or co-host, I keep getting a notice that the breakout rooms are finished and asked to close them, but there is still over two minutes left in the breakout time.  I know this because my co-facilitator has more time left on their side. The countdown clock is set at 30 seconds, so I know it's not that.  Any ideas how to fix this issue?