Active speaker view jumps around too often

I like to use active speaker view for recording interviews BUt recently I've had a problem in that the view bounces back and forth far too often, even if there is no noise at my end to activate the switch. I've had to mute my microphone manually to prevent it but don't know why it's suddenly a problem when it wasn't one at all for years.