speaker delay from other party to my headset

[seanmiller]

When on a conference call the other parties are able to hear me from the first word to the last, but once it shifts to them to talk, there is a significant delay before I can hear what they are saying... so much so that I have to ask them to repeat themselves, which if we are talking and they aren't quit for too long, we are fine.  But once I have talked for a bit, I hear a beep, then when I ask them to respond, it takes a bit of time for Zoom to recognize that they are speaking.  They get the green boarder and the mouth is moving, but the audio is delayed, and I pick them up halfway thru a sentence.  How do I fix? 

Also, when there have been three parties, the other two don't have the delay on their side, it's only on my side.