Echo in meeting with Zoom Room when using Rodecaster

Hi,

We recently made our own setup for the sort of Town Hall meetings.

We have a Rodecaster Duo, 2 wireless mics of the same brand a Logitech Rally camera, and a speaker. We are using a Zoom Room license that runs on a Mac Mini and an iPad as the controller. 

The setup work overall okay except that there is one meeting, yes one in particular, where people that are connected remotely have echo when they talk. Interestingly, we have another meeting using the same devices and setup where there is no echo. 

Some of the things that I noticed are:

1. The meeting with echo the first couple of folks that join remotely don't seem to experiment echo from the beginning. 
2. Once the meeting that has echo finish I have asked a few folks to stay and they don't have echo.
3. There is a Neat bar that connects remotely to both meetings and one of the meetings they have echo and the other one they don't
4. The number of people joining to the meeting with echo is bigger (30) than the other one (20)
5. The controller has the audio and video that corresponds to the right devices
6. We have setup some custom values for the outputs of the Rodecaster Duo. Where we basically increase the volume of the mics and the volume of the zoom for people that is connected remotely using the virtual output.
7. The meetings configuration when I look at Zoom are similar one to the other one. However, whenever the meeting with echo starts the camera doesn't turn on by itself. Wondering if the Rally camera is using a mic here and how to check that though with point 1 and 2 echo should be constant.
8. People that is connected remotely doesn't hear the echo when the location with the setup talk through the mic.
9. People that is connected remotely have been all mute except for the meeting room using the Neat Bar though point 3 makes me think that it shouldn't be a problem that device.
10. To stop the echo muting the room with the Rodecaster is enough.

Curious if anyone experienced anything like this or if you have a way to fix the problem or keep troubleshooting. Also, if you have tips to work around this problem in the meantime that could be helpful as the communication isn't full duplex someone has to mute our room to stop the echo. As there are too many people is hard to troubleshoot when all are on the call.