Replacing Spotlights

I have a Zoom meeting with a panel of three to four speakers and two people doing signing. The people signing will be changing every 15 minutes. My plan is to spotlight all of the panelists and the person who is actively signing. I planned on using "Replace Spotlight" when they pass off every 15 minutes. I cannot see how I can designate who the new person is replacing when I hit "Replace Spotlight"; it removes all Spotlights and just makes the new signer as having the Spotlight.  Looking for a solution.

Hope this makes sense.