Invitation for one meeting with various start times

I am trying to set up a meeting with one breakout room that will go all day.  Some people will be invited to the entire session (the interviewers), though most will need to be invited for parts of the meeting (e.g., 4 interviewees to be there 9-10, 5 interviewees to be there 10-11, and so on).  They would all come to the meeting and then be placed in the breakout room at their scheduled time slot.  I can make the whole meeting invite, but when I try to adjust the time for these individuals, Zoom changes the whole meeting time.  If I copy the invite, I lose the calendar feature in Outlook.  Any suggestions are appreciated.