Zoom Scheduler - Allows for double booking with synced calendar ??

Hello,

I have just added zoom scheduler to my account. While setting up an appointment booking page and exploring the feature, I am noticing that scheduler is showing my entire schedule as available-- even though most of my calendar throughout the week is booked. To state this another way, when someone looks at my scheduler page they will see a list of times that I am not actually available due to external appointments that do show on the calendar I have synced with my zoom account.

Is two-way calendar sync not available? Is there a setting that I have missed somewhere? 

What I would like to do is use zoom scheduler to have folks add appointments to my calendar that do not conflict with events that are already on the calendar.