Attached iCloud calendar to Scheduler but my schedule doesn't block out existing appointments

Hi all. I know adding iCloud calendar is in beta mode, but I seem to have done everything I need to - generated a code, made it my primary calendar, toggled it to on. But when I got to my public-facing schedule page, it has me free every hour every day! Why isn't it blocking out my existing appointments? Thanks.