Attendees in Zoom Invite Not Integrating with Zoom Personal Contacts List

I just spent a great deal of time adding contacts in the Personal Contacts List because I didn't want to link to my gmail contact list.  But, when scheduling a meeting, it doesn't seem to pull data from the Personal Contacts List.  What am I missing?  What's the point of a Personal Contact List if you can't use it to invite people to a zoom meeting?