Hi Maniur,
This is the best reference for setting up calendar integration. Zoom does support the on premise Exchange server. If you are not the Exchange admin, you will probably need that person's assistance to complete the tasks.
Settings-for-calendar-and-contacts-integration-
If this answered your question, please consider marking as solution accepted to help others.
Thank you,
Nancy