Phone number

I'm having an issue where when I've enabled to see contacts on the zoom app, its automatically linked my phone number to my contacts and it will not give me the option to remove it. Even when I go on the website to see if theres an option to remove it, it says there's no mobile numbers linked however I know this is false as other contacts on zoom can see my number which I do not want them to. Please help!