Speed Dial Settings directly on Phone

I set speed dial settings directly on my phone before we had zoom software to use.  I have deleted the direct settings, but zoom will not update the locations on the phone that were directly set up.  What is a solution for this problem.