Audio deteriorates with time

A variety of things can cause sound to degrade over time – though in most cases this doesn't happen, of course. A lot depends on your audio settings.

Any chance you can grab a screen shot of your Zoom Settings Audio tab and post?  Also might be helpful to know what kind of mic you are using (brand and model if possible), and if you are using any sound applications for compression, equalization, noise reduction, etc.