How to fix the music lowering when people start talking？

Hi @sztan.

Zoom's audio really does try to make sure that people speaking are heard over other things, including noise and music.

You might look into this Zoom Support article on "Original Sound" settings, but even with that, I think that any speaking will "duck" the audio from other sources.