phone ringing through head set and you can't hear your current call

so we use a headset here to answer multiple calls. when i am on one call and the phone rings it rings through the headset and i can't hear my current customer that i am speaking with. is their any setting or any advice to fix this problem. i tried the audio use separate audio device to play ringtone simultaneously and that didn't work. 

thank you, Chris