Bug: Quit application when clicking quit icon

The application won't quit when I close it via the cross icon in Windows, via the taskbar and it's still in the system tray, even though I have this option turned off in the settings. I want to quit the application normally, please. How?