They are tight for a reason - so it takes a distinct and intentional effort to disengage.
Don't jack with the safety. If you think the click of the safety is somehow going to cost you a bird, squeeze the safety button between your thumb and forefinger and you can push it over silently instead of just pushing it from one side.