Exactly like I do other than I hand roll my own loads. I do take a wire brush and scrub my barrel after every shot then run a bore snake when I'm patterning, but I can't imagine it makes that much difference. The only other thing I can think of that would cause the drop in pattern would be variability in the ammo, but I can't imagine factory loads varying enough between loads for you to ever see it when patterning. I'm stumped.
Are these loads you are using to pattern from the same lot number?