Specials blocked after ending combo with medium

Ollyoxenfree

I started doing bounty quest and I noticed every time I finished a combo with a medium and then used a special, the enemy would block the special. If I finished with a light, the special would land. The hard part is my muscle memory usually has me finishing with mediums.