Keep at it.

Eventually you'll be able to drop all fingers pretty much at the same time, even on chords like B7 (or Cm7b5 if you decide chords such as that are useful)