Prune back those perennials that you want to keep up with!
Fall and spring are the best times of year to do this kind of trimming, because it clears the way for new shoots that are sent out.
Be careful: do a background check on your specific variety of perennial before you start hacking away, since certain plants only bloom on old growth, while others only bloom on the new.