I saw an argument recently, that most of the problem has been caused by the fact that sentencing has been pulled out of the hands of the judiciary (though mandatory minimums etc). Judicial discretion in sentencing was once a check on this sort of thing.