Many times a simple logistic regression or SVM could do wonders, especially on datasets <100K examples. It's a matter of being aware such applications are possible. The code is usually less than a couple hundred lines, but takes some experimentation to get it right.