>My understanding is this is one eventual goal of Street View database: to be able to use image recognition (street names, street numbers, buildings, landmarks, etc) to more correctly locate pins.

They're now using reCAPTCHA to assist with that: http://techcrunch.com/2012/03/29/google-now-using-recaptcha-...