Of course it should. But a rule that says you're banned because you're *too open...

mapgrep on Oct 12, 2011 | parent | context | favorite | on: How My Popular Site was Banned by Google

Of course it should. But a rule that says you're banned because you're too open with search engines is insane. robots.txt should have nothing to do with it.