Hacker Newsnew | past | comments | ask | show | jobs | submit | rzmmm's commentslogin

Isn't it obvious? Web scraping and even scanning written books is at record levels because the data is so useful for training. They are using every byte of user data.

It does work, at least in my experience. The challenge may be cheap for your n-of-1 but keep in mind the scraper bots are crawling number of domains with very high concurrency.

And without control of their source IP addresses. They use a "rotating proxy" meta-proxy which sends each request through a different proxy, which invalidates the Anubis response and triggers a new challenge.

Real attackers fuck. If they have IP address control issues they will fix them. The bots being stopped are the silly ones.

Okay. That's good enough. The problem people using Anubis have is not "I'm being targeted for a DDoS" and is actually "my site is being incidentally DDoS'd because scrapers are DDoSing the entire internet". A solution to the latter is what people need. Every single one of these threads comes up with hypotheticals about how useless Anubis is and how it can't possibly work and yet it does work for the real-world problem that real-world webmasters are dealing with.

Right: It's a threat-modeling mistake to start lumping different groups with different goals and different operational constraints together.

Sure, the cheap lock I added to the outside shed's door-latch is terrible and can be shimmed open in two seconds with a bit of flat metal... but the important thing right now is that it keeps the raccoons out. If there's a new threat to the gardening tools or the bikes, then I have a different problem and I'll consider something else.


If every site does it the scrapers will adapt. The scrapers will always have a cost advantage over real users for this.

Most of the problem in this case is that the scrapers are being incredibly lazy and not investing even minimal effort in their approach. If this forces them to revisit how they go about things then mission accomplished.

It's remarkable how stable 20-30% show HN concentration is after late 2022, for the extended stats.


The Show HN volume went 805/month to 4,199/month over that same time period, so from 3.2% of all submissions to 13.4%, while HN overall only grew 1.3x. So the flat ~24% held through a 5x expansion in the denominator, which makes it a lot more interesting honestly.


Interesting. To me it seems there are bunch of special cases where ketone monitor can be big help.


Reading these comments it seems that meta-discussion of AI is the most hot button topic of all in HN.


Well you need some substrate which can be metabolized into sugar, such as carbohydrate or protein.


Definitely. I was only responding to the statement that sugar is a necessity for energy if you’re moving around a lot. You can do this without sugar.


You can write raw sql and use the "describe" clause in script, and then generate code with the result. This gives full db-backend-frontend type safety with raw sql queries


This just shifts the legal responsibility to you.


It can also be a personal preference for minimalism vs. maximalism. Or many other things.


The implementation of the kernel is relatively trivial, it's an intentional design choice.


As claude would say, "relatively" is carrying a lot of weight in that frase. Definitely load-bearing — would not pass a quick smoke test.


but where’s the seam!?


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: