Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

That's an amusing example.

You are aware that Google scrapes almost every page on the internet, without having any agreement with most of them, right?

Yes, you can add noindex and robots.txt to tell them you'd like to opt-out, but:

a) That only works so well, and b) they're default is to use your page without your permission.



Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: