Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

https://github.com/robots.txt

I don't see anything here about wiki specifically but maybe one of the rules hits wiki pages?



They've moved from robots.txt to blocking by headers.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: