Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I was confused at what you were saying at first. For those that may also be confused:

You can add something like this to your robots.txt:

    User-agent: *
    Disallow: /some/unguessible/url
And then you ban any IPs/bots that visit that URL.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: