Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yelp is very aggressive against crawlers. They IP banned me for curl'ing their site a few times for something or another that their API didn't provide. I had to email them and promise never to do it again. I'd imagine it has provoked some to attempt to crawl them via Tor. I just use the Open Table API instead.


! Cheers to the tip.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: