Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

cant confirm this - sitemaps are used for discovery -> the urls listed in the sitemap get pushed into the 'discovered urls queue' then this queue is prioritized for crawling- and - if there are no other factors - the shorter urls get prioritized higher (as there is a bigger chance that a shorter url is a canonical version of a longer url - well, the chance is bigger then the other way round


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: