This is incredible! Crawling issues Scalable crawling of unlimited sized Internet, algorithm for "freshness" and determining duplicates in dynamic pages PageRank a nice supplement to my other meme for the academic paper about Google. The best part: it's my job to read this stuff! Stanford's CS345 - The Web Crawling/organizing/Searching bible |