This is an amazing read. But i think for people to implement, it should be how t...

		bootcat on July 5, 2018 \| parent \| context \| favorite \| on: How to crawl a quarter billion webpages in 40 hour... This is an amazing read. But i think for people to implement, it should be how to crawl billion pages on cheaper boxes, may be spanning to a week or something.