] Heritrix is the Internet Archive's open-source, ] extensible, web-scale, archival-quality web crawler ] project. ] ] Heritrix (sometimes spelled heretrix , or misspelled or ] missaid as heratrix / heritix / heretix / heratix ) is an ] archaic word for inheritess . Since our crawler seeks to ] collect the digital artifacts of our culture for the ] benefit of future researchers and generations, this name ] seemed apt. The odds just went up greatly that MemeStreams will keep a cache and revision record of every page that get's meme'd. (Add that to the list of everything else we have promised..) I have not had a chance to look at this in depth yet, it just hit my radar. (via BoingBoing) OSS'ing this was a great move. I was thinking about trying to get a part-time job working down at the Internet Archive. I'm a big supporter of everything they are doing over there.. |