LexaBlog

Our Sentiment about Text Analytics and Social Media

Got a spare 142 Gigs?
Submitted by Mike Marshall on Thu, 2009-04-02 04:00

Just a very quick note to point you in the direction of a fantastic resource that Paul (one of the other members of the engineering team) pointed me at the other day. Its part of the ICWSM 2009 Data Challenge and is a set of 44 million blog posts generated between August and October 2008. Its in XML and is only 142 gigs after you uncompress it. Could form that basis of a great test set a la TREC maybe?