Big Data-Hoarding Hedge Funds And Managing The Twitter ‘Firehose’

In an effort to beat benchmarks, investment companies sometimes say they are looking at the entire dataset of Twitter, known in the business as the “full firehose”. In actual fact, few people can manage the sheer scale and storage challenges that come with it, not to mention the costs. A hypothesis-driven attempt to do some of…