When it comes to sentiment analysis, not everyone cares about accuracy, but if you do you have to watch our wonderful VP of Product Placement and Marketing, Seth Redmore, give his talk on Accuracy and Opportunity for the 2014 Sentiment Analysis Symposium. We’ve already posted the slides from this presentation, so you can follow along as Seth discusses the imprecise nature of accuracy, the personal nature of sentiment, and the benefits and limits of crowdsourcing.
Accuracy is going to mean different things to different people. Whether to focus on high precision or high recall is largely going to depend on what field you’re in and what you’re trying to achieve. Maximizing accuracy is going to involve both understanding your content and your needs, but also scoring some content the old fashioned human way, crowdsourcing style. Seth gives a comprehensive run down of crowdsourcing best practices, paying particular attention to Amazon’s Mechanical Turk, to ensure quality scoring and fair work standards.
Of course, accuracy is never going to be 100%, but that’s okay. The most important thing is understanding how to optimize to fit your needs.