Tokenization plays an important role in key text analytics features, like entity and theme extraction. Whether you’re building or buying, you’ve gotta know tokenization. In this two minute article, our Chief Scientist, Paul, lays out the fundamentals.