Python 3 Text Processing with NLTK 3 Cookbook

Over 80 practical recipes on natural language processing techniques using Python's NLTK 3.0About This BookBreak text down into its component parts for spelling correction, feature extraction, and phrase transformationLearn how to do custom sentiment analysis and named entity recognitionWork through the natural language processing concepts with simple and easy-to-follow programming recipesWho This Book Is ForThis book is intended for Python programmers interested in learning how to do natural language processing. Maybe you've learned the limits of regular expressions the hard way, or you've realized that human language cannot be deterministically parsed like a computer language. Perhaps you have more text than you know what to do with, and need automated ways to analyze and structure that text. This Cookbook will show you how to train and use statistical language models to process text in ways that are practically impossible with standard programming tools. A basic knowledge of Python and the basic text processing concepts is expected. Some experience with regular expressions will also be helpful.What You Will LearnTokenize text into sentences, and sentences into wordsLook up words in the WordNet dictionaryApply spelling correction and word replacementAccess the built-in text corpora and create your own custom corpusTag words with parts of speechChunk phrases and recognize named entitiesGrammatically transform phrases and chunksClassify text and perform sentiment analysisIn DetailThis book will show you the essential techniques of text and language processing. Starting with tokenization, stemming, and the WordNet dictionary, you'll progress to part-of-speech tagging, phrase chunking, and named entity recognition. You'll learn how various text corpora are organized, as well as how to create your own custom corpus. Then, you'll move onto text classification with a focus on sentiment analysis. And because NLP can be computationally expensive on large bodies of text, you'll try a few methods for distributed text processing. Finally, you'll be introduced to a number of other small but complementary Python libraries for text analysis, cleaning, and parsing.This cookbook provides simple, straightforward examples so you can quickly learn text processing with Python and NLTK. Read more