Getting Started with Natural Language Processing

458 Pages·2022·13.644 MB·

by  Ekaterina Kochmar

Ekaterina Kochmar
M A N N I N G
Core NLPconcepts and techniques covered in this book
Core NLPconcept or technique First introduction
Cosine similarity Chapter 1
N-grams Chapter 1
Tokenization Chapter 2
Text normalization Chapter 2
Stemming Chapter 3
Stopwords removal Chapter 3
Term frequency–inverse document frequency Chapter 3
Part-of-speech tagging Chapter 4
Lemmatization Chapter 4
Parsing Chapter 4
Linguistic feature engineering Chapter 6
Word senses Chapter 8
Topic modeling Chapter 10
Named entities Chapter 11
NLPand MLtoolkits and libraries used in this book
Toolkit or library Examples of use
Natural LanguageToolkit (NLTK) Chapters 2, 3, 5, 8, 10
spaCy Chapters 4, 6, 7, 8, 11
displaCy Chapters 4, 11
scikit-learn Chapters 5, 6, 8, 9, 10
gensim Chapter 10
pyLDAvis Chapter 10
pandas Chapter 11
Getting Started with Natural Language Processing

Getting Started with
Natural Language
Processing
EKATERINA KOCHMAR
MANNING
SHELTER ISLAND
For online information and ordering of this and other Manning books, please visit
www.manning.com. The publisher offers discounts on this book when ordered in quantity.
For more information, please contact
Special Sales Department
Manning Publications Co.
20 Baldwin Road
PO Box 761
Shelter Island, NY 11964
Email: [email protected]
©2022 by Manning Publications Co. All rights reserved.
No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in
any form or by means electronic, mechanical, photocopying, or otherwise, without prior written
permission of the publisher.
Many of the designations used by manufacturers and sellers to distinguish their products are
claimed as trademarks. Where those designations appear in the book, and Manning Publications
was aware of a trademark claim, the designations have been printed in initial caps or all caps.
Recognizing the importance of preserving what has been written, it is Manning’s policy to have
the books we publish printed on acid-free paper, and we exert our best efforts to that end.
Recognizing also our responsibility to conserve the resources of our planet, Manning books
are printed on paper that is at least 15 percent recycled and processed without the use of
elemental chlorine.
The author and publisher have made every effort to ensure that the information in this book
was correct at press time. The author and publisher do not assume and hereby disclaim any
liability to any party for any loss, damage, or disruption caused by errors or omissions, whether
such errors or omissions result from negligence, accident, or any other cause, or from any usage
of the information herein.
Manning Publications Co. Development editor: Dustin Archibald
20 Baldwin Road Technical development editor: Michael Lund
PO Box 761 Review editor: Adriana Sabo
Shelter Island, NY 11964 Production editor: Kathleen Rossland
Copy editor: Carrie Andrews
Proofreader: Jason Everett
Technical proofreader: Al Krinker
Typesetter: Dennis Dalinnik
Cover designer: Marija Tudor
ISBN: 9781617296765
Printed in the United States of America
To my family, who always supported me and believed in me.

brief contents
1 ■ Introduction 1
2 ■ Your first NLP example 31
3 ■ Introduction to information search 71
4 ■ Information extraction 114
5 ■ Author profiling as a machine-learning task 151
6 ■ Linguistic feature engineering for author profiling 194
7 ■ Your first sentiment analyzer using sentiment
lexicons 229
8 ■ Sentiment analysis with a data-driven approach 263
9 ■ Topic analysis 304
10 ■ Topic modeling 346
11 ■ Named-entity recognition 384
vii