Characteristics of NLTK, SpaCy, CoreNLP and Spark NLP

Name               Spark-NLP SpaCy NLTK CoreNLP
------------------------------------------------
Sentence Detection Yes       Yes   Yes  Yes
Tokenization       Yes       Yes   Yes  Yes
Stemming           Yes       Yes   Yes  Yes
Lemmatization      Yes       Yes   Yes  Yes
POS Tagger         Yes       Yes   Yes  Yes
NER                Yes       Yes   Yes  Yes
Text Matcher       Yes       Yes   No   Yes
Date Matcher       Yes       No    No   Yes
Chunking           Yes       Yes   Yes  Yes
Spell Checker      Yes       No    No   No
Sentiment Detector Yes       No    No   Yes
Pretrained Models  Yes       Yes   Yes  Yes
Training Models    Yes       Yes   Yes  Yes

Technical Functionality Comparison

Features                       Spark-NLP SpaCy NLTK CoreNLP 
-----------------------------------------------------------
Java API                       Yes       No    No   Yes 
Scala API                      Yes       No    No   No
Python API                     Yes       Yes   Yes  No 
Training on GPU                Yes       Yes   No   No
User-defined Deep Learning N/w Yes       Yes   No   No                   
Supports Spark Natively        Yes       No    No   No
Supports Hadoop                Yes       No    No   No

Tags: Natural Language Processing,