Difference between revisions of "Natural Language Processing (NLP)"
(→Sentiment Analysis) |
|||
| Line 10: | Line 10: | ||
* [http://azure.microsoft.com/en-us/services/cognitive-services/directory/lang/ Language services | Cognitive Services | Microsoft Azure] | * [http://azure.microsoft.com/en-us/services/cognitive-services/directory/lang/ Language services | Cognitive Services | Microsoft Azure] | ||
* [[Text Transfer Learning]] | * [[Text Transfer Learning]] | ||
| − | |||
| − | |||
| − | |||
* [[Courses]]: | * [[Courses]]: | ||
| Line 18: | Line 15: | ||
** [http://www.class-central.com/course/coursera-natural-language-processing-9603 Natural Language Processing | Higher School of Economics] | ** [http://www.class-central.com/course/coursera-natural-language-processing-9603 Natural Language Processing | Higher School of Economics] | ||
** [http://www.class-central.com/course/deep-learning-for-natural-language-processing-8097 Deep Learning for Natural Language Processing | Oxford - Phil Blunsom] | ** [http://www.class-central.com/course/deep-learning-for-natural-language-processing-8097 Deep Learning for Natural Language Processing | Oxford - Phil Blunsom] | ||
| − | |||
| − | |||
| − | |||
| Line 34: | Line 28: | ||
| + | == Pipeline == | ||
| + | [http://www.youtube.com/results?search_query=Pipeline+workflow+workbench+nlp+natural+language Youtube search...] | ||
| + | |||
| + | * [[Natural Language Tools]]: | ||
| + | * [http://en.wikipedia.org/wiki/Outline_of_natural_language_processing#Natural_language_processing_tools Outline of natural language processing | Wikipedia] | ||
| + | * [http://github.com/CogComp/cogcomp-nlp/tree/master/pipeline CogComp NLP Pipeline | Cognitive Computation Group, led by Prof. Dan Roth] | ||
| + | |||
| + | <youtube>k5X12mdEvb8</youtube> | ||
| + | <youtube>k5X12mdEvb8</youtube> | ||
== Regular Expressions (Regex)== | == Regular Expressions (Regex)== | ||
| Line 179: | Line 182: | ||
<youtube>DDByc9LyMV8</youtube> | <youtube>DDByc9LyMV8</youtube> | ||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
= [[Evaluation Measures - Classification Performance]] = | = [[Evaluation Measures - Classification Performance]] = | ||
Revision as of 05:04, 23 September 2018
- Outline of natural language processing | Wikipedia
- Natural Language Processing | Wikipedia
- Grammar Induction | Wikipedia
- How do I learn Natural Language Processing? | Sanket Gupta
- AI-Powered Search
- Natural Language | Chris Umbel
- NLP News | Sebastian Ruder
- Language services | Cognitive Services | Microsoft Azure
- Text Transfer Learning
Speech recognition, speech translation, understanding complete sentences, understanding synonyms of matching words, sentiment analysis, and writing complete grammatically correct sentences and paragraphs.
Contents
- 1 Pipeline
- 2 Regular Expressions (Regex)
- 3 Tokenization / Sentence Splitting
- 4 Stop Words
- 5 Stemming (Morphological Similarity)
- 6 Part-of-Speech (POS) Tagging
- 7 Chunking
- 8 Chinking
- 9 Named Entity Recognition (NER)
- 10 Coreference
- 11 Hierarchical Classifier
- 12 Lemmatization
- 13 Corpora
- 14 Topic Modeling
- 15 Word Embeddings
- 16 Summarizer
- 17 Ontologies
- 18 Semantic Role Labeling (SRL)
- 19 Deep Learning Algorithms
- 20 Evaluation Measures - Classification Performance
- 21 Capabilities
Pipeline
- Natural Language Tools:
- Outline of natural language processing | Wikipedia
- CogComp NLP Pipeline | Cognitive Computation Group, led by Prof. Dan Roth
Regular Expressions (Regex)
Search for text patterns, validate emails and URLs, capture information, and use patterns to save development time.
Tokenization / Sentence Splitting
Stop Words
Stemming (Morphological Similarity)
Refers to a crude heuristic process that chops off the ends of words in the hope of achieving this goal correctly most of the time, and often includes the removal of derivational affixes.
Part-of-Speech (POS) Tagging
Chunking
Chinking
Named Entity Recognition (NER)
Coreference
Hierarchical Classifier
Lemmatization
Lemmatization usually refers to doing things properly with the use of a vocabulary and morphological analysis of words, normally aiming to remove inflectional endings only and to return the base or dictionary form of a word, which is known as the lemma . If confronted with the token saw, stemming might return just s, whereas lemmatization would attempt to return either see or saw depending on whether the use of the token was as a verb or a noun. The two may also differ in that stemming most commonly collapses derivationally related words, whereas lemmatization commonly only collapses the different inflectional forms of a lemma. Stemming and lemmatization | Stanford.edu
Corpora
Topic Modeling
Word Embeddings
Summarizer
Ontologies
(aka knowledge graph) can incorporate computable descriptions that can bring insight in a wide set of compelling applications including more precise knowledge capture, semantic data integration, sophisticated query answering, and powerful association mining - thereby delivering key value for health care and the life sciences.
Semantic Role Labeling (SRL)
identifies shallow semantic information in a given sentence. The tool labels verb-argument structure, identifying who did what to whom by assigning roles that indicate the agent, patient, and theme of each verb to constituents of the sentence representing entities related by the verb.
Deep Learning Algorithms
- Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and Recurrent Neural Network (RNN)
- Deep Q Learning (DQN)
- 7 types of Artificial Neural Networks for Natural Language Processing
- Combination of Convolutional and Recurrent Neural Network for Sentiment Analysis of Short Texts | Xingyou Wang, Weijie Jiang, Zhiyong Luo
- Autoencoders / Encoder-Decoders
- LSTM
- GRU
Evaluation Measures - Classification Performance
Confusion Matrix, Precision, Recall, F Score, ROC Curves, trade off between True Positive Rate and False Positive Rate.
Capabilities
Sentiment Analysis
Wikifier
