NLP- natural language processing
NLP is a sub field of AI that is focused on enabling computers to understand and process human language.
text processing techniques
1.basic text processing
2. advance text processing
Basic text preprocessing of text data
1. lower casing
2. punctuation removal
3. strop words removal
4. frequent words removal
5. rare words removal
6. tokenization
7. stemming
8. lemmatization
Advance text processing
1. N- grams
2. term frequency
3. inverse document frequency
4. term frequency- inverse document frequency -TF-IDF
5. bag of words
6. word embedding
NLP tools and libraries
- spacy
- polyglot
- core nlp
- rasa nlu
- python
- textblob
- sckit learn
- gensim
No comments:
Post a Comment