NLP Learnings 23 – Language Models – Sentence and Document Embeddings – Which one to consider

In the previous post, we learned what are Sentence and Document Embeddings. In this short post, we learn which embedding (sentence or document) to consider.

Sentence Embedding vs Document Embedding – Which one to consider

Sentence Embedding Document Embedding

If you need detailed information on a large text, then consider words and sentence embeddings.

If you are more interested in higher-level of information on a large text, then consider document embeddings.

high-level means the classification of a document as a whole. Classification of a document could be Entertainment, Politics, Sports, and more.

the higher level also means the TOPIC classification of a document.

Consider word and sentence embeddings if you are looking for a lower level of detailed information like emotions at the tech sentence level, the subject of a political scandal or a sentence, the subject of a large news article, and more. While analyzing the documents, remove some of the details obtained from the sentences.
  You can consider the first “N” paragraphs of a document instead of considering all the text in the document.
 

Through the TF-IDF technique, you can determine 

a. words that are more relevant to the topic(s) of document

b. most discriminatory words of document

c. words that are more/less likely to appear in a document

Related Topics:

  1. Natural Language Processing Primer
  2. NLP Learnings 02 – After Primer – NLP Models & Evaluating NLP Models
  3. NLP Learnings 03 – What is Linguistic in NLP and Linguistic Categories or Linguistic Levels
  4. NLP Learnings 04 – Sentence Linguistic Analysis – Words As First Step
  5. NLP Learnings 05 – Sentence Linguistic Analysis – Pragmatics Analysis
  6. NLP Learnings 06 – What can we do with A Sentence in NLP Tasks
  7. NLP Learnings 07 – Introducing NLP Language Models
  8. NLP Learnings 08 – Language Models – Probability Types
  9. NLP Learnings 09 – Language Models – Measuring Text Based On Probability
  10. NLP Learnings 10 – Language Models – Defining Word Boundaries
  11. NLP Learnings 11 – Language Models – Your Business Text Data and Their Words Representation
  12. NLP Learnings 12 – Language Models – Regularization Techniques And Your Business Text Data
  13. NLP Learnings 13 – Language Models – Smoothing Regularization Techniques And Your Business Text Data
  14. NLP Learnings 14 – Language Models – NLP Key Terms and Concepts
  15. NLP Learnings 15 – Language Models – Classifiers Introduction
  16. NLP Learnings 16 – Language Models – Classifiers – What are Probabilistic Classifiers
  17. NLP Learnings 17 – Language Models – Classifiers – Simple Classifiers Introduction
  18. NLP Learnings 18 – Language Models – Classifiers – Simple Classifiers – Linear Probabilistic Classifier Introduction
  19. NLP Learnings 19 – Language Models – Classifiers – Evaluating Classifiers – Precision Recall F-Score Confusion Matrix
  20. NLP Learnings 20 – Language Models – Classifiers – Represent Words In A Document – Choosing and Representing Features In The Right Way
  21. NLP Learnings 21 – Language Models – Word Embeddings
  22. NLP Learnings 22 – Language Models – Sentence and Document Embeddings
  23. NLP Learnings 23 – Language Models – Sentence and Document Embeddings – Which one to consider