An n-gram model builds upon the bag of words approach by considering n consecutive tokens in addition to the individual tokens of a document. For example, a bigram (n=2) would create features from each pair of consecutive tokens in the text. If a document consists of the sentence “It is sunny and 75 degrees”, in addition to the individual words, an n-gram of size 2 would consist of the pairs [“It is”, “is sunny”, “sunny and”, “and 75”, “75 degrees”].
What is an n-gram model?
- Categories: Textual Data
- Updated: March 26, 2023
Help us improve this post by suggesting in comments below: - modifications to the text, and infographics
- video resources that offer clear explanations for this question
- code snippets and case studies relevant to this concept
- online blogs, and research publications that are a “must read” on this topic
- video resources that offer clear explanations for this question
- code snippets and case studies relevant to this concept
- online blogs, and research publications that are a “must read” on this topic
Partner Ad
- Other Questions in Textual Data
Find out all the ways
that you can