why does the length of dictionary increases with the no of features?
Bag of words-Bigrams, Trigrams, Ngrams
Hello Shalini,
When using Bigrams, Trigrams and Ngrams we are not just increasing the length of the dictionary but doing that for a logical reason.
Bigrams refers to extracting two words together from the text data. For example there’s a sentence ‘India lost to New Zealand in the world cup match yesterday’, here there are certain words which make no sense when used alone, they add more value when used along with another word, like ‘New Zealand’ and ‘world cup’. We use bigrams to include such pairs together in our vocabulary.
Similarly, when we clip together n words, it’s called an Ngram.
I hope this clears your doubt.
I hope I’ve cleared your doubt. I ask you to please rate your experience here
Your feedback is very important. It helps us improve our platform and hence provide you
the learning experience you deserve.
On the off chance, you still have some questions or not find the answers satisfactory, you may reopen
the doubt.