For Capturing negative reviews in Movie Rating Prediction Challenge

I wrote the folllowing line in the getCleanReview function in clean_text.py->
new_tokens = [token for token in tokens if token not in en_stopwords or token==‘not’]
I also included the Bigram features but I’m not able to get a +ve review for “the movie I saw was not bad.”
Pls help.

Hey @D17LP0007, this is the general problem with the naive bayes classifiers. They are unable to capture the context of the words. Your model is not able to give the correct output because in training data there will be no such sentence having negative negation. This is the reason we prefer LSTM and RNN. Also lstm and rnn will also fail if training data lack such examples.

Hope this cleared your doubt. :blush:

1 Like

I hope I’ve cleared your doubt. I ask you to please rate your experience here
Your feedback is very important. It helps us improve our platform and hence provide you
the learning experience you deserve.

On the off chance, you still have some questions or not find the answers satisfactory, you may reopen
the doubt.