while i am calculating movie rating predicton,if i train my model for all the training dataset available it leads to memory error and with 10000 reviews it gives 80% accuracy. what can be solution to this
Memory error in movie rating prediction challenge
While you were training with all 40000 dataset and using CountVectorizer() don’t convert the result into toarray()
and leave it as sparse matrix. I know you won’t be able to see the data in a good fashion, But this would resolve the problem of memory error.
Thanks