Boundary in KNN

In k-NN what will happen when you increase/decrease the value of k?

  1. The boundary becomes smoother with decreasing value of K
  2. The boundary becomes smoother with increasing value of K
  3. Smoothness of boundary doesn’t dependent on value of K
  4. None of above

What is the smoothness of boundary? Can you please explain how we can create boundary in case of K-NN?

Hey @tisandas2011, in lay man terms smoothness of boundary is something like the boundaries separating different classes, must be smooth, and must not contains spikes.

In neural network videos, we will use a file named visualize.py it will help you to plot such decission boundaries.

Now suppose if k =1 than there will be huge impact of outliers. Which means outlliers will affect the decission boundary a lot, on the other hand if k=5 or any other little higher value than the impact of the outliers will be reduced. So the points which are very close to the outlier point, will be classified correctly.

Hope this resolved your doubt.
Plz mark the doubt as resolved in my doubts section. :blush:

I hope I’ve cleared your doubt. I ask you to please rate your experience here
Your feedback is very important. It helps us improve our platform and hence provide you
the learning experience you deserve.

On the off chance, you still have some questions or not find the answers satisfactory, you may reopen
the doubt.