Q8. Likelihood Estimation in Logistic Regression
Suppose, there are 6 training (x1…x6) points, and hypothesis value comes out to be as follows -
Remember hθ(x) = sigmoid(wT.x + b), where w and b are weights and bias learned by the model after training.
hθ(x1) = 0.6
hθ(x2) = 0.4
hθ(x3) = 0.7
hθ(x4) = 0.1
hθ(x5) = 0.4
hθ(x6) = 0.9
The maximum likelihood estimation is defined as the product of the probabilities p(yi|xi). Assuming 100% correct classification, the likelihood value(without log) for the above case would be -
0.006048
0.122472
0.198762
Class Labels are needed