About Training of Neurons

As we are training each neuron with the same data, wouldn’t they learn the same parameters ( decision boundary ), as each neuron is a linear classifier ?