how can we calculate number of parameters of all different layers?
Creating a LSTM Architecture
First of all go through this blog, to get the intuition of step by step working of LSTM cell.
https://colah.github.io/posts/2015-08-Understanding-LSTMs/
After reading and understanding this, you will be able to recognize that all four gates, namely, forget gate, update gate, input gate and output gate have similar equation and i.e. W * [xt ht] + b, (here [xt ht] means concatenation and not misunderstand it with dot product.) Now specifically let xt has input shape of (m,) and ht has shape of (n,) than the W will have shape of (n, m+n) and b will have (n), so total number of parameters will be 4 * (nn + nm + n).
Hope this cleraed your doubt. 
Sir has not taught everything in depth ,From where can i get rest?
I have already send the link in by above comment. Refer that. Also new videos will be arriving soon for in depth knowledge of lstm.
Happy Learning
I hope I’ve cleared your doubt. I ask you to please rate your experience here
Your feedback is very important. It helps us improve our platform and hence provide you
the learning experience you deserve.
On the off chance, you still have some questions or not find the answers satisfactory, you may reopen
the doubt.