Doubt in adding SimpleRNN Layer

#1

How to decide for the dimensionality of the output state vector , ie the value of units while adding SimpleRNN layer?

#2

The units parameter in simple RNN layer specifies the output dimensions and not the number of units. This can be any number and there is no particular method to find out this parameter value. Although you can take 3-4 values of the order of 100 and experiment with them.

Hope this helps.

#3

Yes Sir i know that it specifies the output dimensions, but it will be the output dimension of each unit na?, and if yes then can this value be any value starting from 1 to any largest number, ie it won’t have any effect on the model accuracy or parameters ? for ex. isn’t there a chance that is the output dimension are specified to be a very small value then the output can be highly compressed and thereby result in loss of information and so on …Will such type of problems won’t occur?

#4

Usually we take this number to be in the power of 2 like 32,64,128,256,512,1024…these units usually solve the purpose of our problem. But we need to try these values out.

#5

I hope I’ve cleared your doubt. I ask you to please rate your experience here
Your feedback is very important. It helps us improve our platform and hence provide you
the learning experience you deserve.

On the off chance, you still have some questions or not find the answers satisfactory, you may reopen
the doubt.