String tokenizer working

not able to understand how its string tokenizer actually works internally

it divides based on a delelimter
delemiter u can say a ending point where division can be done
so like
i am a boy and u put a delimiter ’ ’ that is space then it will seperate this string whenever the ’ ’ will encounter

I hope I’ve cleared your doubt. I ask you to please rate your experience here
Your feedback is very important. It helps us improve our platform and hence provide you
the learning experience you deserve.

On the off chance, you still have some questions or not find the answers satisfactory, you may reopen
the doubt.