Cannot get a response from the crawler.!

#21

this your used in new project or the previous one ?

#22

The way you made your previous code , is correct and works too .
its just that, i don’t know why your code wasn’t running for you.

#23

this one is new project.

#24

hey @prerit_goyal ,
so what did you used in the previous one ? do you remember that.

#25

rather than using the command:
scrapy genspider spider quotes.toscrape.com/

in my previous file:
I made a new file using quotes.py in myfile folder.

#26

okay so try one thing now.
scrapy startproject myfile
scrapy genspider myfile
( now paste your previous code in the .py spider file made )
scrapy crawl myfile

run these commands and try once again.

#27

yes I did all these commands in the previous file after i got all these results in my new file. :smile:

Only one thing that is disturbing in both the files was that “for loop”, that loop is making all the problem of not getting any resultant file.

#28

hey @prerit_goyal ,
that a confusion for me too now. :sweat_smile:

#29

is there a possibility that there maybe some updates in python or scrapy modules that maybe leading to that kind of problem??!!

#30

2021-05-14
2021-05-141920×1080 87.1 KB

An update:
I tried updating my coding to find out about the errors:
I found that the loop was working fine… the error was coming from the function “def start_request” only,
when i deleted that and the required changes in then the for loop statement as:
from:
scrapy.Request(url = i, callback = self.parse)

to
scrapy.Request(url = i)

now the scrapy is working fine…
now i do know how it is working, what i don’t know is why it is not working if i add the def function and the callback??

#31

i don’t think that should effect in this manner.

#32

Now toh you are confusing me too on this. Will check it once on teamviewer , that would be good .

1 Like
#33

yes thats good for me too!!
Sorry, :sweat_smile: for creating all this confusion!!

#34

is this issue resolved now ?

#35

no its still there…

#36

okay. Then just ping me on 8630831390 , we will discuss a time to connect on team viewer to get this done.

#37

I hope I’ve cleared your doubt. I ask you to please rate your experience here
Your feedback is very important. It helps us improve our platform and hence provide you
the learning experience you deserve.

On the off chance, you still have some questions or not find the answers satisfactory, you may reopen
the doubt.