Scrapy shell for pepperfly

#1

Can’t I use scrapy shell for sites like pepperfly, which allows GET requests only by browsers? Because the response generated is 403 instead of GET.

#2

Hey @SanchitSayala, there is a hint video for this challenge, you can see that, in which we scrape the pepperfry site using scrapy.

Hope this resolved your doubt.
Plz mark the doubt as resolved in my doubts section. :blush:

#3

I saw the hint video, in which bhaiya made some changes in the settings file for this purpose. But isn’t there a way to so that the same can be used for scrapy shell too?

#4

Hey @SanchitSayala, i myself haven’t tried it yet, will let you know if something is possible.

#5

I hope I’ve cleared your doubt. I ask you to please rate your experience here
Your feedback is very important. It helps us improve our platform and hence provide you
the learning experience you deserve.

On the off chance, you still have some questions or not find the answers satisfactory, you may reopen
the doubt.