I don’t understand what’s wrong. why 2% inaccuracy?
Why not 100% accuracy?
Scrapy crawling.
output in a JSON using scrapy crawl -o books.json. Used pandas in another file. loaded that JSON into a list of dictionary using json.load() method and converted all of this list of dictionaries into a data frame. Dropped the first column of Dataframe, exported it as a CSV using the to_csv() method.
hey @siddhu28.ss ,
Its not your fault in code.
Its basically the functioning of scrapy , scrapy is basically made to work for crawling websites and scrap data.
But on this website , as the links provided to images are given in a different way , hence there are some small mistakes done by scrapy to understand them.
I would request you to try with BeautifulSoup , it might be a bit more helpful to you.
I hope I’ve cleared your doubt. I ask you to please rate your experience here
Your feedback is very important. It helps us improve our platform and hence provide you
the learning experience you deserve.
On the off chance, you still have some questions or not find the answers satisfactory, you may reopen
the doubt.