Challenge - Scrape a Book Store!

anas_cb19 · February 20, 2021, 6:25am

Code Link: https://ide.codingblocks.com/s/427201

Why I’m getting only 33% of the total on submission?

While scraping I run : scrapy crawl books_spider -o “books_store.csv”

prashant_ml · February 20, 2021, 6:55am

hey @anas_cb19 ,
can you please share your submission file.
I guess i need to check that.

anas_cb19 · February 20, 2021, 8:01am

github.com

healer9/Web-Scrapping/blob/main/Assignments/Assignment-1/bookStore/books_store.csv

image_url,book_title,product_price
../media/cache/2c/da/2cdad67c44b002e7ead0cc35693c0e8b.jpg,A Light in the ...,£51.77
../media/cache/26/0c/260c6ae16bce31c8f8c95daddd9f4a1c.jpg,Tipping the Velvet,£53.74
../media/cache/3e/ef/3eef99c9d9adef34639f510662022830.jpg,Soumission,£50.10
../media/cache/32/51/3251cf3a3412f53f339e42cac2134093.jpg,Sharp Objects,£47.82
../media/cache/be/a5/bea5697f2534a2f86a3ef27b5a8c12a6.jpg,Sapiens: A Brief History ...,£54.23
../media/cache/68/33/68339b4c9bc034267e1da611ab3b34f8.jpg,The Requiem Red,£22.65
../media/cache/92/27/92274a95b7c251fea59a2b8a78275ab4.jpg,The Dirty Little Secrets ...,£33.34
../media/cache/3d/54/3d54940e57e662c4dd1f3ff00c78cc64.jpg,The Coming Woman: A ...,£17.93
../media/cache/66/88/66883b91f6804b2323c8369331cb7dd1.jpg,The Boys in the ...,£22.60
../media/cache/58/46/5846057e28022268153beff6d352b06c.jpg,The Black Maria,£52.15
../media/cache/be/f4/bef44da28c98f905a3ebec0b87be8530.jpg,Starving Hearts (Triangular Trade ...,£13.99
../media/cache/10/48/1048f63d3b5061cd2f424d20b3f9b666.jpg,Shakespeare's Sonnets,£20.66
../media/cache/5b/88/5b88c52633f53cacf162c15f4f823153.jpg,Set Me Free,£17.46
../media/cache/94/b1/94b1b8b244bce9677c2f29ccc890d4d2.jpg,Scott Pilgrim's Precious Little ...,£52.29
../media/cache/81/c4/81c4a973364e17d01f217e1188253d5e.jpg,Rip it Up and ...,£35.02
../media/cache/54/60/54607fe8945897cdcced0044103b10b6.jpg,Our Band Could Be ...,£57.25
../media/cache/55/33/553310a7162dfbc2c6d19a84da0df9e1.jpg,Olio,£23.88
../media/cache/09/a3/09a3aef48557576e1a85ba7efea8ecb7.jpg,Mesaerion: The Best Science ...,£37.59
../media/cache/0b/bc/0bbcd0a6f4bcd81ccb1049a52736406e.jpg,Libertarianism for Beginners,£51.33

This file has been truncated. show original

prashant_ml · February 20, 2021, 9:09am

your code is not retrieving the full title of the book.
the titles are having .... in there ends.
just correct that it will work

anas_cb19 · February 20, 2021, 9:41am

After the correction you mentioned above, now it shows a 98% score😔 …

prashant_ml · February 20, 2021, 10:43am

that really good.
The other 2% might be due to media paths.

i suggest you to work with beautiful soup to score 100

prashant_ml · February 25, 2021, 6:26pm

I hope I’ve cleared your doubt. I ask you to please rate your experience here
Your feedback is very important. It helps us improve our platform and hence provide you
the learning experience you deserve.

On the off chance, you still have some questions or not find the answers satisfactory, you may reopen
the doubt.

1rn18cs002.abhinav · May 29, 2021, 2:59pm

This url gives 98% accuracy because of the change in the image url
http://books.toscrape.com/catalogue/page-1.html

This is the correct url which gives 100% result
http://books.toscrape.com/

last url gives first 20 image in this format so it achieves 100% accuracy
media/cache/2c/da/2cdad67c44b002e7ead0cc35693c0e8b.jpg
vs
first url gives first 20 image in this format so it achieves 98% accuracy
…/media/cache/2c/da/2cdad67c44b002e7ead0cc35693c0e8b.jpg

I hope this helps you