I wanted to scrape some weather information from weather.com website and built a scraper for it using scrapy. Now i want selenium to search in the search input of the website about the next state i want to get the web page of to scrape data for that particular state/city. I am not able to do it the only data i get is the url i defined as the start_url and i have scraped info for New delhi and now i want to scrape for Jaipur but only New delhi data is being saved. How can i do this? Please help!
Scrapy and Selenium
Please help me out someone.