How to Run a Scrapy Spider from a Python Script
Scrapy is a framework for building web crawlers and includes an API that can be used directly from a python script. The framework includes many components and options that manage the details of requesting pages from websites and collecting and storing the desired data. The typical way to run scrapy is to use the …