How to Install Scrapy on PyCharm?

by

Scrapy is an open-source Python library to extract data from websites, i.e., web scraping.

Problem Formulation: Given a PyCharm project. How to install the Scrapy library in your project within a virtual environment or globally?

Here’s a solution that always works:

  • Open File > Settings > Project from the PyCharm menu.
  • Select your current project.
  • Click the Python Interpreter tab within your project tab.
  • Click the small + symbol to add a new library to the project.
  • Now type in the library to be installed, in your example "scrapy" without quotes, and click Install Package.
  • Wait for the installation to terminate and close all popup windows.

Here’s the installation process as a short animated video—it works analogously for Scrapy, just type in “scrapy” in the search field instead:

Make sure to select only “Scrapy” because there are many other packages that are not required but also contain the term “scrapy” (false positives):

Alternatively, you can run the pip install scrapy command in your PyCharm “Terminal” view:

$ pip install scrapy
"pip install scrapy" PyCharm

Feel free to check out the following free email academy with Python cheat sheets to boost your coding skills!

To become a PyCharm master, check out our full course on the Finxter Computer Science Academy available for free for all Finxter Premium Members: