# scrapy

Scrapy is a Python framework for large-scale web scraping. Unlike BeautifulSoup, which parses individual pages, Scrapy manages the full crawling workflow: following links, handling pagination, managing request queues, and exporting data. It is used when scraping requires collecting data from many pages across a site.

Visit the following resources to learn more:

- [@official@Scrapy Docs](https://docs.scrapy.org/en/latest/)
- [@article@A Minimalist End-to-End Scrapy Tutorial (Part I)](https://medium.com/data-science/a-minimalist-end-to-end-scrapy-tutorial-part-i-11e350bcdec0)
- [@video@Scrapy for Beginners - A Complete How To Example Web Scraping Project](https://www.youtube.com/watch?v=s4jtkzHhLzY)