Arik Chakma
274082fd77
* refactor: clean to roadmap content * refactor: move shared helpers into scripts/lib
9 lines
718 B
Markdown
9 lines
718 B
Markdown
# scrapy
|
|
|
|
Scrapy is a Python framework for large-scale web scraping. Unlike BeautifulSoup, which parses individual pages, Scrapy manages the full crawling workflow: following links, handling pagination, managing request queues, and exporting data. It is used when scraping requires collecting data from many pages across a site.
|
|
|
|
Visit the following resources to learn more:
|
|
|
|
- [@official@Scrapy Docs](https://docs.scrapy.org/en/latest/)
|
|
- [@article@A Minimalist End-to-End Scrapy Tutorial (Part I)](https://medium.com/data-science/a-minimalist-end-to-end-scrapy-tutorial-part-i-11e350bcdec0)
|
|
- [@video@Scrapy for Beginners - A Complete How To Example Web Scraping Project](https://www.youtube.com/watch?v=s4jtkzHhLzY) |