imhamza333 / project-scraping

Overview

Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing. in this project, i am learning about scrapy and understanding the basic concept of scrapy.

Scrapy is maintained by Zyte (formerly Scrapinghub) and many other contributors.

Check the Scrapy

Homepage at Scrapy for more information, including a list of features.

Requirements

Python 3.6+ Works on Linux, Windows, macOS, BSD Install

The quick way:

pip install scrapy

See the install section in the documentation at

For more details

Documentation

Documentation is available online at here and in the docs directory.