View Code? Open in Web Editor
NEW
A simple WebCrawler for exploring and downloading content from web pages within a given domain/url.
License: MIT License
Python 39.94%
HTML 60.06%
web-crawler's Introduction
A Simple WebCrawler Made In Python for exploring and downloading content from web pages within a given Domain/URL.
- This Tool Crawls The Given URL/Domain And Collects The HTML File Of Each WebPage And Compresses Them Into Zip Archive For Downloading.
- My First Original Tool ^_^
apt update -y
apt upgrade -y
pkg install python -y
pkg install git
git clone https://github.com/Th3-C0der/Web-Crawler
ls
cd Web-Crawler
pip install -r requirements.txt
cd Web-Crawler
python main.py
- Open This Url On Your Browser
http://127.0.0.1:5000
- To Update Script โ
python update.py
web-crawler's People
Contributors
Stargazers
Watchers