GithubHelp home page GithubHelp logo

kalebu / website-images-spider Goto Github PK

View Code? Open in Web Editor NEW
10.0 3.0 7.0 4 KB

A scraper for downloading all downloadable images on a given website

Home Page: https://kalebujordan.dev/

Python 100.00%
python python-project webscraping python-webscraping-application beautifulsoup4 requests python-project-beginner python-tanzania

website-images-spider's Introduction

Website-Images-Spider

The repo consists of a source of for scraper made in python for downloading/scraping all public available images from a given website.

How it works

Once you specify the website, the scraper will scans through out a given website to find all public available tlinks and dive into all of those to find if there is any downloadable image , If there is , it will automatically download it and save on your local directory.

Getting started

To get started using this tool, firstly clone or download the repository to your computer just as shown below;

$-> git clone https://github.com/Kalebu/Website-Images-Spider

Dependancies

Before you begin playing this project, I recommend you to install the following dependencies first

$-> pip install bs4, requests, pillow

Move into the Project directory

Navigate into your project repository either by using cd commands or by opening a terminal inside a project repository.

$-> cd Website-Images-Spider
$ Website-Images-Spider-> python app.py
Enter URL with images : 

Enjoy downloading the images

Now once you run the script, it will prompt you to enter a url for a specific website you would like to scrap the images from and then once done, take a coffe while you wait for the images to be downloaded.

Note

This script doesn't work very well with website with a bunch of JS

Issues

Incase you have any difficulties or issues while trying to run the script you can raise it on the issues.

Pull Requests

If you have something to add I welcome pull requests on improvement , you're helpful contribution will be merged as soon as possible

Give it a Star ✴️

If you find this repo useful , give it a star

Credits

All the credits to kalebu

website-images-spider's People

Contributors

kalebu avatar kalebujordan avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.