hreluz / go-image-scrapper

Web Image Scraper in Golang

Description

This command-line application scrapes images from websites using CSS selectors. It emphasizes responsible usage, requiring users to ensure they have proper authorization or ownership of the website before scraping.

Features

• CSS Selector Based Scraping: Specify CSS selectors to target specific images on web pages.
• Permission Verification: Users are reminded to only scrape images from websites they own or have obtained prior permission to scrape.
• Concurrent Scraping: Efficiently fetch images using Go's concurrency features.
• Configurable Output: Define output directory and file naming conventions.

Notes on Usage

• Compliance: Ensure compliance with legal and ethical guidelines regarding web scraping. Respect robots.txt rules and website terms of service.

• Permission: Only scrape images from websites you own or have explicit permission to scrape. Respect intellectual property rights and privacy concerns.

Contributing

Contributions are welcome! If you have any ideas for improvements, feature requests, or find any issues, please open an issue or pull request. Contributions should align with the project's goals of ethical and responsible web scraping practices.

License

This project is licensed under the MIT License. Feel free to use, modify, and distribute the code, respecting the terms specified in the license.

Disclaimer

This application is intended for educational and ethical use cases. The authors assume no liability for any misuse or unethical use of this software. Users are responsible for adhering to legal requirements and respecting the rights of website owners and users.