GithubHelp home page GithubHelp logo

cybersecrs / ripli Goto Github PK

View Code? Open in Web Editor NEW
1.0 2.0 1.0 55 KB

Ripli Downloader for HACKTOBERFEST-2020 - Starting on October 3th, 2020

Home Page: https://www.github.com/cybersec/ripli

License: MIT License

Ruby 98.71% Shell 1.29%
hacktoberfest2020 hacktoberfest ruby proxychains proxy-scrapper

ripli's People

Contributors

cybersecrs avatar ml-dalos avatar

Stargazers

 avatar

Watchers

 avatar  avatar

Forkers

ml-dalos

ripli's Issues

Complete list of proxies

After proxies are tested, they should be placed into one list, besides default ones.
I'am still thinking about the best way to separate different countries, one way that I think is ok would be to create list as CSV,
then to make script to export from csv to proxychains list without countries. Maybe even to create new proxychains.conf file and copy it directly to /etc/proxychains.conf

Add more sites to scrap proxies #2

Create separate class/file for each site. Proxies must be in form of type ip port, saved in separated files.
Code can be edited as number of sites grow, but must keep structure of each site - each file.

Test each proxy

Check each proxy for IP address country, and data leak. Tomorrow I will add one or two ways how this could be done (web api, ruby server, ngrok...)

Add superclass

@ml-dalos , I got error with frozen_string, so I pushed back old branch, with one more site, which use same functions as proxyscrape. If you want check it, if not I will do it based on your previous pull request.

edit: I think it's better way to scrap everything, then if needed export proxies with regexp, unless website is like proxyscrape, to get all list at once. That way ripli would work if website change some html/css (tell me if I'am wrong). We should test which way is faster, because with more sites added it will be more important.

Hacktoberfest-2020

Everything is explained in readme file.
This is simple project I want to do during Hacktoberfest, with some tutorials about web scrap with Ruby, and Proxychains for Linux users. After all, it will be something useful for all Linux users, or at least to me :) I found it's dam hard to find free list with huge number of proxies in proxychains format, so I want to do it on my own.
Happy hacking!

Edit proxyscan class

There was conflict between branches so now ProxyScan should be rewritten to work with superclass

Tutorials about Ruby web scrapping

There's many tutorials online, but I want to create this in Serbian language (after English).
Tutorials should explain in short terms how it work, and show examples for different types.
This should contain example code for different ruby gems and their best use case (simple scrap, JavaScript etc...)
Quality over Quantity, any help is appreciated.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.