buildhacksecure / gitscraper

A tool which scrapes public github repositories for common naming conventions in variables, folders and files

gitscraper

These are the results of scraping 176,734 GitHub repos and 35,958,908 individual files for commonly occurring strings which can be used for fuzzing.

It was created by grepping php files for particular patterns but can be used against any web stack.

The results have been processed and ordered from the most frequently found at the top to least at the bottom.

files.txt

This is the filename of the individual php file

folders.txt

This is the folder name that the php file was found in.

headers.txt

These are headers that the web application requests.

methods.txt

These are function names within the php application.

routes.txt

These are routes which are defined in the 3 most popular php frameworks.

params.txt

These are parameters that the web application looks for in the request body or query string.

gitscraper's Issues

Call to undefined function curl_init()

Not sure what the issue is, providing username as first argument and personal key as second argument.

$ php gitscrape.php <USERNAME> <PERSONAL KEY>
Viewing Since: 0
PHP Fatal error:  Uncaught Error: Call to undefined function curl_init() in /home/ubuntu/tools/gitscraper/gitscrape.php:34
Stack trace:
#0 /home/ubuntu/tools/gitscraper/gitscrape.php(99): Http->__construct('https://api.git...')
#1 {main}
  thrown in /home/ubuntu/tools/gitscraper/gitscrape.php on line 34

PHP Fatal error: Uncaught Error: Call to undefined function curl_init() in /opt/gitscraper/gitscrape.php:34

Congrats for this amazing tool =-)
i'd like to another users knows that they will have to install curl module on php if they havent yet.
Without it, the scripts will throw an error
The command bellow resolves the issue
sudo apt-get install php-curl

Thanks!