GithubHelp home page GithubHelp logo

tierre0703 / bustabit_finance_scraper Goto Github PK

View Code? Open in Web Editor NEW

This project forked from dpandev/bustabit_finance_scraper

0.0 0.0 0.0 3.38 MB

scraper tool that fetches finance data from bustabit games

Python 100.00%

bustabit_finance_scraper's Introduction

Bustabit Finance Scraper (with Python)

Scrapes historical game data from the bustabit site and exports data into a CSV.

This project utilizes the python libraries Selenium, BeautifulSoup, and Pandas. The script scrapes data from each game listed on the site with a user-defined starting game number and number of games (to scrape). There is a random delay which prevents the scripts from sending too many requests to the site.

The Mozilla GeckoDriver is also used in pair with Selenium.


Running the Script

First, install the requirements. (Also make sure to download the correct version of GeckoDriver for your specific OS and place it in the project directory).

$ pip install -r requirements.txt

Edit the following variables in options.txt to scrape specific games in a chronologically increasing order.

starting_game = 2351255
number_of_games = 2

Run the script.

$ python bustabit_scraper.py  (for Mac OS)

$ python.exe bustabit_scraper.py  (for Windows)

That's it.

The script will export the data to a CSV in the project directory.


Additional Exporting Options

If you want to export specific user data from the site, edit the options.txt based on the instructions below:

To export game history data of a specific user:

specific_user = True  (set value to True)
user_name = username_example  (replace with username)

You can also choose which data to extract and export to CSV: (Each value represents a specific column of data)

games  = true   //specific game id
dates = true    //date of the specific game
times = true    //time of the specific game
bustaNums = true //number at which game busted
users = false   //to list all users that participated in game
bets = true     //bet amount (in bits)
cashedOut = true //cash out multiplier
profits = true  //profit amount (in bits)
betNums = true  //specific bet id

Make sure to save the changes made to options.txt before running the script!

bustabit_finance_scraper's People

Contributors

dpandev avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.