GithubHelp home page GithubHelp logo

mehulcoder / internshala_scraper Goto Github PK

View Code? Open in Web Editor NEW
3.0 2.0 0.0 67 KB

Tired of looking up for your internship application status in Insternshala by scrolling and switching to different pages again and again? So, this one's for you. A simple webscraping tool which will extract the required data for you and put it into a csv file, in a structured and sorted format.

JavaScript 100.00%
nodejs scraper webscraping internshala tool cookies csv

internshala_scraper's Introduction

internshala_scraper

Tired of looking up for your internship application status in Insternshala by scrolling and switching to different pages again and again?

So, this one's for you. A simple webscraping tool which will extract the required data for you and put it into a csv file, in a structured and sorted format.

Open to suggestions for upcoming versions

Getting Started

Prerequisites

You should have the following installed on your local machine:

NodeJs
npm
Terminal

Below are the download links for the same:

Install them and then move to the next step.

Installing

  • Download and extract the repository.

  • Start terminal and change working directory to the extracted repository.

  • Make sure your current working directory contains the file named index.js

  • To install the required dependencies, inside the terminal, run command npm install

Running

  • Say your email address is [email protected] and password is password. (You'll be having something different, use yours only)
  • Using the terminal run command node index.js [email protected] password

Basically you have to provide credentials as the arguments while running the application.

  • Wait for a few seconds till you see a output.csv file in your directory.
  • DONE !!! Just open the output.csv file and you have all your required data. You can sort it in MS Excel or any other application

Built With

  • NodeJs

  • npm dependencies used:

    • "request-promise": "^4.2.5" : To send requests.
    • "ora": "^4.0.4", : For loading animation.
    • "json2csv": "^5.0.1": For creating .csv file

Authors

Acknowledgments

This was something which I had in my mind from a very long time. I didn't now stuff back then so wasn't able to come up with anything. This was really a fun project, got to learn a lot, about cookies and stuff and so much more.

I tried to make this README as detailed as possible. If you have any queries or suggestions you can E-mail me at [email protected] or [email protected].

internshala_scraper's People

Contributors

dependabot[bot] avatar mehulcoder avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.