lukevibes / intelligent-job-scrapper

Find out what skills are associated to your dream job using this intelligent web scrapper that crawls Canada's top job posting websites.

Intelligent Job Scrapper

This project crawls and scraps Canada's most popular job posting websites to see what skill are associate with your a specific technology-based job.

Note: This project was reposted from the original repository. This was a collaborative project and I did not build it alone.

Table of Contents

• About The Project
• Getting Started
  • Prerequisites
  • Setup
    • Server
    • Web Client
• Usage
• Contributors
• Contact

About The Project

Note: This repository is a duplicate of the original project. I decided to duplicated so I could have more control over the read-me file you are reading now. Please acknowledge that guzbandu and sahajarora1286 both contributed in making this awesome project a reality. If you want to see the original please check it out here.

This project crawls a handful of job posting websites that are popular in Canada and, provided a job title term like: 'Database Engineer' or 'Data Scientist' scraps relevant job posting to see what are the top skills that are currently popular with said job.

This project is a fullstack project as it implements a REST back-end and front-end system.

As a recent computer science grade, I thought this project was really useful because it seems every company has a different preference of technologies to master so understanding what skills are appreciated across multiple industries is really helpful.

Getting Started

This project was developed with Java and a slew of other technologies. Please Follow the instructions bellow carefully to download and run the project. If you have any issues please feel free to email me at [email protected] . I would be happy to help or fix any issues you run into.

Prerequisites

Here the things you need to run the code:

• Java 8

npm install java

• Maven

npm install maven

• Ionic and Cordova

npm install -g ionic cordova

• Node.js 8.4: download

• MongoDB : download

• Studio 3T: download

• Eclipse Neon: download

Setup

Server

1. Clone the repo

git clone https://github.com/LukeVibes/PopularMusicAI

2. Download all the prerequisite goodies.
3. Open project with Eclipse Neon
4. Right click the project then choose Maven -> Update Project before running the project
5. From the Web perspective click on the Servers tab, select Tomcat v7.0 and right click. Choose the add and remove... menu option. Be certain that the COMP4601-Project is added to the server.
6. Start the server

Web Client

Awesome, next step is running the Web Client! To do that:

1. In the terminal, navigate to the root of this project (/ProjectClient/project), and run the following command to download the required modules:

npm install

2. In the terminal, navigate to the root of this project (/ProjectClient/project), and run the bellow command to launch this app in a browser. This command launches a static file server at a URL like "http://localhost:8003/index.html". Your URL might be different than this. You can check the URL in the output within the terminal.

ionic cordova run browser

3. To find your URL, Look for the line that reads

Static file server running @ ...

4. If the app did not automatically open up in a browser, then open a browser, enter the static file server URL (obtained from the output in terminal) and hit Enter.

Usage

Please follow the steps in Setup to properly have the Server and Client running before proceeding with this section.

Great, so now that you have all the good stuff running head to we front-end client website and follow the steps bellow to try-out the program!

1. From within the web client select a skill.
2. Click on "Find Relevant Skills (Database)" button.
3. View the related skills and their relevance in the Chart that is presented.

Contact

Luke Daschko - @lukeduker - [email protected]

Project Link: hhttps://github.com/LukeVibes/Intelligent-Job-Scrapper