kitlangton / assignment_web_scraper

Bottom feeding your way across the web

assignment_web_scraper

Bottom feeding your way across the web

A Ruby-based web scraping and parsing project which uses NokoGiri, Mechanize, Open-uri. From the Viking Code School.

Kit & Kelsey

query address: "https://www.dice.com/jobs?q=#{serch+term}"

scraper.history_added = Proc.new { sleep 0.5 }

https://www.dice.com/jobs/q-#{query}-limit-120-startPage-#{page}-limit-120-jobs

increment page until .err_p text = 404

Increment Page-#{i} until 404'ed! https://www.dice.com/jobs/q-rails-limit-100-jobs.html

Short description goes here

• Employer
• Location
• Date Posted