Webscrapping Project
Python env - webscrapping conda env - webscrapping
A. Steps
- Import packages needed
- Data extraction with the help of an API key Header , URL , request
- Pass Number two to BeautifulSoup
- Transform data - fetch the information you need from the web page
- create an empty data structure or list to hold the data
- Handle pagnation in order to fetch multiple pages of data
- create a dataframe for the data fetched and transformed
- check for duplicates in the data
- Export this data to csv
Sites: Indeed Google - serapi Timejobs