lorenzolacorte / internship-scraper

Engineering Internships Scraper, developed to scrape european tech internships.

Hi everyone! I am Lorenzo La Corte, a Software Security and Engineering Student from Genoa, Italy.

📫 Contact Me on Social Media

LinkedIn | Instagram | ✉️ Email | 💬 Issue me about everything!

💡 What I am currently working on

• Master's Thesis Research - Research Internship at the Okinawa Institute of Science and Technology, from April to September 2024.

  Networked Quantum Devices Unit - Thesis on Optimization of Quantum Repeater Chains

• (just finished) MSc Second Year Courses: High Performance Computing, Binary Analysis and Secure Coding, Capstone Project and Blockchain and Distributed Ledger.

• European Tech Internships Repository and European Tech Internships Scraper: a collection and a scraper for european tech internships.

• CTFs, programming competitions, hackatons, ...

• Interested in new grad and PhD positions 👀

📚 Articles

Here you can find a list of my university projects 📖.

internship-scraper's Issues

Divide cities into two different files

Divide cities into two different files: general ones as they are now (a list that can contain all cities you want), and the ones specific for indeed, as this it accepts only some cities that you can check here: JobSpy.

Explore additional data sources

Explore additional data sources: expand our scraping capabilities beyond city-based data to include company-based data. This may involve scraping from company career sites or LinkedIn research filtered by specific companies.

Add Indeed Contributions

Similar to our LinkedIn scraping, implement scraping for Indeed job postings.

Generalize different scraping configurations in a unique branch

Now, we have several branches for several configurations.

• make constant.py file parametric,
• run one action per configuration, creating different tables
• update the main repository to scrape directly from the several tables

also:

• remove the backups

Rework Passing of Data

Instead of storing data as lines in .txt files, pass pandas DataFrames through scripts for more efficient data management.