hongyingyue / sql_project_data_job_analysis

SQL project; job posting data analysis

Introduction

📊 Dive into the data job market! Focusing on data analyst roles, this project explores 💰 top-paying jobs, 🔥 in-demand skills, and 📈 where high demand meets high salary in data analytics.

🔍 SQL queries? Check them out here: project_sql folder

Background

Driven by a quest to navigate the data analyst job market more effectively, this project was born from a desire to pinpoint top-paid and in-demand skills, streamlining others work to find optimal jobs.

Data hails from SQL Course. It's packed with insights on job titles, salaries, locations, and essential skills.

The questions to answer through SQL queries were:

1. What are the top-paying data analyst jobs?
2. What skills are required for these top-paying jobs?
3. What skills are most in demand for data analysts?
4. Which skills are associated with higher salaries?
5. What are the most optimal skills to learn?

Tools I Used

Following the course

For my deep dive into the data analyst job market, I harnessed the power of several key tools:

• SQL: The backbone of my analysis, allowing me to query the database and unearth critical insights.
• PostgreSQL: The chosen database management system, ideal for handling the job posting data.
• Visual Studio Code: My go-to for database management and executing SQL queries.
• Git & GitHub: Essential for version control and sharing my SQL scripts and analysis, ensuring collaboration and project tracking.

The Analysis

Only demonstrate Question 1

1. Top Paying Data Analyst Jobs

SELECT
    job_id,
    name AS company_name,
    job_title,
    job_location,
    job_schedule_type,
    salary_year_avg,
    job_posted_date    
FROM
    job_postings_fact
LEFT JOIN company_dim ON job_postings_fact.company_id = company_dim.company_id
WHERE
    job_title_short = 'Data Analyst' AND
    job_location = 'Anywhere' AND
    salary_year_avg IS NOT NULL
ORDER BY
    salary_year_avg DESC
LIMIT 10

Here are three insights from the data:

• Significant Salary Variability: The salaries for data analyst roles vary widely, from $184,000 to $650,000, indicating significant differences in role responsibilities, company value, and industry standards.
• Senior Roles Command Higher Pay: Senior positions such as "Director of Analytics" and "Associate Director- Data Insights" generally offer higher salaries compared to standard data analyst roles, reflecting the increased responsibilities and expertise required.
• Consistent Demand Across the Year: The job postings are spread throughout 2023, suggesting a steady demand for data analysts across different sectors, including tech, healthcare, and finance.

Bar graph visualizing the salary for the top 10 best paying jobs for Data Analyst; ChatGPT generated this graph from my SQL query results

6. Top 10 demanded skills for Data Engineer

NO.	Skills	Demand Count	Demand Percent
1	SQL	113,375	60.7%
2	Python	108,265	58.0%
3	AWS	62,174	33.3%
4	Azure	60,823	32.6%
5	Spark	53,789	28.8%
6	Java	35,642	19.1%
7	Kafka	29,163	15.6%
8	Hadoop	28,883	15.5%
9	Scala	28,791	15.4%
10	Databricks	27,532	14.7%

Based on the provided data regarding the top 10 skills demanded for Data Engineers, we can derive the following key insights:

• SQL and Python Proficiency: SQL and Python are the top two most in-demand skills among Data Engineers, with demand counts of 113,375 and 108,265, respectively. Both skills have high demand percentages, indicating their critical importance in data engineering roles. SQL is essential for querying and managing data within databases, while Python is versatile for data manipulation, scripting, and automation tasks.

• Cloud Computing Skills: Cloud computing platforms such as AWS and Azure are among the top skills demanded for Data Engineers, with demand counts of 62,174 and 60,823, respectively. This underscores the growing reliance on cloud-based infrastructure for data storage, processing, and analytics tasks within data engineering roles.

• Big Data Technologies: Skills related to big data technologies such as Spark, Hadoop, and Kafka are also prominently featured among the top demanded skills for Data Engineers. These technologies enable the processing and analysis of large volumes of data, highlighting the importance of big data expertise in data engineering roles.

Additionally, familiarity with specific tools and platforms such as Databricks and Scala can enhance a Data Engineer's skill set and marketability in the industry.

What I Learned

TBC

Conclusions

1. The salaries for data analyst roles vary widely, from $184,000 to $650,000.
2. The job postings are spread throughout 2023, suggesting a steady demand for data analysts across different sectors, including tech, healthcare, and finance.

Closing Thoughts

Good course!