Semi-Structured (JSON), Structured and Unstructured Data Analysis with Spark and Python & Spark Performance Tuning
- Apache Spark’s framework, execution and programming model.
- Lazy evaluations (Narrow vs Wide transformation) and internal working of Spark.
- PySpark practices on structured, unstructured and semi-structured data using RDD, DataFrame and SQL.
- Build simple to advanced Big Data applications for different types of data (volume, variety, veracity) through real case studies.
- Apply Adaptive Query Execution (AQE) to optimize Spark SQL query execution at runtime