trort / spark_ver_bigdatahw_jiuzhang

Homework for the Big Data course at Jiuzhang, re-written in Python and Spark!

Project: Rewriting Jiuzhang Big Data course projects in Spark

The original homework and reference answers are here. The course introduces the concept and use of Hadoop MapReduce framework, and implemented a few widely-used algorithms in Java.

This project aims to rewrite those algorithms in PySpark, which is much more flexible and much simpler to write and read.

Environment

The Jupyter notebooks here are developed and tested on the Docker container with Jupyter and PySpark installed, provided by Jupyter. Those programs should also run on other Spark-installed machines.

spark_ver_bigdatahw_jiuzhang's Issues

hi, do you have code of the front end of those project ?

Hi, thanks for your project code, they helps a lot! But do you have the code of the front end of those projects along with the course? And if yes ,do you mind share with me those code?