Data Analysis Assessment for SG the Data Scientist role.
- Python 3.9
- Conda 22.9.0
- Jupyter
- IDE: Visual Studio Code
- clone Repo
- Create conda environment
conda env create -f environment.yml
- Run data_preprocessing.py file
python data_preprocessing.py
- Run each notebook either using Jupyter Lab or from command line:
cd notebooks
ipython -c "%run part1.ipynb"
├── ...
├── data_preprocessing.py # file that will preprocess the raw dataset that is given as input
├── data
│ ├── assignment_preprocessed.csv # dataset after being preprocessed in data_preprocessing.py
│ └── assignment_rev2.csv # raw dataset
├── notebooks # jupyter notebooks - one for each assignment part
│ ├── part1.ipynb
│ ├── part2.ipynb
│ ├── part3.ipynb
│ └── statistics_visualization.ipynb # jupyter notebook with some basic stats from the preprocessed dataset