words-sdsc / coursera

Data sets and scripts for Coursera Big Data Specialization.

Data sets and scripts for Coursera Big Data Specialization.

https://www.coursera.org/specializations/bigdata

coursera's Issues

Variant for Ubuntu

My main machine is running Ubuntu 17.10, I could not run the VM described in course, so I had a few alternatives:

1. Install Docker on my machine and get the cloudera image (too slow)
2. Rent an Ubuntu VM on Google Cloud, and install Docker then get cloudera image (too expensive)
3. Rent a Centos VM on Google Cloud, and install Cloudera packages on it (Confusing commands compared to Ubuntu, and no GUI available for third exercise)
   it there a way I could install those examples of a Debian based machine?

thanks

big-data-2.zip cannot be downloaded

after clicking the download button, web browser displays: Unable to connect
Firefox cannot establish a connection to the server at raw.githubsercontent.com

besides, coursera-master.zip can be downloaded in wiondows operation system, but how to share the downloaded file into VBox?

psql: could not connect to server: No such file or directory Is the server running locally and accepting connections on Unix domain socket "/tmp/.s.PGSQL.5432"?

Hi,

Could you help me with the error that appears? This happens when i try to install Anaconda in big-data-3.
I tried to restart it but it didn't

Thanks

Big data

Pyhton in worker and in driver has different versions

Hello,

I have the following error while trying to execute lines.count() :
Python in worker has different version 2.6 than that in driver 3.5, PySpark cannot run with different minor versions

Do you have a solution to fix it ?

Please update Course and this repo

big-data-4/setup.sh leads to ERROR: certificate common name "ssl4689

The following error is reported when running big-data-4/setup.sh:
ERROR: certificate common name "ssl468914.cloudflaressl.com" doesn't match requested host name "repo.continuum.io". To connect to repo.continuum.io insecurely use '--no-check-certificates'. bash : Anaconda3-4.0.0-Linux-x86_64.sh: No Such file or directory Run 'source ~/.bashrc' to complete setup.

env: jupyter: No such file or directory

Working on cloudera VM for windows, course 3, week1, trying to set up spark with jupyter notebooks.

After installing scripts and supposedly anaconda with jupyter support (./setup.sh) and after sourcing bashrc, while trying to run pyspark I am getting error:
env: jupyter: No such file or directory

I tried to install some components manually but it didn't help. Does anyone know how to go through this step?

Big data

Coursera

Cant extract the big-data-2.zip file

It is showing the zip file exists but is "not directory". It also shows that it is unable to process it.

[Temporal Fix/ Turn-around] Jupyter not found and other Anaconda-related issues

Hi,

For those of us having these errors, it's impossible to move forward with the installation, at least not following Coursera's deprecated instructions.

I've done the following in the same VM where I downloaded the big-data-3 datasets, and it will allow us to install Anaconda (and therefore Junyper) and actually do the requested tasks using Junyper.

Steps:

1. Download the Official Anaconda Installer https://repo.anaconda.com/archive/Anaconda3-2019.10-Linux-x86_64.sh

2. go to the directory where it's located, in my case:
   cd Downloads

3. install it:
   ./Anaconda3-2019.10-Linux-x86_64.sh

NOTE: You will notice that you can see the text, prompts and notifications you were supposed to see during a normal installation.

4. close current terminal, open a new one and execute pyspark as requested by the exercise's instructions.

5. Now you should be able to enter in Juypyter Notebook and do tasks on http://localhost:8889/

That's it, I hope it helps.

Path of csv files is hardcoded

The path for the csv files is hardcoded.

I'm opening this issue but I already have the fix for this. I'm checking how can I generate a pull request for it

Error in Course VM, when trying to run PySpark

$ pyspark
jupyter: '/home/cloudera/anaconda3/bin/find_spark_home.py` is not a Jupyter command
'/home/cloudera/anaconda3/bin/pyspark: line 24: /bin/load-spark-env.sh: no such file or directory
'/home/cloudera/anaconda3/bin/pyspark: line 77: /bin/spark-submit: No such file or dir 
'/home/cloudera/anaconda3/bin/pyspark: line 77: exec: /bin/spark-submit: cannot execute: No such ...

While trying to run through the Coursera course Machine Learning with Big Data

I am working around this by just properly setting up a seperate environment.. but thought I should warn you, the VM as is doesn't work for PySpark. Also, it is a security risk to be using such an old VM.. I recommend performing a $ sudo yum update in the instructions OR recommend a newer VM image.