Spark 1.2 Configuration Incorrect about emr-bootstrap-actions

[christopherbozeman]

The spark-shell will default to local and basic instance of Spark on EMR also uses the Spark defaults. I recommend taking a look at the "-x" argument with "install-spark" at the readme https://github.com/awslabs/emr-bootstrap-actions/blob/master/spark/README.md. This argument will preconfigure Spark to use the entire cluster as it was set at creation of the cluster.

Then try spark shell as:
MASTER=yarn-client /home/hadoop/spark/bin/spark-shell

[8evers]

HI,

I did try the -x argument as well without any luck, however I suspect that this was related to issue 38 and the changes you made 3 hours ago seem to have fixed the issue

Thanks