[BUG] Application Web UI unavailable about spark-standalone-cluster-on-docker

[rareal]

It looks like the Web UI is started by the SparkContext
https://spark.apache.org/docs/latest/monitoring.html
"Every SparkContext launches a Web UI, by default on port 4040, that displays useful information about the application"

As you start the SparkContext on the jupyterlab container, I guess that's the one that will have the server and hence needs the port binding.

[alexeyegorov]

@rareal Thanks for this hint! Logic is so helpful! :)
Nevertheless, I mean... probably as this is not a special case, but the ordinary usage of this docker image I think it might be helpful to add this single line to the docker-compose.yml file. I can do that and prepare a pull request. Does it make sence?

[rareal]

I think it makes sense, yes.
There's a Contributing ref too, I might contribute a windows build script later, if time permits :)

[alexeyegorov]

Adding 4040:4040 as port for jupyterlab service solves the issue. I don't quite understand why... does anybody else have this problem at all?

[alexeyegorov]

@rareal what is might be changed for Windows build script? For Mac OS I would just need to adjust the existing build script. Will you write a new one for the windows shell? That would be awesome, btw. Couple of colleagues are using windows and would really appreciate your work. :)

[rareal]

I'd write a powershell script, adapt the yml parsing (powershell also does not have a built in yml parser) and the rest seems pretty straightforward to adapt too

[andre-marcos-perez]

Hey @alexeyegorov and @rareal the solution proposed by #41 works like a charm. I'll be merging #41 to the develop branch for the next release! Thanks both for the contribution. @rareal I will accessing the #43 anytime soon.

[andre-marcos-perez]

@alexeyegorov and @rareal if you would like to be featured on the contributors, feel free to submit a pr on the README file, just make sure to follow the pattern.