Tool for using Spark to copy URLs to a cluster in parallel.
Builds using Apache Maven. Run mvn package to build, and
run with spark-submit --class net.fnothaft.copier.Copier target/copier*.jar.
fnothaft/copier
Apache Spark-based tool for downloading a list of URLs. Apache 2 licensed.
README
Contributors
