Comments (4)
marnovo
commented on May 17, 2024
1
@ajnavarro take a look.
from jgit-spark-connector.
smola
commented on May 17, 2024
Stuff that requires more thought:
- A lot of functionality that is independent from Spark would be available from the JVM without Spark...
- ...but do we need to access any of that from Python without PySpark?
- Would it make sense to use py4j to call JVM code from Python when not using PySpark? (that's what uses PySpark under the hood), note that it requires an external JVM process in addition to the Python interpreter.
from jgit-spark-connector.
smola
commented on May 17, 2024
Here is a PR exploring some aspects of the API: #2
from jgit-spark-connector.
bzz
commented on May 17, 2024
WIP on design document
from jgit-spark-connector.
Related Issues (20)
- Return of org.eclipse.jgit.errors.RevWalkException: Walk failure HOT 2
- [feature request] Handy handling of bad siva-files HOT 2
- Engine fails on UAST when run spark-shell with --packages argument in cluster mode HOT 6
- Modify requirements file, Pyspark version HOT 2
- Add a configuration flag to skip siva read errors
- [Change] Files not cleaned in /tmp folder on Spark Workers when using apollo HOT 2
- commits filtering counterintuitive behaviour HOT 1
- Engine fails to extract UASTs on actual Spark cluster HOT 5
- Latest version of Docker image engine-jupyter missing bblfsh HOT 6
- Expose Bblfsh UAST extraction errors in Engine
- Jupyter example notebook doesn't work out-of-the-box
- Docker Hub 'latest' image doesn't point to master Dockerfile. HOT 2
- Missing dependencies for pyspark in README HOT 6
- Build and test process leave the repository in dirty state for git describe HOT 3
- Engine fails on siva files from pipeline-staging cluster HOT 14
- Update README with EOL
- "standard" repository format does not work HOT 7
- ReferencesDataFrame files property HOT 4
- WARN Repository: close() called when useCnt is already zero
- WARN CommitIterator: missing object HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jgit-spark-connector.