Comments (5)
hi @the-other-tim-brown @sagarlakshmipathy @vinishjail97, what do you think?
https://github.com/daragu/incubator-xtable/tree/module
from incubator-xtable.
What is the enhancement that comes with this? It feels a bit arbitrary.
from incubator-xtable.
What is the enhancement that comes with this? It feels a bit arbitrary.
Hi @the-other-tim-brown, well, I think I& a couple of points.
- For mvn projects, add same prefix to sub modules is friendly for developers.
- Development best practices: it is impossible to deploy two modules having the same name. To avoid this kind of conflict, we recommend to prefix all modules of a project by a common key referring to the project (example : "xtable-aaa, xtable-bbb").
- After this modification, developers can quickly determine which folders in this project are submodules and which folders are regular folders by using the prefix of the folder
e.g
- For Xtable project users
From the official docs, user will use utilities/target/utilities-0.1.0-SNAPSHOT-bundled.jar
to convert data lake formats
java -jar utilities/target/utilities-0.1.0-SNAPSHOT-bundled.jar --datasetConfig my_config.yaml
The name utilities-0.1.0-SNAPSHOT-bundled.jar
does not have recognizability. The new name xtable-utilities-0.1.0-SNAPSHOT-bundled.jar
is more recognizable.
from incubator-xtable.
@daragu thanks for the references and explanation. The changes sound good to me. The only thing is that the website
directory is not maven module. Should that just stay as website
for now? It may be moved in the future when we rethink how to manage the docs.
from incubator-xtable.
OK, the website directory will stay as website in the pullrequest.
from incubator-xtable.
Related Issues (20)
- Make start_demo script easier to call
- Azure CI pending HOT 14
- Error while creating Hudi format from source Iceberg table using Hive Catalog . HOT 26
- Upgrade dependencies to avoid using versions with known vulnerabilties
- Introduce apache rat plugin to xtable project HOT 1
- Throw Permission denied error when try to run demo in docker HOT 6
- The Hudi example at https://xtable.apache.org/docs/hms#register-the-target-table-in-hive-metastore is not the command for HMS sync. HOT 1
- no rows in Trino when pyspark xtable source from delta and write into Hudi and Iceberg with S3 + HMS HOT 17
- when spark-sql (using hive) to create iceberg data in S3, it doesn't generate version-hint.text HOT 3
- "IllegalStateException: Recursive update" when converting Hudi table to Delta HOT 13
- Update docs to add xtable - oss unity catalog integration
- Clarification on Sync Command and Required JAR Files HOT 5
- Sync with Delta Source fails when column stats are missing
- XTable 1st Release HOT 10
- Glue Iceberg Table to Delta Conversion Failed HOT 5
- The github workflow requires approval from a maintainer HOT 4
- Wrong hoodie.table.name generated (iceberg->hudi) HOT 2
- Make XTable as a community managed Airflow provider HOT 8
- `Too many files with unapproved license` Error running mvn clean package on `main` HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from incubator-xtable.