Comments (19)
I'll start on Oracle
from ibis.
We should try to come up with a way to address the specific concern without having to "hack" github issues by adding conventions.
A roadmap's issues IMO should be closed. It indicates that work is complete. We should also close milestones when they are reached, similar to how we close out release milestones when the release is complete.
If our roadmap is empty, and we don't want it to be empty, which seems reasonable, then we need to add more things to it.
from ibis.
I'll start working on the sqlite
backend now to familiarize myself with the new sqlglot code path. @cpcloud also just pinged on zulip saying he's working on the mysql
backend. AFAIK all other backends are still available for work.
from ibis.
For Impala, we should be able to use the hive
sqlglot dialect and supplement by adding rules to its TRANSFORMS
dict
(see the DataFusion backend for a custom dialect subclass).
from ibis.
I am starting on MS SQL now.
from ibis.
Working on PySpark. Since the tests are really slow it will take some time.
from ibis.
I will start on BigQuery today or tomorrow, depending on how much progress I can make with mssql
from ibis.
I'm starting on the impala backend today.
from ibis.
I'll start on Druid today.
from ibis.
I am working on the exasol port today.
from ibis.
Weekly Update:
2024-01-18
This is the primary focus of the team, intending to get all backends refactored to the new relational model (building on previous refactor work) and in the process migrating from SQLAlchemy to SQLGlot. We are on track to get this done in Q1, with most backends already ported and the rest in progress (excluding Flink, RisingWave, and perhaps one more).
This week we landed the following backends in the port:
- druid
- impala
- pyspark
- BigQuery is ported and awaiting a final review.
Work is started on these backends:
- exasol
- sqlite
- oracle
- dask
(copying over last week's update on behalf of Phillip)
from ibis.
Work has completed on:
- exasol
- oracle
In PR:
- dask
In progress:
- sqlite
Not yet started:
- flink
- risingwave
Reviews:
- risingwave (likely to go in this week)
Others:
- flink blog
- 8.0.0 release
from ibis.
Work has completed on:
- sqlite
In review:
- dask
In progress:
- flink
Not yet started:
- risingwave
Others:
- risingwave-sans-sqlglot was merged
We're close to merging the-epic-split
into main, and have reorganized remaining work items into tes-required-for-merge
and tes-required-for-release
labels to help identify blockers for the respective steps.
from ibis.
Work to port backends has completed on:
- dask
- risingwave
In review:
- flink
We're VERY close!
We've tagged a bunch of follow ups using the labels mentioned in the previous comment.
from ibis.
All backends ported and merged into the-epic-split
. Closing this out!
Tracking the epic rebase in #8310.
Thanks to all involved in porting and refactoring, this was a huge effort!
from ibis.
reopening and adding [DONE]
in the title for keep in on the GH project
great work everyone!
from ibis.
@lostmygithubaccount Why do we need to keep these open?
from ibis.
so they aren't removed from the GH project after 2 weeks and our roadmap is empty
from ibis.
re-closing per discussion
from ibis.
Related Issues (20)
- feat: add .cast() after every UDF HOT 1
- cannot use duckdb schema properly HOT 4
- bug: inner Deferred binds to wrong thing in `Table.select(_.x.map(_.b))` HOT 2
- feat(flink): implement support for array collect HOT 1
- bug: `Parser Error: syntax error at or near "UNION"` HOT 2
- docs: Probably typo in chaining expressions How-to HOT 4
- Deprecate legacy UDF functionality HOT 1
- bug(duckdb): inconsistent output pandas types due to accidental decimal usage
- feat(api): shorthand for table topk HOT 6
- feat(flink): deduplication using `distinct()` HOT 1
- docs: faq
- feat(ir): more flexible dereferencing support for the right hand side of joins
- feat(pyspark): Add UUID support to pyspark when spark 4.0 is supported
- feat(parquet): figure out convention for multi-file parquet writing
- feat(Polars): enable pushdown filtering for lazy dataframes HOT 1
- bug: ibis.decompile(expr) returns SQL code HOT 1
- Docs: replace internals article HOT 1
- feat: docs: update extending tutorial for custom operations HOT 4
- bug: can't execute `map<array, anything>`
- feat: support more types as keys to Map HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ibis.