EricGao888/Spider2
[ICLR 2025 Oral] Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows
PMC-member@Apache DolphinScheduler, SDE@Alibaba Cloud, Ex-SDE@Amazon, Alumni@Purdue, Alumni@SJTU
[ICLR 2025 Oral] Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows
agentic workflow to write weekly / monthly worklogs
dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
Apache Spark Kubernetes Operator
Apache Spark - A unified analytics engine for large-scale data processing
Curated Big Data Applications for Kubernetes
Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.
Apache Airflow Hive Operator for Alibaba Cloud Serverless Spark
airflow_alibaba_provider
Set up airflow local dev env in 5 minutes
A self-contained dbt project for testing purposes
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
CDC Connectors for Apache Flink®
An application metrics facade for the most popular monitoring tools. Think SLF4J, but for metrics.
🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.
Open source SQL Query Assistant service for Databases/Warehouses
Apache Hive
Mirror of Apache Kafka
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
ChatGPT SDK and CLI for Java
An Open Standard for lineage metadata collection
GPT-powered chat for documentation search & assistance.
Take a guess what I'm going to do with this repo : )
APM, Application Performance Monitoring System
Network Projects and System Programming