Comments (1)
klimantje
commented on September 26, 2024
I'm running into the same issue. Currently the whole spark session is started (and fails) when using the plugin to generate the dag. This can be fixed by a parameter (e.g. used for viz) but for this plugin runnign with params is not supported.
from kedro-airflow-k8s.
Related Issues (20)
- kedro-airflow-k8s does not support KEDRO_ENV
- Compile step broken with kedro==0.18.0 HOT 3
- Add support for --dag-name flag to schedule step.
- Ensure pipeline works when git not initialized
- Fix typo in docs/03_getting_started/01_quickstart.md HOT 1
- Replace hardcoded '/opt' in project_path in spark job with PROJECT_HOME env HOT 1
- ValueError: Failed to format pattern '${xxx}': no config value found, no default provided HOT 6
- Add custom script injection to airflow_spark_task_template HOT 1
- Invalid status in Mlflow during pipeline execution
- Airflow run dag with config HOT 4
- feature request: Group kedro nodes in same DAG task
- Update kedro dependencies HOT 1
- Add support for python 3.9 and 3.10
- Set up Dependabot and CodeQL
- Update kfp dependencies HOT 1
- Add ability to specify service accounts and imagePullSecrets to run the pipeline with
- Invalid configuration generated by `kedro airflow-k8s init` HOT 3
- kedro-airflow-k8s[gcp] depends on nonexistent library HOT 2
- Authentication to MLFlow
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kedro-airflow-k8s.