This repository contains the DAG code used in the AI integrations webinar.
The DAGs in this repository showcases the following packages:
- apache-airflow-providers-cohere
- apache-airflow-providers-pinecone
- apache-airflow-providers-weaviate
- apache-airflow-providers-openai
- apache-airflow-providers-pgvector
- apache-airflow-providers-opensearch
This demo contains the following DAGs:
- DAGs showing how to use LLM endpoints:
cohere_example
andopenai_example
. - DAGs showing how to use a vector database:
pinecone_example
,weaviate_example
, (upcoming:pgvector_example
). - A DAG showing how to use the OpenSearch provider:
opensearch_example
.
You can find a full description of each of these DAGs in the relevant Learn integration tutorial.
Additionally, this repository contains a use case DAG analyze_customer_feedback
showing how to use the Cohere and OpenSearch provider together, you can find a detailed code description in the Use Cohere and OpenSearch to analyze customer feedback in an MLOps pipeline use case.