kborovik / llmdoc-infra

LLMDOC application Infrastructure deployment on GCP & AWS using Kubernetes, HELM, and Hashicorp Vault

Google Cloud Infrastructure for Document Question Answering with Generative AI and Elasticsearch

Google Cloud infrastructure deployment for https://github.com/kborovik/llmdoc

Pipeline Design Principles

• Maximize short feedback development cycle by keeping all dependencies in the project
• Uncompromised end-to-end deployment and testing with a single command make all
• Manage deployment targets difference with configuration files google_project.tfvars
• Track code base changes with git branch
• Track code base deployment state with git tag

Deployment Stack

Security Static Analysis

Checkov is a static code analysis tool for scanning infrastructure as code (IaC) files for misconfigurations that may lead to security or compliance problems.

https://www.checkov.io/

make checkov

Terraform

Work in progress

make terraform

Kubernetes (HELM)

HashiCorp Vault

make vault

Vault Secrets Operator

The Vault Secrets Operator is a Kubernetes operator that syncs secrets between Vault and Kubernetes natively without requiring the users to learn details of Vault use.

https://github.com/hashicorp/vault-secrets-operator

https://developer.hashicorp.com/vault/tutorials/kubernetes/vault-secrets-operator

Document Question Answering

Work in progress

Functional Testing

Work in progress