esoubiran-aneo / armonik

Main repository for ArmoniK, An Open-Source orchestrator based on Kubernetes managing the distribution of hybrid multi cloud computations

Table of contents

• ArmoniK
  • When should I use ArmoniK
  • When should I not use ArmoniK
• ArmoniK versions
• ArmoniK deployment
• How to run ArmoniK.Samples
• Acknowledge
• Bugs/Support

ArmoniK

ArmoniK is a high throughput compute grid project using Kubernetes. The project provides a reference architecture that can be used to build and adapt a modern high throughput compute solution on-premise or using Cloud services, allowing users to submit high volumes of short and long-running tasks and scaling environments dynamically.

Warning: This project is an Open Source (Apache 2.0 License).

When should I use ArmoniK

ArmoniK should be used when the following criteria are meet:

1. A high task throughput is required (from 250 to 10,000+ tasks per second).
2. The tasks are loosely coupled.
3. Variable workloads (tasks with heterogeneous execution times) are expected and the solution needs to dynamically scale with the load.

When should I not use ArmoniK

ArmoniK might not be the best choice if :

1. The required task throughput is below 250 tasks per second.
2. The tasks are tightly coupled, or use MPI.
3. The tasks use third party licensed software.

ArmoniK versions

The current version of ArmoniK uses the tags listed in armonik-versions.txt where:

• core is the ArmoniK Core tag used for container images of Control plane, Polling agent and Metrics exporter.
• worker is the tag used for the container image of the workers
• admin-gui is the tag used for the container images of ArmoniK AdminGUI (admin-api and admin-app)
• samples is the tag for ArmoniK Samples

ArmoniK deployment

All instructions to build, deploy and test ArmoniK software are described in ArmoniK deployment

How to run ArmoniK.Samples

Please Clone the repository Armonik.Samples into the [Root_Armonik_folder]/Source/

git clone https://github.com/aneoconsulting/ArmoniK.Samples.git

Instructions to run ArmoniK.Samples are described in Run Samples

Acknowledge

This project was funded by AWS and started with their HTCGrid project.

Bugs/Support

Please direct enquiries about ArmoniK to the public mailing list [email protected].

See also Issues of ArmoniK project.

To report a bug or request a feature, please use and follow the instructions in one of the issue templates. Don't forget to include the version of ArmoniK you are using.

armonik's Issues

Dependency Dashboard

This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.

Repository problems

These problems occurred while renovating this repository. View logs.

• WARN: File contents are invalid JSON but parse using JSON5. Support for this will be removed in a future release so please change to a support .json5 file name or ensure correct JSON syntax.

Open

These updates have all been created already. Click a checkbox below to force a retry/rebase of any.

• chore(deps): pin dependencies (actions/checkout, actions/deploy-pages, actions/setup-node, actions/upload-pages-artifact, amannn/action-semantic-pull-request, marocchino/sticky-pull-request-comment)
• chore(deps): update npm packages (@aneoconsultingfr/armonik-docs-theme, @nuxtjs/eslint-config-typescript, eslint, markdownlint-cli, mermaid, nuxt, pnpm)
• chore(deps): update terraform modules
• chore(deps): update terraform provides (aws, cloudinit, external, helm, kubernetes, local, null, pkcs12, random, tls)
• chore(deps): update github actions (major) (actions/checkout, actions/deploy-pages, actions/setup-node, actions/upload-pages-artifact)
• chore(deps): update npm packages to v9 (major) (eslint, pnpm)
• chore(deps): update terraform aws to v5
• chore(deps): update terraform terraform-aws-modules/ec2-instance/aws to v5
• Click on this checkbox to rebase all open PRs at once

Detected dependencies

github-actions

.github/workflows/aws-deploy.yml

• actions/checkout v3
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main
• actions/checkout v3
• aneoconsulting/ArmoniK.Action.Deploy main
• actions/checkout v3
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main

.github/workflows/deploy-docs.yml

• actions/checkout v3
• actions/setup-node v3
• actions/upload-pages-artifact v1
• actions/deploy-pages v1

.github/workflows/deploy.yml

• actions/checkout v3
• actions/checkout v3
• actions/checkout v3
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main
• actions/checkout v3
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main
• actions/checkout v3
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main
• actions/checkout v3
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main

.github/workflows/manual-aws-deploy.yml

• actions/checkout v3
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main

.github/workflows/manual-aws-destroy.yml

• actions/checkout v3
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main
• aneoconsulting/ArmoniK.Action.Deploy main

.github/workflows/semantic-pull-request.yml

• amannn/action-semantic-pull-request v5
• marocchino/sticky-pull-request-comment v2
• marocchino/sticky-pull-request-comment v2

.github/workflows/validate-docs-generation.yml

• actions/checkout v3
• actions/setup-node v3
• actions/checkout v3
• actions/setup-node v3
• actions/checkout v3
• actions/setup-node v3

npm

.docs/package.json

• @aneoconsultingfr/armonik-docs-theme ^0.6.10
• mermaid ^10.2.0
• nuxt ^3.5.2
• @nuxtjs/eslint-config-typescript ^12.0.0
• case-police ^0.6.1
• eslint ^8.41.0
• markdownlint-cli ^0.34.0
• pnpm 8.6.0

terraform

infrastructure/docs/client-node/instances.tf

• terraform-aws-modules/ec2-instance/aws ~> 4.1.4

infrastructure/docs/client-node/providers.tf

• aws ~> 4.20.0
• random ~> 3.1.0
• template ~> 2.2.0

infrastructure/docs/kubernetes/cluster/k3s-cluster/instances.tf

• terraform-aws-modules/ec2-instance/aws ~> 3.3.0
• terraform-aws-modules/ec2-instance/aws ~> 3.3.0

infrastructure/docs/kubernetes/cluster/k3s-cluster/providers.tf

• aws ~> 3.69.0
• template ~> 2.2.0

infrastructure/docs/kubernetes/cluster/kubeadm-cluster/instances.tf

• terraform-aws-modules/ec2-instance/aws ~> 3.3.0
• terraform-aws-modules/ec2-instance/aws ~> 3.3.0

infrastructure/docs/kubernetes/cluster/kubeadm-cluster/providers.tf

• aws ~> 3.69.0
• template ~> 2.2.0

infrastructure/quick-deploy/aws/all/armonik.tf

infrastructure/quick-deploy/aws/all/ecr.tf

infrastructure/quick-deploy/aws/all/eks.tf

infrastructure/quick-deploy/aws/all/keda.tf

infrastructure/quick-deploy/aws/all/kms.tf

infrastructure/quick-deploy/aws/all/metrics-server.tf

infrastructure/quick-deploy/aws/all/monitoring.tf

infrastructure/quick-deploy/aws/all/providers.tf

infrastructure/quick-deploy/aws/all/storage.tf

infrastructure/quick-deploy/aws/all/versions.tf

• aws ~> 4.47.0
• kubectl ~> 1.14.0
• kubernetes ~> 2.13.0
• local ~> 2.2.0
• null ~> 3.1.0
• pkcs12 ~> 0.0.7
• random ~> 3.4.3
• tls ~> 4.0.4

infrastructure/quick-deploy/aws/all/vpc.tf

infrastructure/quick-deploy/aws/armonik/main.tf

infrastructure/quick-deploy/aws/armonik/providers.tf

infrastructure/quick-deploy/aws/armonik/versions.tf

• kubernetes ~> 2.7.1
• tls ~> 4.0.4

infrastructure/quick-deploy/aws/ecr/main.tf

infrastructure/quick-deploy/aws/ecr/providers.tf

infrastructure/quick-deploy/aws/ecr/versions.tf

• aws ~> 4.47
• null ~> 3.1.0
• random ~> 3.4.3

infrastructure/quick-deploy/aws/eks/main.tf

infrastructure/quick-deploy/aws/eks/providers.tf

infrastructure/quick-deploy/aws/eks/versions.tf

• aws ~> 4.47
• cloudinit ~> 2.2.0
• helm ~> 2.7.0
• kubernetes ~> 2.13.0
• local ~> 2.2.0
• random ~> 3.4.3

infrastructure/quick-deploy/aws/keda/main.tf

infrastructure/quick-deploy/aws/keda/providers.tf

infrastructure/quick-deploy/aws/metrics-server/main.tf

infrastructure/quick-deploy/aws/metrics-server/providers.tf

infrastructure/quick-deploy/aws/monitoring/main.tf

infrastructure/quick-deploy/aws/monitoring/providers.tf

infrastructure/quick-deploy/aws/monitoring/versions.tf

• external ~> 2.2.0
• kubernetes ~> 2.13.0
• local ~> 2.1.0

infrastructure/quick-deploy/aws/storage/main.tf

infrastructure/quick-deploy/aws/storage/providers.tf

infrastructure/quick-deploy/aws/storage/versions.tf

• aws ~> 4.47.0
• kubectl ~> 1.14.0
• kubernetes ~> 2.13.0
• null ~> 3.1.0
• pkcs12 ~> 0.0.7
• random ~> 3.4.3
• tls ~> 4.0.4

infrastructure/quick-deploy/aws/vpc/main.tf

infrastructure/quick-deploy/aws/vpc/providers.tf

infrastructure/quick-deploy/aws/vpc/versions.tf

• aws ~> 4.47.0
• null ~> 3.1.0
• random ~> 3.4.3

infrastructure/quick-deploy/localhost/all/armonik.tf

infrastructure/quick-deploy/localhost/all/images.tf

infrastructure/quick-deploy/localhost/all/keda.tf

infrastructure/quick-deploy/localhost/all/metrics-server.tf

infrastructure/quick-deploy/localhost/all/monitoring.tf

infrastructure/quick-deploy/localhost/all/providers.tf

infrastructure/quick-deploy/localhost/all/storage.tf

infrastructure/quick-deploy/localhost/all/versions.tf

• kubectl ~> 1.14.0
• kubernetes ~> 2.13.0
• local ~> 2.2.0
• null ~> 3.1.0
• pkcs12 ~> 0.0.7
• random ~> 3.4.3
• tls ~> 4.0.4

infrastructure/quick-deploy/localhost/armonik/main.tf

infrastructure/quick-deploy/localhost/armonik/providers.tf

infrastructure/quick-deploy/localhost/armonik/versions.tf

• external ~> 2.1.1
• kubernetes ~> 2.13.0
• local ~> 2.2.2
• null ~> 3.1.0
• pkcs12 ~> 0.0.7
• random ~> 3.4.3
• tls ~> 4.0.4

infrastructure/quick-deploy/localhost/keda/main.tf

infrastructure/quick-deploy/localhost/keda/providers.tf

infrastructure/quick-deploy/localhost/keda/versions.tf

• external ~> 2.1.1
• kubernetes ~> 2.13.0
• local ~> 2.1.0
• null ~> 3.1.0
• random ~> 3.4.3
• tls ~> 4.0.4

infrastructure/quick-deploy/localhost/metrics-server/main.tf

infrastructure/quick-deploy/localhost/metrics-server/providers.tf

infrastructure/quick-deploy/localhost/metrics-server/versions.tf

• external ~> 2.1.1
• kubernetes ~> 2.13.0
• local ~> 2.1.0
• null ~> 3.1.0
• random ~> 3.4.3
• tls ~> 4.0.4

infrastructure/quick-deploy/localhost/monitoring/main.tf

infrastructure/quick-deploy/localhost/monitoring/providers.tf

infrastructure/quick-deploy/localhost/monitoring/versions.tf

• external ~> 2.1.1
• kubernetes ~> 2.13.0
• local ~> 2.1.0
• null ~> 3.1.0
• random ~> 3.4.3
• tls ~> 4.0.4

infrastructure/quick-deploy/localhost/storage/main.tf

infrastructure/quick-deploy/localhost/storage/providers.tf

infrastructure/quick-deploy/localhost/storage/versions.tf

• external ~> 2.1.1
• kubectl ~> 1.14.0
• kubernetes ~> 2.13.0
• local ~> 2.2.2
• null ~> 3.1.0
• pkcs12 ~> 0.0.7
• random ~> 3.4.3
• tls ~> 4.0.4

---

• Check this box to trigger a request for Renovate to run again on this repository