aws-samples / aws-batch-operational-dashboards Goto Github PK

During deployment "sam deploy --stack-name ${BATCH_DASHBOARD_NAME} ...", one could experience the following error if the account is not a member of an organization:
Resource handler returned message:
"Your account is not a member of an
organization. (Service:
AWSSingleSignOn; Status Code: 400;
Error Code: AccessDeniedException;
Request ID: 7fdf6cad-1b9b-4d28-
b959-26262ec7a900; Proxy: null)
(Service: Grafana, Status Code:
403, Request ID: 66819d95-0456-
4853-ae0b-ba5a8e02191e)"
(RequestToken: 869a9138-6c5f-f50a-
1c72-3bb9c43c4b00,
HandlerErrorCode: AccessDenied)

There is a couple of places where the metric 'Ops' should be used.
E.g., the template file batch-grafana-dashboard-template.json has the following section, where the EBSReadOps_Average should be used.

  "title": "EBS Read IOPS",
  "transformations": [
    {
      "id": "calculateField",
      "options": {
        "alias": "EBS Read IOPS",
        "binary": {
          "left": "EBSReadBytes_Average",
          "operator": "/",
          "reducer": "sum",
          "right": "60"
        },
        "mode": "binary",
        "reduce": {
          "include": [
            "EBSReadBytes_Average"
          ],
          "reducer": "sum"
        },
        "replaceFields": true
      }
    }
  ],
  "type": "timeseries"
}

],

the S3 bucket is empty and when I took a look at the Lambda, I saw this error, handled as warning!
the main reason that I ended up to debug is error I get in Grafana

Any suggestion what could be the issue?

2024-05-02 12:19:00 3a0adf03-417f-4df3-991b-35cd2fae2363 WARN DynamoDBMetadataHandler:250 - doGetTable: Unable to retrieve table batch-op-dashboard-batchjobdata-41yi200clapo from AWSGlue in database/schema default. Falling back to schema inference. If inferred schema is incorrect, create a matching table in Glue to define schema (see README) com.amazonaws.services.glue.model.EntityNotFoundException: Entity Not Found (Service: AWSGlue; Status Code: 400; Error Code: EntityNotFoundException; Request ID: 03a04a20-5584-43a8-bf70-fcff1ce3cf52; Proxy: null)

I will test also the feature branch!

In the case the job definition is registered with memory first and vcpus second, the values are interchanged and lead to incorrect display in the dashboard.

AWS CloudFormation and AWS CLI make EC2 platform capabilities as default and leave platform capabilities variable unset.

Change version to 2023.46.2

Currently, the dashboard display job with a stoppedAt time leading to only show jobs FAILED or SUCCEEDED.
It will be nice to see RUNNING jobs as well.

EC2 metrics display the name of the metric. I will be more useful to have the instance id.
Solution: specify as lias {{InstanceId}} in Grafana

Set Grafana Version to 8.4

The instructions for the Cost Dashboard is slightly off as there are no data sources in the json file that references Cloudwatch.

This is what I see:

amazon Managed grafana requires to have plugin management enabled.

PluginAdminEnabled:true

By default, container insights data retention is 1 day.
This feature will setup container insights retention based on a variable.

Currently the solution obtain CPU,memory and EBS metric through CloudWatch.
It will be great to have individual GPU metric such as compute and memory utilization.

Hello,
After deploying the solution today, trying to follow up the guide and at the step requiring adding an Athena datasource I'm unable to do so:
the Athena doesn't appear as datasource type available to add.
The previous datasource (Cloudwatch) was added successfully but not this one.

Are there prerequisites missing for the Athena to become available as datasource?

Customers would like to understand on which compute environment a particular job was run on.

Hello,
When I try to add an Amazon Athena Data Source, I get this error below

I do not get prompted to add any information related to the Athena data source, as is shown in your tutorial. The moment I click on athena in the add data source page, it shows me "Data Source added" and I immediately get the error in the screenshot above.
I've tried the Athena plugin version 2.13.5 and 2.14.0. I am running Grafana 9.4.
Is Athena part of the Enterprise Plugins and is that why I'm getting this error?