andrewkroh / go-ingest-node-metrics Goto Github PK

First of all thank you for this extremely helpful tool.

However I would propose some of the following adjustments.

I have observed the same like in your screenshot.
https://github.com/andrewkroh/go-ingest-node-metrics/blob/main/docs/ingest-node-pipeline-dashboard.png

1. Please have a look at the conditionals like e.g. the cisco asa pipeline this if condition if in reality based on a date processor with names like 7_conditional or 181_conditional which don't really help what exact processor equivalent in the pipeline this is about:
   https://github.com/elastic/beats/blob/v7.13.3/x-pack/filebeat/module/cisco/shared/ingest/asa-ftd-pipeline.yml#L73-L104
   and looking to the elasticsearch /_ingest/pipeline query the resulting equivalent JSON looks like that:
   
   However looking to the relevant part of the /_nodes/stats query the date processor is not really reflected as of the key, but the other 2 show the relevant used processor and not only the type as conditional itself.
   
   So it would be helpful a lot if one could ingest the pipeline stats key itself to identify better, what exact processor inside the pipeline this is talking about, and then reflect that one in the dashboard pie.

2. Another enhancement would be to add column pipeline to the Processor Stats Table in case multiple pipelines are used:
   

3. Finally it would be really cool if there could be configured a cluster with https (maybe with ignored certificated validation) but as of now it's only possibly to ingest into an elasticsearch cluster with http.

Hi Andrew,
One of the support techs recommended I try your dashboard, thanks for sharing BTW, but I think that in _node/stats for 8.1 it seems to break. The issue appears to be where a value starts with """ and includes a "value" between that one and the closing """. The error that go-ingest-node-metrics throws is "invalid character '"' after object key:value pair". And when I plug the node-json into a json validator it throws up too.

Thanks!

-Bobby