GithubHelp home page GithubHelp logo

excelero / telegraf-plugin Goto Github PK

View Code? Open in Web Editor NEW
1.0 3.0 4.0 329 KB

NVMesh telegraf statistics collector plugin

Home Page: https://www.excelero.com/

License: GNU General Public License v2.0

Python 100.00%
telegraf-plugin

telegraf-plugin's People

Contributors

akire0ne avatar excelero-andreas avatar excelero-joe avatar kevinguinn-excelero avatar yanivexcelero avatar

Stargazers

 avatar

Watchers

 avatar  avatar  avatar

telegraf-plugin's Issues

nvmesh v 1.x volumes incorrectly mapped

This is Oracle host with nvmesh v 1.x

cat  /proc/nvmeibc/volumes/Oracle_Intel_R1_01/iostats
time=55799831.536
*               |                READ               WRITE                TRIM
num_ops         |            88866126           208931367                   0
size [bytes]    |       9945214828544      21074832113664                   0
total_execution |       61332219643.9      279141419892.8                 0.0
latency         |       61248070211.0      278897947702.1                 0.0
latency^2       |    54566940908828.6   762039493837193.4                 0.0
worst_execution |            317515.1            243623.2                 0.0
worst_latency   |             20679.1            243622.4                 0.0
worst_e2e       |              316000              242000                   0

Non Oracle host, nvmesh v 2.x

cat /proc/nvmeibc/volumes/test/iostats
up_time=3041514.6[sec]
*               |                READ               WRITE                TRIM
num_ops         |            77879219            84808305                   0
size            |       1914830393344       1296294727680                   0 [bytes]
total_latency   |       36683502738.1       67399470213.8                 0.0 [usec]
total_execution |       36768257102.1       67560982199.5                 0.0 [usec]
latency^2       |   153426421321260.4   850768828801414.5                 0.0
worst_latency   |             14955.2           1189475.9                 0.0 [usec]
worst_execution |           1053251.8           1189478.8                 0.0 [usec]
worst_e2e       |                1053                1189                   0 [msec]
worst_e2e_enbl  |                   0                   0                   0 [sec]

As you can see there are some changes
total_latency is latency
size is size [bytes]

As for latency, this seems to fix it:

REGEX_VOL_LATENCY = r"\b(total_latency|((?!.*latency\^2)latency))\s*\S\s*(\d*.\d*)\s*(\d*.\d*)"

but it's incorrectly regex/mapped

 ./nvmesh_telegraf.py
nvmesh,volume=Oracle_Intel_R1_01 num_ops_read=88866126,num_ops_write=208931151,size_in_bytes_read=b,size_in_bytes_write=y,latency_read=latency,latency_write=latency
nvmesh,volume=Oracle_Intel_R1_02 num_ops_read=103649772,num_ops_write=218745189,size_in_bytes_read=b,size_in_bytes_write=y,latency_read=latency,latency_write=latency
nvmesh,volume=Oracle_Intel_R1_03 num_ops_read=101341748,num_ops_write=218167350,size_in_bytes_read=b,size_in_bytes_write=y,latency_read=latency,latency_write=latency
nvmesh,volume=Oracle_Micron_R1_A num_ops_read=179388426,num_ops_write=319758451,size_in_bytes_read=b,size_in_bytes_write=y,latency_read=latency,latency_write=latency
nvmesh,volume=Oracle_Micron_R1_B num_ops_read=172133858,num_ops_write=326062799,size_in_bytes_read=b,size_in_bytes_write=y,latency_read=latency,latency_write=latency
nvmesh,volume=Oracle_Micron_R1_C num_ops_read=100568799,num_ops_write=307101102,size_in_bytes_read=b,size_in_bytes_write=y,latency_read=latency,latency_write=latency
nvmesh,volume=Oracle_Micron_R1_D num_ops_read=164622054,num_ops_write=313834537,size_in_bytes_read=b,size_in_bytes_write=y,latency_read=latency,latency_write=latency
nvmesh,disk=190420D0869D.1 disk_reads=254457013,disk_writes=1285964394,disk_read_in_bytes=17557252952064,disk_write_in_bytes=110449436221440,disk_read_latency=140071029212.3,disk_write_latency=14880550049818.0
nvmesh,disk=190721006515.1 disk_reads=426159421,disk_writes=1522433797,disk_read_in_bytes=21357077245952,disk_write_in_bytes=133431655694336,disk_read_latency=176145965162.9,disk_write_latency=18813839707447.8
nvmesh,disk=PHLE7260007T3P2EGN.1 disk_reads=64515044,disk_writes=223019891,disk_read_in_bytes=5254105194496,disk_write_in_bytes=21084006756352,disk_read_latency=38950846233.8,disk_write_latency=263550517938.8
nvmesh,disk=PHLE726400MU3P2EGN.1 disk_reads=51083142,disk_writes=213975716,disk_read_in_bytes=4967477047296,disk_write_in_bytes=21074830893056,disk_read_latency=32626970673.5,disk_write_latency=264960961117.4
nvmesh,disk=PHLE726400N63P2EGN.1 disk_reads=51788833,disk_writes=223633847,disk_read_in_bytes=5088378335232,disk_write_in_bytes=21092469796864,disk_read_latency=35245475544.5,disk_write_latency=264332584994.3
nvmesh,disk=PHLE726401KN3P2EGN.1 disk_reads=51264622,disk_writes=223018814,disk_read_in_bytes=5054835929088,disk_write_in_bytes=21083989770240,disk_read_latency=34608410776.6,disk_write_latency=266861011554.0
nvmesh,disk=PHLE726401XZ3P2EGN.1 disk_reads=66562567,disk_writes=223635646,disk_read_in_bytes=5312239177728,disk_write_in_bytes=21092486447104,disk_read_latency=39594280601.6,disk_write_latency=263891377249.4
nvmesh,disk=PHLE726401ZC3P2EGN.1 disk_reads=52754937,disk_writes=213975716,disk_read_in_bytes=4977737781248,disk_write_in_bytes=21074830893056,disk_read_latency=32815068419.2,disk_write_latency=262422627480.6
telegraf[11536]: 2021-03-04T23:13:40Z E! [inputs.exec] Error in plugin: metric parse error: expected field at 1:99: "nvmesh,volume=Oracle_Intel_R1_01 num_ops_read=88866126,num_ops_write=208931043,size_in_bytes_read=b,size_in_bytes_write=y,latency_read=latency,latency_write=latency"

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.