Comments (3)
have you tried VMAgent in a cluster mode to spread the scrape jobs out over multiple instances of VMAgent?
There are instructions in the docs for running in cluster mode on k8s and a blog post explaining how cluster mode works.
from victoriametrics.
600MB is really huge metrics response. And It'll take a lot of time to process it.
I can suggest to disable staleMarkers detection no_stale_markers: true
for this job (or for all jobs with flag -promscrape.noStaleMarkers").
job config example:
scrape_configs:
- job_name: kube-state-metrics
no_stale_markers: true
# make sure that series limit is not set or has default 0 value
series_limit: 0
static_configs:
- targets: ["kube-state-url:1234"]
It must skip GetRowsDiff function execution.
from victoriametrics.
600MB is really huge metrics response. And It'll take a lot of time to process it.
I can suggest to disable staleMarkers detection
no_stale_markers: true
for this job (or for all jobs with flag -promscrape.noStaleMarkers"). job config example:scrape_configs: - job_name: kube-state-metrics no_stale_markers: true # make sure that series limit is not set or has default 0 value series_limit: 0 static_configs: - targets: ["kube-state-url:1234"]It must skip GetRowsDiff function execution.
Good idea, but I want to know if there are other problems? And although setting no_stale_markers: true
, I consider it also run GetRowsDiff func once ref. If we could optimize the GetRowsDiff func? Or we shard kube-state-metrics component.
Thanks for replies.
from victoriametrics.
Related Issues (20)
- Unexpected metrics/labels missing in VictoriaMetrics HOT 10
- Victorial metrics is showing data for nodes, that don't have label in filter HOT 17
- Don't add default scrape port
- How to use VM on bare metal within public network? HOT 13
- VictoriaLog crashed use go1.23rc2 in Linux HOT 6
- VMAGENT : scrapping error is not an error HOT 3
- Sometimes High Storage connection saturation HOT 1
- [vmagent]: How env flags are enumarted ? HOT 1
- vmstorage stop saving any metrics for the whole cluster if one instance cannot write to the disk. HOT 20
- vmbackupmanager: name of backup is wrong HOT 11
- How can I export all my VictoriaLogs as a CSV HOT 1
- Prometheus remote write failed, status:400 or 404, msg: 'unsupported path requested: \"/insert/0/prometheus' HOT 5
- How to calculate the QPS of logs in victorialog HOT 1
- How to setup VMAgent remotewrite to different targets with different authority method HOT 2
- Dropped labels log should show the total labels found HOT 1
- allow configuration of dedup on same timestamp behavior HOT 4
- vmagent API endpoint to programmatically test relabeling rules HOT 1
- prometheus remote write to vminsert, get "server returned HTTP status 502 Bad Gateway" HOT 2
- vmbackup delete snapshot before create backup HOT 2
- Subscribe to new VM Blog articles via email HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from victoriametrics.