Comments (5)
Hello @tripitakav
This is usually a caused by vmstorage starting background merges. Before the disk expansion vmstorage could postpone merges as there was not enough free disk space to perform a merge. After the disk resize vmstorage detected that there is enough disk space to perform background merge and started merging the data.
You can confirm if that's the case by checking "Active merges" and "Merge" speed panels. If that is the case you will see than number of merges and their speed was lower before the disk resize.
from victoriametrics.
@zekker6
Yes, there is indeed a backend merge. Name is indexdb/file.
So is there any way to reduce memory usage?
from victoriametrics.
@tripitakav Usually, 3-5Mil merge speed should not use that much memory. Could you gather memory profile from the storage nodes as per this instruction and share the profiles here?
from victoriametrics.
@tripitakav could you please share screenshots of the Troubleshooting and Interconnection section of the Grafana dashboard?
Btw, I see you have a plenty of restart annotations on the screenshots. Why it is so?
from victoriametrics.
@zekker6 @hagen1778
Sorry, I took a leave last week and the old cluster has been deleted by my colleagues, so I cannot see any information. I will temporarily close this issue for now
from victoriametrics.
Related Issues (20)
- Recording rules run interval consistency and not missing data in recording rules HOT 1
- Vmagent performance degradation after restarting HOT 6
- How Victoria Metrics stores data for each tenant on Vmstorage when multitenancy is enabled HOT 1
- Add Grafana Alloy, Prometheus, and VMAgent to data ingestion docs
- How to setup mTLS between VMbackup and Minio? HOT 1
- vmalert -dryRun doesn't detect label template issues HOT 4
- VMInsert does not support InfluxDB health endpoint
- How to assert the VM cluster is deploy succeed? HOT 6
- streaming aggregation (i.e., interval:1d) HOT 5
- VMAgent in-memory data buffering with -remoteWrite.disableOnDiskQueue=true HOT 2
- Streaming aggregation have concepts similar to event time, ingestion time, and processing time as seen in Apache Flink? HOT 6
- Feature read __sample_limit__ from labels HOT 3
- Using io_uring in Linux?
- VMUI for Logs: improvements in table view
- VMUI: option to sort by time always
- make possible send VMProto packets to kafka HOT 2
- Add additional paths to the VMOperator Quickstart
- Why is there a delay of approximately 30 seconds in the data results queried from VMS? HOT 7
- The same query shows is different between the VictoriaMetrics UI graph and the Prometheus graph
- VictoriaLogs: make version of VictoriaLogs visible
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from victoriametrics.