-
Notifications
You must be signed in to change notification settings - Fork 195
Description
For some reason VictoriaMetrics - cluster dashboard treats vmauth as both vminsert and vmselect instances. This manifests in all charts that include vmselect and/or vminsert. Some examples where it is noticed right away:
Statssection at the very top. Theversionanduptimecharts show additional vmselects and vminserts:
Drilldownsection at the very bottom. These additional vmselects and vminserts are included into theCPU Usagechart. This is where you can see that it is actually avmauthinstance - both vmselect and vminsert have the same IP and8427port.
To Reproduce use our sandbox dashboard and choose lts deployment.
If vmauth consumes little resources, then its presence may be not noticed on other charts. But if it has significant resource utilization this will show as if vmselect or vminsert consume more resources that they actually do.
Additionally, even if vmauth consumes little resources, but has some utilization spikes (i.e. its max cpu is 0.5, but it suddenly uses 0.45 cpu) it will significantly distort vmselect and vminsert utilization charts.
An example from my personal cluster:
Here is the Resource Usage / CPU (All) chart. Notice the vmselect spikes (yellow line). The vminsert has exactly same spikes (the green line, it is hidden behind yellow line because it is exactly the same):
If you look at the same chart but unaggregated, we will see that vmselect and vminsert actually have no spikes. Instead these are vmauth spikes.
Because this chart does not use absolute numbers and instead uses the relative ones (current utilization-to-max), vmauth utilization wins (because the query also has max function).