prometheus histogram buckets 过大对性能影响严重不? - V2EX
V2EX = way to explore
V2EX 是一个关于分享和探索的地方
Sign Up Now
For Existing Member  Sign In
请不要在回答技术问题时复制粘贴 AI 生成的内容
imherer

prometheus histogram buckets 过大对性能影响严重不?

  •  
  •   imherer May 22, 2024 1309 views
    This topic created in 705 days ago, the information mentioned may be changed or developed.

    官方的 DefBuckets 是 11 个,我目前定义的是 22 个,主要是统计的时间范围跨度有点大,从几 us 到上百 ms

    不知道 22 个算不算大?

    7 replies    2024-05-27 14:49:05 +08:00
    fantastM
        1
    fantastM  
       May 22, 2024   1
    bucket 可以当作一个 label ,不是影响性能的重点。需要关注的是,所有 label 的 key-value 组合有多少种,太多的话,会引起高基数问题 https://prometheus.io/docs/practices/naming/#labels

    CAUTION: Remember that every unique combination of key-value label pairs represents a new time series, which can dramatically increase the amount of data stored. Do not use labels to store dimensions with high cardinality (many different label values), such as user IDs, email addresses, or other unbounded sets of values.
    rrfeng
        2
    rrfeng  
       May 22, 2024   1
    影响不大
    sampeng
        3
    sampeng  
       May 22, 2024   1
    都是内存操作。。为何会大?
    但是,个数个多无所谓,你别基数太高。
    线上就有个研发把 label 写交易 id 。。。妈蛋。。。反而把我 prometheus server 干死了。。不过那是古早了。现在有问题,但可解。不过依然要注意,性能不影响,但这玩意无论如何是在内存的,给你干 oom 了别哭
    imherer
        4
    imherer  
    OP
       May 23, 2024
    @sampeng 到了 prometheus server 那边也是纯内存的吗?
    sampeng
        5
    sampeng  
       May 23, 2024
    @imherer 以前是有 buffer 。。给我干死过。后面升级过后就好多了。另一方面是一开始没事,因为基数太大,启动在做校验能把内存全给干死。每次我一换机器就直接起不来,一开始没当回事,一查,有个研发把 id 当 label 。。。但后面 prometheus 缓解了这个问题。

    不过,你要计算的是在业务端,22 个 label ,很容易大基数。这都是在内存里面的,分分钟几百 M 的内存占用。
    imherer
        6
    imherer  
    OP
       May 24, 2024
    @sampeng label 有 7 个,不算多吧,就是这个 buckets 有 22 个,从 0.00x 到几百
    sampeng
        7
    sampeng  
       May 27, 2024
    @imherer 我的意思是。。只要基数不大,闭着眼睛用。。就是每个 label 又几百个变量。那得玩死,10 个以下,感觉 22 个随便用
    About     Help     Advertise     Blog     API     FAQ     Solana     1306 Online   Highest 6679       Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 38ms UTC 23:41 PVG 07:41 LAX 16:41 JFK 19:41
    Do have faith in what you're doing.
    ubao msn snddm index pchome yahoo rakuten mypaper meadowduck bidyahoo youbao zxmzxm asda bnvcg cvbfg dfscv mmhjk xxddc yybgb zznbn ccubao uaitu acv GXCV ET GDG YH FG BCVB FJFH CBRE CBC GDG ET54 WRWR RWER WREW WRWER RWER SDG EW SF DSFSF fbbs ubao fhd dfg ewr dg df ewwr ewwr et ruyut utut dfg fgd gdfgt etg dfgt dfgd ert4 gd fgg wr 235 wer3 we vsdf sdf gdf ert xcv sdf rwer hfd dfg cvb rwf afb dfh jgh bmn lgh rty gfds cxv xcv xcs vdas fdf fgd cv sdf tert sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf shasha9178 shasha9178 shasha9178 shasha9178 shasha9178 liflif2 liflif2 liflif2 liflif2 liflif2 liblib3 liblib3 liblib3 liblib3 liblib3 zhazha444 zhazha444 zhazha444 zhazha444 zhazha444 dende5 dende denden denden2 denden21 fenfen9 fenf619 fen619 fenfe9 fe619 sdf sdf sdf sdf sdf zhazh90 zhazh0 zhaa50 zha90 zh590 zho zhoz zhozh zhozho zhozho2 lislis lls95 lili95 lils5 liss9 sdf0ty987 sdft876 sdft9876 sdf09876 sd0t9876 sdf0ty98 sdf0976 sdf0ty986 sdf0ty96 sdf0t76 sdf0876 df0ty98 sf0t876 sd0ty76 sdy76 sdf76 sdf0t76 sdf0ty9 sdf0ty98 sdf0ty987 sdf0ty98 sdf6676 sdf876 sd876 sd876 sdf6 sdf6 sdf9876 sdf0t sdf06 sdf0ty9776 sdf0ty9776 sdf0ty76 sdf8876 sdf0t sd6 sdf06 s688876 sd688 sdf86