Enabling capacity metric collection

[edd1619]

Hello,

Could you direct me to the documentation on enabling capacity metric collection?

Thanks!

[cgrinds]

hi @edd1619 do you mean the metrics shown under the Capacity Metrics row shown below?
If so, those are enabled by default as part of the Volume and Aggregate templates in the Zapi or Rest collector.
https://github.com/NetApp/harvest/blob/main/conf/zapi/default.yaml#L9

[edd1619]

Hi @cgrinds We are looking for per aggregate/volume/qtree/lun capacity. When we check Prometheus, we only see disk capacity for aggr and only perf metrics from volumes. Do we have to enable per aggregate/volume/qtree/lun capacity metric somehow ?? ***@***.*** Thanks! @edd1619<https://github.com/edd1619> From: Chris Grindstaff ***@***.***> Sent: Monday, November 28, 2022 12:52 PM To: NetApp/harvest ***@***.***> Cc: Dannenfelser, Edward ***@***.***>; Mention ***@***.***> Subject: [EXTERNAL] Re: [NetApp/harvest] Enabling capacity metric collection (Discussion #1556) hi @edd1619<https://github.com/edd1619> do you mean the metrics shown under the Capacity Metrics row shown below? If so, those are enabled by default as part of the Volume and Aggregate templates in the Zapi or Rest collector. https://github.com/NetApp/harvest/blob/main/conf/zapi/default.yaml#L9<https://github.com/NetApp/harvest/blob/main/conf/zapi/default.yaml#L9> [image]<https://user-images.githubusercontent.com/242252/204346075-4e198e31-76ee-4f38-a870-0129971d99af.png> — Reply to this email directly, view it on GitHub<#1556 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AOGQCXVMRK54XFTBSBE3UGLWKTWLTANCNFSM6AAAAAASNRLVZI>. You are receiving this because you were mentioned.Message ID: ***@***.******@***.***>> <br /><br /> ICON plc made the following annotations. ------------------------------------------------------------------------------ This e-mail transmission may contain confidential or legally privileged information that is intended only for the individual or entity named in the e-mail address. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution, or reliance upon the contents of this e-mail is strictly prohibited. If you have received this e-mail transmission in error, please reply to the sender, so that ICON plc can arrange for proper delivery, and then please delete the message. Thank You, ICON plc South County Business Park Leopardstown Dublin 18 Ireland Registered number: 145835

[cgrinds]

hi @edd1619 what version of Harvest are you using?
I see capacity information in the Harvest 22.11 dashboards - so trying to understand if we're talking about different things?

1. Do you see the data you need in one of Harvest's dashboards?
2. Or, you aren't using the out-of-the-box dashboards, and you are instead querying Prometheus directly or via your own dashboards?
3. Can you share one or two prom queries you expect to return data that aren't?
4. Did these metrics exist earlier, and now they don't, or this is the first time you're trying to collect them?

[edd1619]

Hi Chris, We are on version 21.08. We see LUN size/size used data in the dashboard but no Volume, Aggregate or Qtree size/size used data. WeE are unable to create the query because we do not see ‘aggr_size’ or ‘aggr_size_used’ metric when trying to create the query, we only see ‘aggr_disk….’ options. We should have the 2 previous mentioned metrics as well?? ***@***.*** These did not exist. We are just moving to Harvest 2.0 so it is new setup. Thanks! From: Chris Grindstaff ***@***.***> Sent: Monday, November 28, 2022 2:42 PM To: NetApp/harvest ***@***.***> Cc: Dannenfelser, Edward ***@***.***>; Mention ***@***.***> Subject: [EXTERNAL] Re: [NetApp/harvest] Enabling capacity metric collection (Discussion #1556) hi @edd1619<https://github.com/edd1619> what version of Harvest are you using? I see capacity information in the Harvest 22.11 dashboards - so trying to understand if we're talking about different things? 1. Do you see the data you need in one of Harvest's dashboards? 2. Or, you aren't using the out-of-the-box dashboards, and you are instead querying Prometheus directly or via your own dashboards? 3. Can you share one or two prom queries you expect to return data that aren't? 4. Did these metrics exist earlier, and now they don't, or this is the first time you're trying to collect them? — Reply to this email directly, view it on GitHub<#1556 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AOGQCXSQOIQVO6U5BW7TJE3WKUDH5ANCNFSM6AAAAAASNRLVZI>. You are receiving this because you were mentioned.Message ID: ***@***.******@***.***>> <br /><br /> ICON plc made the following annotations. ------------------------------------------------------------------------------ This e-mail transmission may contain confidential or legally privileged information that is intended only for the individual or entity named in the e-mail address. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution, or reliance upon the contents of this e-mail is strictly prohibited. If you have received this e-mail transmission in error, please reply to the sender, so that ICON plc can arrange for proper delivery, and then please delete the message. Thank You, ICON plc South County Business Park Leopardstown Dublin 18 Ireland Registered number: 145835

[cgrinds]

Thanks! That explains why we're seeing different things. That version is quite old. We've had six releases since then with many bug fixes and new features. Can you upgrade to 22.11 and take a look at the new dashboards that should include what you're looking for.

There are several dashboards that use the metrics under aggr_space_*, volume_size, volume_space_physical_used, volume_space_logical_used, volume_size_used.

It's probably best to upgrade, import the Harvest dashboards, and take a look at the capacity panels already exposed in Aggregate, Disk, Lun, Qtree, and Volume. Those panels can be inspected for their prom query and metrics.

[Dinesvl]

Hi Cris,

Could you please give me link for 22.11 version .rpm offline installation files for redhat? I tried installing 22.11 and failed to download some repo's while installing. I don't have internet in the client machine which i am trying to upgrade. Thanks

[edd1619]

Great thank you! We will try upgrade. On the upgrade topic, we tried an upgrade in test and it was not too smooth. Is there a detailed upgrade link you could provide? Thanks! From: Chris Grindstaff ***@***.***> Sent: Monday, November 28, 2022 3:20 PM To: NetApp/harvest ***@***.***> Cc: Dannenfelser, Edward ***@***.***>; Mention ***@***.***> Subject: [EXTERNAL] Re: [NetApp/harvest] Enabling capacity metric collection (Discussion #1556) Thanks! That explains why we're seeing different things. That version is quite old. We've had six releases since then with many bug fixes and new features. Can you upgrade to 22.11<https://github.com/NetApp/harvest/releases/tag/v22.11.0> and take a look at the new dashboards that should include what you're looking for. There are several dashboards that use the metrics under aggr_space_*, volume_size, volume_space_physical_used, volume_space_logical_used, volume_size_used. It's probably best to upgrade, import the Harvest dashboards, and take a look at the capacity panels already exposed in Aggregate, Disk, Lun, Qtree, and Volume. Those panels can be inspected for their prom query and metrics. — Reply to this email directly, view it on GitHub<#1556 (reply in thread)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AOGQCXUVQOOGLT3ZJTXN2YTWKUHV7ANCNFSM6AAAAAASNRLVZI>. You are receiving this because you were mentioned.Message ID: ***@***.******@***.***>> <br /><br /> ICON plc made the following annotations. ------------------------------------------------------------------------------ This e-mail transmission may contain confidential or legally privileged information that is intended only for the individual or entity named in the e-mail address. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution, or reliance upon the contents of this e-mail is strictly prohibited. If you have received this e-mail transmission in error, please reply to the sender, so that ICON plc can arrange for proper delivery, and then please delete the message. Thank You, ICON plc South County Business Park Leopardstown Dublin 18 Ireland Registered number: 145835

[rahulguptajss]

@Dinesvl I suspect rpm downloaded on your end got corrupt. Could you share the command, you are running. I tried below and works fine.

rpm -i https://github.com/NetApp/harvest/releases/download/nightly/harvest-22.12.13-nightly.x86_64.rpm

[Dinesvl]

@rahulguptajss
I used below commands.
yum install harvest-22.12.12-nightly.x86_64.rpm
yum localinstall harvest-22.12.12-nightly.x86_64.rpm

Also no response when i tried rpm -i command which you gave

[rahulguptajss]

Let's try to see if rpm downloaded is not corrupted. Could you share output of below commands

rpm --checksig harvest-22.12.13-nightly.x86_64.rpm
rpm -qip harvest-22.12.13-nightly.x86_64.rpm
rpm -qa | grep harvest

Note that today nightly rpm name is harvest-22.12.13-nightly.x86_64.rpm

[Dinesvl]

I tried with RPM name harvest-22.12.13-nightly.x86_64.rpm.. and it worked fine. Can i monitor the spikes for 1 more day ?

[rahulguptajss]

cool. Yes let's monitor it.

[edd1619]

Great thanks for the help Chris! From: Chris Grindstaff ***@***.***> Sent: Monday, November 28, 2022 3:33 PM To: NetApp/harvest ***@***.***> Cc: Dannenfelser, Edward ***@***.***>; Mention ***@***.***> Subject: [EXTERNAL] Re: [NetApp/harvest] Enabling capacity metric collection (Discussion #1556) hi @edd1619<https://github.com/edd1619> take a look at https://netapp.github.io/harvest/22.11/upgrade/<https://netapp.github.io/harvest/22.11/upgrade/> and if you have problems, hit us up on Discord<https://discordapp.com/channels/855068651522490400/1001963189124206732>. — Reply to this email directly, view it on GitHub<#1556 (reply in thread)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AOGQCXW4GUMQXDH4AAKZF23WKUJH7ANCNFSM6AAAAAASNRLVZI>. You are receiving this because you were mentioned.Message ID: ***@***.******@***.***>> <br /><br /> ICON plc made the following annotations. ------------------------------------------------------------------------------ This e-mail transmission may contain confidential or legally privileged information that is intended only for the individual or entity named in the e-mail address. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution, or reliance upon the contents of this e-mail is strictly prohibited. If you have received this e-mail transmission in error, please reply to the sender, so that ICON plc can arrange for proper delivery, and then please delete the message. Thank You, ICON plc South County Business Park Leopardstown Dublin 18 Ireland Registered number: 145835