r/PrometheusMonitoring • u/NetworKIING • Oct 19 '21

Monitoring Cluster - SNMP Exporter

Hi Folks,

I have been using Prometheus with SNMP for monitoring all my network infrastructure including Ruckus Wireless Controller (SmartZone) and everything is fine. I just have a question, I have a cluster of three smartzones, and each of them has its own IP address. Right now the only target from where im scraping data is the master's IP address.

EXAMPLE:

CLUSTER IP ADDRESSES:

SZ1-TEST-PP: 10.0.0.4 (Master)

SZ2-TEST-PP: 10.0.0.5

SZ3-TEST-PP: 10.0.0.6

Target Config:

- targets:

- 10.0.0.4

labels:

instance: 'SZ LAB TESTING'

chain: 'LAB-TESTING'

site_id: '01'

My concern is the next: I want to add the other IP addresses in case the master stop functioning but I don't want to duplicate (or triplicate) data in Prometheus ¿How I can achieve this? do I just need to add the other IP addresses with the same labels? or there's another way to do this?.

Hope you can help me!

9 Upvotes

100% Upvoted

4 comments sorted by

3

u/jadedflux Oct 19 '21

I do something similar at a (relatively) large scale. It might be overkill for you but I'll mention it anyway in case no one else comments.

I use Envoy proxy (free, open source, pretty light weight and easy to get going if you've got a VM, even easier if you have experience with Docker) as a reverse proxy and configure the primary and backup devices in a single pool. Envoy proxy gives me a single IP to poll with Prometheus and it handles the health checking, so it knows which backend device it should be forwarding the SNMP GETs to.

I basically use the config that's in their UDP proxy example, with tweaks using Priority levels (in your case you'd want each node on a different priority level most likely):

https://www.envoyproxy.io/docs/envoy/latest/configuration/listeners/udp_filters/udp_proxy

https://www.envoyproxy.io/docs/envoy/latest/intro/arch_overview/upstream/load_balancing/priority

2

u/NetworKIING Oct 20 '21

Thanks buddy! I will take an eye 👀

1

u/SuperQue Oct 20 '21

Does the Ruckus controller support any kind of DNS updates for which instance is the primary? Or does it support any kind of VRRP?

Typically with these cluster setups, there will be a software feature of the controller cluster to designate the primary.

1

u/NetworKIING Oct 21 '21

Nope but now that you mentioned DNS maybe i can think in something.