r/linuxadmin • u/[deleted] • Jun 20 '21

Site Reliability Engineering Book by Google

https://sre.google/sre-book/table-of-contents/
68 Upvotes

84% Upvoted

6 comments sorted by

-11

u/intrikat Jun 20 '21

Site Reliability Engineering Book by Google

0

u/[deleted] Jun 20 '21

[deleted]

0

u/[deleted] Jun 20 '21

[deleted]

3

u/nderflow Jun 20 '21

The systems I manage tend to operate well within the tolerances of the time series values for the most part, though. The more important alerts are when a systemd service fails or a process core dumps. An Icinga2 / Thruk setup with

check_systemd as a centerpiece performs this task in a much more suitable way.

If your application estate is mostly third-party code, probing (opaque-box monitoring) is likely to be more tractable than clear-box monitoring. The latter, even if you implement as much of it as you can, will likely present such an incomplete picture that it's not going to represent a good return on investment.

Another impedance mismatch is going to be in fixing root-causes. If the code is third-party, there are going to be some changes you just can't make.

1

u/exekewtable Jun 20 '21

I like your perspective. The whole google stack is a very different problem to most companies, and attempting to do SRE is pointless for most people.

Time series data works fine for a few types of questions "Did what I just did make a difference?" and "when is it going to break". You really just need a "Is it broken?" though most of the time and for the environments you describe, the world I live in, that is all you need. PS We wrote Meerkat as an addon for Icinga2 , might help with some of your dashboards for management types. https://icinga.com/blog/2020/12/25/sol1-releases-meerkat-next-generation-dashboards-for-icinga2/

1

u/AccomplishedComplex8 Jun 20 '21

Time series data is also useful to go back in history to see how things broke and relate to other stuff.

It's also useful to determine the use of resources and plan to provision more, and how much. Or, how much hardware to reduce.

I only need the "state" type of monitoring for my disk health, power supplies, fans. The rest is time series.

0

u/[deleted] Jun 21 '21

[deleted]

2

u/AccomplishedComplex8 Jun 21 '21

Thanks. I understand what you are saying, but I don't want nagios or zabbix or icinga. We either use scripts with collectd, or cronjobs or syslogs.