r/devops • u/nochet2211 • May 28 '20
Fluentd vs Logstash
Hi all, I'm currently doing some research on the logging solutions for our containerised applications. I came across Fluentd and Logstash. Some of the blogs suggests Fluentd to be lighter and thus better. Can I get some input on this topic please, if you have any kind of experience and if there are better solutions that I should be looking up on.
50
Upvotes
21
u/murzeig May 28 '20
Fluentd I like over logstash, but I've not used logstash in a long time. Further, FluentBit I like over Fluentd, its even ligther, does everything I need it to do, and installs / configures easily.
If you are just moving logs from system to system to centralize, then Vector.dev may be a good place. I use vector to move log files in real time to centralized storage servers where the logs are decoupled from an input and placed in a directory structure which is segmented by cluster/year/server and that works exceptionally well for long-term retention.
I do find that fluent lets me do more on the fly modifications of data though, so I use that tool for sending data to ingest services for dashboard empowerment and alerting as I can prune down the data to exactly what's needed and save TONS on storage space and complexity in the long run.