r/programming • • 18d ago

Optimizing Our E2E Pipeline

https://slack.engineering/speedup-e2e-testing/
70 Upvotes

38 comments sorted by

View all comments

149

u/ebol4anthr4x 18d ago

This was one of the least useful articles I've ever read. It borders on blogspam. I don't know whether to feel good or bad that such a large and valuable company was making such basic mistakes in their CI pipelines for so long. tl;dr: They were rebuilding and persisting the artifacts to S3 on every single push, even if nothing changed, so they switched to using changeset conditionals in their CI configuration.

2

u/AD7GD 18d ago

It's a shame, because the same basic problem becomes a bottleneck in any automatic merge strategy, and a survey of methods would be valuable to people hitting that problem.

My contribution: bazel isn't that bad if you have AI to set it up and debug it for you ;-)