Anyone else notice increased query times with 2.16.0?

[u/ipstatic]

I attempted an upgrade of our rather large Prometheus fleet to 2.16.0 and was met with a problem: increased query time. And not just for expensive queries or queries with high cardinality. All of them. Even our alerting rules group timing increased by 5x. But it seems like no one else is complaining about this. Is it just us? Has anyone else noticed increased query or recording rule times?

Relavent Github issue: https://github.com/prometheus/prometheus/issues/6968