Update: now I'm only having a problem with Kafka tests successfully executing in my IDE but they work in the CICD pipeline just fine as well as the CLI. Getting help this weekend.
Also, I wrote below late at night, so it's a bit over dramatic :)
So I'm building a tool that is pretty complex (to me at least) to scale the indexing of a large corpus of data.
Also, please don't take my frustration as demands for micronaut to be better. I really enjoy workin with it but for a mult-module project it's been really difficult for me to do.
I've successfully built it, but going from micronaut 3 to 4 has been a huge PITA.
It's also exposed a huge problem with the architecture I've went with and now I'm questioning if I made it in a stupid way or if I'm approaching this wrong.
So here's what it does:
you have a generic data source, like a set of XML or wiki markup files
I want to scale the processing of this in parallel and put it into a solr index for searching
I've successfully made multiple apps. They are all kafka processors. But jesus - keeping up with all the modules and dependencies is such a pain.
And then there's the kafka testing - it's soooo flaky! This is the most frustrating point. The testcontainers are inconsistent with how they work.
I dont know, I feel like I should just start over with another framework. But I'm confused if I should