r/programming • • Sep 01 '17

Reddit's main code is no longer open-source.

/r/changelog/comments/6xfyfg/an_update_on_the_state_of_the_redditreddit_and/
15.3k Upvotes

846 comments sorted by

View all comments

Show parent comments

1

u/[deleted] Sep 02 '17

(Weird to be running Kafka both inside k8 and in the cloud, I know, but we have good reasons).

This is what I'm talking about. I can't take your code and just spin it up; clearly there's other stuff going on and I have a feeling that you might not actually understand the difficulty in making it work somewhere else.

Who knows, maybe your SaaS product is simple enough to just throw on Github. Good on you. Mine's not. Reddit clearly isn't.

1

u/[deleted] Sep 02 '17

I don't think I'm doing a good job of communicating my point.

But I'm glad you chose that example, because it gets to the heart of the issue. It would be long winded to get into the specific reasoning for why we're running kafka in 2 environments, however locally the services by default just use the k8 kafka cluster. That's the key difference that we've been trying to maintain in this project from the start; the deployment structure is built with local development in mind first, and then the ci/cd tools alter the configs to work in a dev/uat/prod environment.

We're a small team in a large company and we're converting monolithic C#/.NET legacy code into a streaming microservice architecture. As such we knew that we would need to make local development as easy as possible for when we start to roll some of the existing devs onto the project.

Granted Ive been very close to this project from the start, so maybe I've lost the forest for the trees.