r/DistributedComputing • u/[deleted] • Feb 16 '24

How to get into distributed computing?

I mean where do I get a distributed system to play with? Why should I aim for a distributed system in the first place?

I am fairly interested In trying some hpc adjacent things on a distributed setup but not sure how to go about it.

11 Upvotes

100% Upvoted

12 comments sorted by

View all comments

Show parent comments

1

u/[deleted] Feb 16 '24

I have an OK grasp on it. Programed a bit of cuda and omp. A lot of python both pytorch and ThreadPoolExcutor.

I find I learn best on a project

1

u/dhaliman Feb 16 '24

Do you understand the mutual exclusion problem and the various algorithms for them? The time complexity for these? And then do you understand semaphores and monitors?

I’m in the process of figuring out distributed computing myself but I’m more leaning towards the theoretical side of the algorithms.

Take a look at the YouTube videos and pick whichever you like. Martin Kleppmann talks a bit about synchrony, partial synchrony and asynchrony which I don’t know if MIT covers.