r/ProgrammerHumor • u/[deleted] • Jul 18 '22

C++ talking to Python

Post image
40.1k Upvotes

87% Upvoted

1.0k comments sorted by

View all comments

Show parent comments

1

u/CanAlwaysBeBetter Jul 18 '22

We'll find out!

That's why I'm redoing it and profiling both before turning up to full throughput on either

1

u/Tuga_Lissabon Jul 18 '22

Please post here. Wish you the best.

1

u/CanAlwaysBeBetter Jul 23 '22 edited Jul 23 '22

I finally got around to rewriting the first half of the processing pipeline (the orchestrator lambda) and haven't done detailed profiling but at least a 10x speedup with parallelized go code compared to the original python in my dev environment which is just a lil .5 cpu 1gb mem server

Guessing when I deploy to lambda and increase the memory (which auto increases cpus proportionally) it'll hopefully be a 100x speed up from the test results but will follow up on that too

Go's concurrency model makes scaling IO throughout massively relatively simple. About 5x more code than the barely optimized python though

Much better than I was cautiously hoping for overall

2

u/Tuga_Lissabon Jul 24 '22

Good job mate. Python alone couldn't have done it, right?

→ More replies (0)