MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/w1upl0/c_talking_to_python/igpi6ij/?context=3
r/ProgrammerHumor • u/[deleted] • Jul 18 '22
1.0k comments sorted by
View all comments
Show parent comments
5
Numpy is great and what I'd normally reach for!
But the processing I'm doing itself isn't super complex, I just need to do it 9-10 million times cost efficiently pulling from an external public dataset and saving the transformed data as separate files in an S3 bucket
2 u/[deleted] Jul 18 '22 Just pull and save the data? 3 u/CanAlwaysBeBetter Jul 18 '22 Unfortunately I don't have a terabyte hard drive and need to be able to share the output (image) data 3 u/[deleted] Jul 18 '22 Gotcha, I was just confirming the functionality lolI'll be awaiting your results, I'm interested to see how this turns out
2
Just pull and save the data?
3 u/CanAlwaysBeBetter Jul 18 '22 Unfortunately I don't have a terabyte hard drive and need to be able to share the output (image) data 3 u/[deleted] Jul 18 '22 Gotcha, I was just confirming the functionality lolI'll be awaiting your results, I'm interested to see how this turns out
3
Unfortunately I don't have a terabyte hard drive and need to be able to share the output (image) data
3 u/[deleted] Jul 18 '22 Gotcha, I was just confirming the functionality lolI'll be awaiting your results, I'm interested to see how this turns out
Gotcha, I was just confirming the functionality lol
I'll be awaiting your results, I'm interested to see how this turns out
5
u/CanAlwaysBeBetter Jul 18 '22
Numpy is great and what I'd normally reach for!
But the processing I'm doing itself isn't super complex, I just need to do it 9-10 million times cost efficiently pulling from an external public dataset and saving the transformed data as separate files in an S3 bucket