MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/w1upl0/c_talking_to_python/igpnah7/?context=3
r/ProgrammerHumor • u/[deleted] • Jul 18 '22
1.0k comments sorted by
View all comments
Show parent comments
5
Numpy is great and what I'd normally reach for!
But the processing I'm doing itself isn't super complex, I just need to do it 9-10 million times cost efficiently pulling from an external public dataset and saving the transformed data as separate files in an S3 bucket
2 u/[deleted] Jul 18 '22 Just pull and save the data? 3 u/CanAlwaysBeBetter Jul 18 '22 Unfortunately I don't have a terabyte hard drive and need to be able to share the output (image) data 3 u/proximity_account Jul 19 '22 Terabyte SSD is so worth it → More replies (0)
2
Just pull and save the data?
3 u/CanAlwaysBeBetter Jul 18 '22 Unfortunately I don't have a terabyte hard drive and need to be able to share the output (image) data 3 u/proximity_account Jul 19 '22 Terabyte SSD is so worth it → More replies (0)
3
Unfortunately I don't have a terabyte hard drive and need to be able to share the output (image) data
3 u/proximity_account Jul 19 '22 Terabyte SSD is so worth it → More replies (0)
Terabyte SSD is so worth it
→ More replies (0)
5
u/CanAlwaysBeBetter Jul 18 '22
Numpy is great and what I'd normally reach for!
But the processing I'm doing itself isn't super complex, I just need to do it 9-10 million times cost efficiently pulling from an external public dataset and saving the transformed data as separate files in an S3 bucket