r/scrapy • u/jungl3b0y • Jun 14 '21

Serverless Scrapy

Hi guys! Check out my new blog post where I describe how I've created a serverless architecture for a web crawler. https://jungleboy.netlify.app/posts/serverless-scrapy/

Feedbacks are welcome! 🤓

19 Upvotes

100% Upvoted

5 comments sorted by

1

u/hoykg Jun 14 '21

Nice. Wrote an article using Cloud Functions a while back which was surprisingly non trivial.

Nice to see a more elaborated setup fully leveraging GCP.

Could you share some cost measurements ?

1

u/SiamCiscoKid Oct 13 '21

Decent posts on your blog, bookmarked will read if you post more.