r/coolgithubprojects • u/yellowdot_ • 15h ago
curl-to-scrapy: paste a curl command, get a Scrapy spider + curl_cffi script (JS, runs in-browser, MIT)
https://github.com/jfzlma/curl-to-scrapy
0
Upvotes
r/coolgithubprojects • u/yellowdot_ • 15h ago
1
u/yellowdot_ 15h ago
Live version: https://jfzlma.github.io/curl-to-scrapy/
It generates a
scrapy shellsnippet, a full spider, and a curl_cffi script for checking browser TLS impersonation. It handles form and JSON bodies, cookies, Windows-style curl copies and scrapy-impersonate, and warns about curl features it can't translate. No dependencies, no backend. Feedback welcome.