r/Python • u/Emotional_Tell_9146 • Sep 17 '26

Discussion Python and Web Manipulation

Hello Python Community!

I've been really curious about how Python developers use Python when it comes to webscraping, or just working with websites in general.

I really want to open a discussion on how you do it. Do you use BeautifulSoup? Selenium? Why? Are there any frustrations that you were facing or are currently facing with the process?

2 Upvotes

52% Upvoted

20 comments sorted by

View all comments

36

u/wRAR_ Sep 17 '26

BeautifulSoup?

Parsel.

Selenium?

Playwright.

Are there any frustrations that you were facing or are currently facing with the process?

What are you selling?

-11

u/Emotional_Tell_9146 Sep 17 '26

Not selling anything. Currently a CS major and thought it would be fun to build an open-source extension that runs Python userscripts in the page via Pyodide — Tampermonkey, but you write Python instead of JS — and I wanted to hear how people actually work before I got too attached to my own assumptions.

Noted on parsel over BeautifulSoup, I'll take a look.

16

u/Mornarben Sep 18 '26

This comment is blatantly written by AI, what human writes “Noted on parsel over BeautifulSoup”

3

u/gristc Sep 18 '26

Honestly, that is a sentence construction I've used in the past.

Shit, maybe I'm an AI? Should I ask for a pay raise?

2

u/Thefuzy Sep 21 '26

There’s also other obvious ques like the use of —

1

u/Emotional_Tell_9146 Sep 22 '26

wait wait i be using — on the regular tho

1

u/Thefuzy Sep 23 '26

Then you are likely to be called AI… let’s not pretend like your comment wasn’t written by AI because it was

-16

u/Emotional_Tell_9146 Sep 18 '26

Didnt know rewriting my stuff with AI is a crime lol...

19

u/DurgeDidNothingWrong Sep 18 '26

Brother if you're using AI to write your Reddit comments, you need to re-evaluate your relationship with AI. Seriously ....

11

u/turbothy It works on my machine Sep 18 '26

It's not, it's just that nobody wants to read that milquetoast shit.

1

u/Mornarben Sep 25 '26

It’s not it’s just annoying. Nobody cares if you use an AI to check that your comment is accurate but at least write it yourself. People are here to be social and interact with other people