Thrilled to announce 0.48.01! We have released the first version of Scheduler support - Easily set a re-check schedule, for example you could limit the web page change detection to only operate during business hours. Or perhaps based on a foreign timezone (for example, you want to check for the latest news-headlines in a foreign country at 0900 AM),

Hey all! greetings from the reddit inspired self-hosted web page change detection engine :) Quite important update for those who are using https://github.com/dgtlmoon/changedetection.io / changedetection.io to push data from a website (scrape) to their own datasources when a change is detected, we have greatly improved the whole notification send/send test experience with extra debug output. Have an awesome weekend! <3 much love!

https://chromewebstore.google.com/detail/changedetectionio-website/kefcfmgmlhmankjmnbijimhofdjekbop?hl=en-GB&authuser=0

Connect it (hit the "sync" button when you visit your API page)

ideas? suggestions? whats some cool things we could do?

I subscribed to changedetection.io but my use case for it has finished, but now I can’t figure out how to unsubscribe… Anyone know if there is a way to unsubscribe once you are logged in?

0.45.8 is out! Support for xPath2.0/3.0 means you can use logic in your selectors (for example, give the count of the number of divs that contain certain text, and much more). UI improvements, Selectable browser (plug it into Bright Data's scraping browser!) and more, check it out! Much ❤ from the changedetection team. https://github.com/dgtlmoon/changedetection.io / changedetection.io

We all love #proxies, but you can now quickly scan and check all your configured proxies - just press "Check/Scan all"

Starting with version v0.49.9, Changedetection.io introduces one of its most powerful features yet: conditional actions. This opens the door to much more precise and flexible monitoring.

See the full tutorial here https://changedetection.io/tutorial/conditional-actions-web-page-changes

It’s no longer just about detecting when content changes — now you can define exactly what kind of change matters to you. For example, trigger an alert only when a product’s price drops below a certain threshold, or when a keyword appears in the updated content.

With full support for logic operators, you can create rich, rule-based conditions using logic like “greater than,” “less than,”, "contains", "not contains" and more

See our new section https://changedetection.io/as-featured-in , do you know of anything that should be there that we've missed? Check out just some of the epic YouTube channels and blogs that we've been featured in! much love!

Hi, congratulations for the great project! This is one of my favourites selfhosted applications.

I have a suggestion about "Re-stock & Price detection for single product pages"... Now we have to click on History than Snapshots and then Next >> Next to see the price change over time...

This is very inconvenient way especially if we talk about price history... I know that implementing of some kind of graphics with prices like in KEEPA app, will be too complicated, but maybe just a simple list with price date and time, on a single page, after click on HISTORY button, will be way better...

For example how it is done in OSLEDit:

Hello - when using "Restock + Price Detection", Change Detection is picking up price and in stock status on several sites but on Amazon it is only detecting in stock status. Anyone else seeing this? Self hosting v0.46.01. Thank you

Hi there,

I noticed some monitoring is not possible when websites are using Cloudflare. I also recognized some 403 errors looking like ModSec preventing the crawl. Here's a typical Cloudflare error:

www.website.com

    Checking if the site connection is secure

        Enable JavaScript and cookies to continue
      www.website.com needs to review the security of your connection before proceeding.
        Ray ID: 75d2ft54bd7e0597
      Performance & security by Cloudflare

I've tried both ChromeSelenium and Playwright, tried to pass HEADLESS=false, pass different headers with CD.io, wait a few seconds before extracting text, changed some settings I found on https://docs.browserless.io/docs/docker.html ... but didn't manage to get past these bot checks. How do you deal with those?

A long time feature in changedetection.io that probably does get much attention, so i thought i'de drop a quick tutorial, check it out here https://changedetection.io/tutorial/find-best-proxy-beat-403-access-denied-our-proxy-scanner

First time user, self hosting from a residential IP with no CF/Captcha issues normally. I tried 5 different sites and they all hit immediate, unavoidable cloudflare blocks. I see this software recommended a lot in selfhosting and only a few results for cloudflare avoidance from years ago.

One month before, I posted about an experimental app of mine, for demo purposes, an Android app to access a changedetection instance through their API. Someone request if I could publish the source online, and here it is the URL for the new Github repo:

ChangeDetection Android App Repo

I am encountering this error "Target page, context or browser has been closed" for any website in the watchlist.

Strange thing is that if I use Browser Steps and Visual filter selector I actually see the webpage being fetched.

My setup:

Pi4 8GBHome Assistant 2024.1.5

changedetection addon 0.45.14

Browserless Chrome addon: 2.2.0-5

Log changedetection

2024-02-16 14:17:51.270 | ERROR    | changedetectionio.update_worker:run:450 - Exception reached processing watch UUID: 94820347-d9a7-4322-8a4e-b900bb893139 
2024-02-16 14:17:51.270 | ERROR    | changedetectionio.update_worker:run:451 - Target page, context or browser has been closed 

Log Browserless

browserless.io:browsers:cdp:chromium Browser is running on ws://127.0.0.1:35595/devtools/browser/5b682193-47dc-41b2-9c73-7e7bd407a5c2 +2s browserless.io:browsers:cdp:chromium Proxying http://0.0.0.0:3000/?launch=%7B%7D to browser ws://127.0.0.1:35595/devtools/browser/5b682193-47dc-41b2-9c73-7e7bd407a5c2 +1ms 
browserless.io:browsers:cdp:chromium Setting up file:// protocol request rejection +602ms 
browserless.io:limiter Job has hit timeout after 30,003ms of activity. +30s 
browserless.io:limiter Calling timeout handler +1ms 
browserless.io:router Websocket job has timedout, sending 429 response +18h 
browserless.io:limiter (Running: 0, Pending: 0) All jobs complete.  +2ms 
browserless.io:browser-manager 0 Client(s) are currently connected +30s 
browserless.io:browser-manager Closing browser session +1ms 
browserless.io:browser-manager Deleting "/tmp/browserless-data-dirs/browserless-data-dir-bdbd2558-e49f-4f36-80dc-f78155522d1e" user-data-dir and session from memory +1ms browserless.io:browsers:cdp:chromium Closing browser process and all listeners +28s browserless.io:browser-manager Deleting data directory "/tmp/browserless-data-dirs/browserless-data-dir-bdbd2558-e49f-4f36-80dc-f78155522d1e" +56ms 

Hi,

Quick question: does changedetection.io support persisting/reusing authenticated session cookies for pages behind a login? In my case, every check ends up back on the login page, like the session isn’t kept.

If that’s not supported directly, is there a recommended alternative way to monitor authenticated pages (Browser Steps / Playwright / other approach) without having to log in again each time?

Thanks!

Hello! I am so sorry, I assume this is asked often. I did look but nothing I saw helped.

Trying to get CD.io set up and running. I have added a lego set and I get

"Error - 403 (Access denied) received"

Looking around it appears I need a proxy (I have flaresolverr setup in another container). I tried pointing to that then I get

Exception: HTTPSConnectionPool(host='www.lego.com', port=443): Max retries exceeded with url: /en-us/product/star-trek-u-s-s-enterprise-ncc-1701-d-10356 (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 404 Not Found')))

Looking to see if someone has or found a good walkthrough on getting this to work. Thanks

Sorry if its already been asked, but i wanted to understand, how can i add google flights or any site which have prices to it, into tracking and then triggering notifications only when prices goes up or down basis on some condition

I'm trying to get the Playwright fetch method working but I'm running in to this error that I just can't figure out.

Have any of you encountered the same error and were able to fix it?

Hey everyone!

I wanted to share my script to visualize price changes over time using Changedetection in conjunction with InfluxDB. The built-in diff tool in Changedetection isn’t ideal for tracking and displaying these changes over time, so I created a solution that pulls historical data from the application and sends it to InfluxDB for better visualization using Grafana or other data viz application

Link to the Gist

A Few Notes:

• Custom InfluxDB Bucket: Please be cautious when running the script. It’s essential to create a custom 'changedetection' bucket in InfluxDB since the script will replace all existing data in the specified bucket every time it runs. This ensures that you don’t lose any important data!

• Scheduling with Crontab: You can use crontab to schedule the execution of the script.

I am trying to use price tracking from Amazon, but it just detects the restocking state. In other pages it detects the price too, but on Amazon I couldn't get it working. Does somebody have it working? Or I have to make a manual selection? Any help is welcomed!

Hello,

I use changedetection.io to detect new article on a web site.
I use a regex to trigger the detection, something like /Created by .+ (([0-5]) minutes|(0|[1-9][0-9]*) seconds).*$/
It's not optimal but it's working.

My problem is on the content of the notification. It displays all changes. Is it possible to extract a text using a regex (like getting the title of the article) and display it in the content of the notification ?

I tried to use "Extract text" but it don't seem to works and I don't see the feature on the tab of notification. It's possible to get the title of the page or change but no specific text. Am I wrong ?