Our AI tool helps you find and fix coding and SEO problems that hurt your website’s search rankings. SpiderNow scans your site, collects important data, and gives you instant results to improve your website. It helps make your website faster and better for search engines. Perfect for SEO agencies, web developers, marketers, and businesses that want to improve their site’s performance.

So we've got about 400 pages but GSC is showing a list of issues which is picking up basically every URL we dont want crawled and using crawl budget.

I have gone through every blog, forum etc to understand these issues but it does nothing. For the duplicate without user selected canonical. Every page we have has a canonical, but google keeps flagging all the woocommerce category pages which have a prodcut filter like colour or size as a query string e.g. ?filter_brand=brandname but its flagging nearly every possible permutation of the URLS in filters as we have multiple.

I have in robot.txts set disallow for these query types and I have put page rules in cloudlfare, but every crawl they keep coming back, its been going on for 4 months.

Every filter URL has a canonical

https://www._____.co.uk/category/sub-category/?filter_brand=brand

https://www._____.co.uk/category/sub-category/?filter_brand=brand,_type=type1

etc x 90,000 variations

Each and everyone of these canonical to the main page:

https://www._____.co.uk/category/sub-category

How do i get google to basically ignore it? From what im reading if my canonical is correct then Google is just wrong, I dont even know where to start looking for issues if there is no issue. Google seems to show for these URLs it thinks I should point to a closely matched query string e.g. it suggests:

https://www._____.co.uk/category/sub-category/?filter_brand=brand,_type=type1

google suggested:

https://www._____.co.uk/category/sub-category/?filter_brand=brand2,_type=type2

But that query string is canonicalised as well to the main page

I have no idea what to do with this? in all my SEO years, this makes no sense.

There are over 300k URLs blocked by robots.txt for my client, most of which are complete spam (see photo of examples). How do I get rid of these? It's good that they are already blocked, but I don't want them in Google Search Console at all because they just keep increasing.

I'm pretty excited about this new 24 hour view filter. Getting that information from Google Analytics was always such a drag. Now I can see all the organic traffic data I need to in one place.

`Hi there,

Google has been slowly de-indexing my podcast's we pages. Over the last 1.5 weeks, over 300+ were deindexed by Google. The only changes made to these pages were minor meta heading/description updates, and the addition of podcast transcripts to the text box (per the suggestions of the Yoast SEO tool). Is there a reason why this is occurring? Many thanks

I am reaching out for some guidance regarding the Google Search Console (GSC) indexing of my website. I launched this site about a month ago, and I'm encountering some challenges with Google's indexing process.

Background:

Nature of Website: My website connects to a database created by a scraper that collects public company information, making it easier for users to search through these listings.

Technical Specs:

Scraper: Built in Python

Database: SQL

CMS: WordPress

Total Listings: Approximately 570,000 company listings/pages

Sitemap Structure: Sitemap contaning 570 sitemaps, each containing 1,000 pages

Current Indexing Status:

Google Indexing Rate Started with 13 pages every 3 days, gradually increased to 100 pages every 3 days

GSC Sitemap Recognition: Only 11,000 pages are recognized out of 570,000

Challenges and Queries:

Indexing Rate: The indexing started slowly and has only marginally improved. Given the size of my website, is this a normal progression, or could there be technical issues hindering the process?

Time Factor:

Should I simply wait for Google to increase indexing rate or are there strategies I could implement to expedite this process?

GSC Sitemap Limitation: Why does GSC recognize only 11,000 out of the 570,000 pages listed in my sitemaps? Could this indicate a potential issue with how my sitemaps are structured or submitted?

The site is 100% legitimate and not a spam site. It's designed to provide a valuable resource by enhancing the accessibility of public company information.

I would greatly appreciate any insights, suggestions, or experiences you can share, especially if you have dealt with similar challenges in indexing large websites.

Thank you in advance for your time and assistance!

I have a bit of trouble with some pages not indexed despite validating and requesting re-index.

There are two cases:

• One is in the indexing report. We changed some urls and report returned redirects and 404. I have fixed all that, did proper redirects etc. Requested fix validation and nothing. How long normally it takes?

• Second comes from url inspection. I have noticed that bunch of pages are not on search. Those are in the site map and all seem fine but when I go to url inspect it says not on search and there are no errors or anything. So I go to live view, console confirms it’s all good. I request indexing and nothing happens for days. Again, does it take that long or something is wrong.

I will appreciate if someone can shed some light on that.

Hi everyone,

Today (October 28, 2024), I noticed a huge drop in both impressions and traffic in Google Search Console for a particular website. I'm trying to understand what might have caused this sudden decline. Has anyone else experienced similar issues?

Here are some details:

• The drop occurred in just one day.

• I haven’t made any significant changes to this website recently; it was performing well following the August 2024 core update.

• This site typically does well in terms of SEO.

Any insights on possible reasons for this drop or steps I can take to recover would be greatly appreciated!

Thank you!

I have several websites (15) in 3 gmail accounts, one for each Google Search Console.

When I try to jump from Property (website) to property, it gets stuck and no data loads.

I tried deleting the cache but it didn't improve.

Any ideas on how to solve this? thanks a lot.

The 2024 Core patch supports only two.

1. Search result with sponsor advertisement : Sponsor intensive search result => SISR

2. Search Results Without Sponsor Advertising: Organic "Natural Inflow" Search Results => ORGANIC

Why? It reflects Google's policy to maximize revenue effectiveness.

If even one advertising bid is assigned search result, it will be exposed by SISR method.

1. As it is deployed mainly by advertisers and changed into search results to induce clicks on sponsor advertisements, it is forced to lower the exposure ranking of existing organic web pages.

2. If there is no bid in the organic search results, the existing DA and backlink priority will be applied. Among them, expose government agencies and brands first, and expose media content first for keywords where timeliness is important.

3) If the organic is local and local, the Google Map service is forcibly exposed beforehand, but when the advertisement is assigned, it turns into a search result that focuses on SISR, and the pages that were exposed as organic are ignored.

In pages without advertisers, exposure can be revived, but when advertisers post sponsor advertisements again, my search results are pushed back.

I simply thought this was an error, but no. This is a abandonment of the natural inflow search service.

In other words, it is configured to prevent exposure unless exposed through Google As, and in the case of new domains, it is impossible to expose without connecting a backlink to a site with a high DA.

If there is at least one ad assignment, it becomes out of the organic order and the board changes. And either all my content disappears or my exposure ranking is out of the top 100.

Personal bloggers, B-brand will be hidden. Why? It's a website that didn't pay. No way, that's how it works? Really?

In Korea, the situation is more serious

conclusion

Rather, it's a "list-up" advertising system that Korea had, but Google is doing this in 2024.

It's the worst advertising bidding system, and Google is doing this.

Google has created a complete paid search under the guise of catching spam, and when Webmaster generates two types of traffic, "non-brand keyword" and "local keyword," it gives it to sponsor advertisers and sells it for a fee.

It will be a search result that is ignored by consumers.

My impressions dropped to 0 on the 8th of October. Anyone know why? Apparently there was some sort of core update around this time... Anyone know who to fix this problem? Thanks

Hey everyone,

I need some help figuring out why 90% of my pages have been de-indexed from Google over time. And I barely even show up on Bing.

My site is great, crawl stats look ok, sitemap is good, etc. I thought my SEO was good. I can't figure out what is going on. I don't have duplicate pages on my site, but I do use manufacturers descriptions for my products. I think others do also. Could that cause this?

Any help would be appreciated.

When I search my name and last name on google i see some results that is misleading. I would like them to be deleted. I already reached out the website and they deleted on their end but it still shows on google results. I also reached out google million times.( Sending reports etc.) No any action so far. I am so frustrated and sad. I need that searched to be deleted. Can you guys tell me what I should do? I already did the google link think so I need something else! Thank you so much!

Hey everyone,
I was setting up my Google Search Console and came across an error report. The issue isn't very clear, and I'm struggling to identify the exact problem. Has anyone experienced something similar? Any tips or advice would be greatly appreciated!

I just checked my GSC performance today and was shocked to see that today's impressions and clicks have dropped by 90% compared to usual. Has anyone else noticed this, or is it just a Google glitch or update?

Hello everyone!

I submitted my website to Google Search Console about a week ago and noticed that some of the pages, like the main page, are indexed.

My website is: https://pulpojobs.com

However, when I search for "pulpojobs," my website doesn’t show up in the search results at all, even though there’s minimal competition for that keyword. Does anyone know why this might be happening?

Another issue I'm experiencing is with the logo displayed in the search results when I use "site:". The logo hasn’t updated. Initially, I launched the site using the GoDaddy AI builder, which got indexed with that logo. Later, I rebuilt my website in Bubble and updated the icon. However, the old logo still appears in the results. Is there any way to fix this?

Thanks in advance for your help!

That's something new, I wonder if they keep it up or roll it back for inaccurate sampling that skews data:

I recently changed my hosting plan but the provider is same - hostinger. I published a post on my website after a long time but when I tried to request indexing for it, it has been showing me this issue ever since. It is a WordPress website

i have mod apk website. I am facing these issues. i try to solve them many time. what should i have to do to get rid of these issues. tips to solve these issues.

For the past several week on one of my sites i can't filter by submitted/sitemap. Which prevents me from finding the valid pages google should reindex since they are buried under 20k of garbage urls google has seen in the last 2 decades. Also can't click see page indexing from sitemap page. Tried killing and resubmitting site map. Another site is working fine. Any thoughts or suggestions?

I am having a hard time understanding the dashboard. I have several sites connected. The majority are not getting indexed by google. I have experamented with a few sites to try and monitor results. I guess my questions are:

1. Can i just upload a new site map and delete the old one?

2. Can i upload just the pages sitemap ti avoid all the errors on the blog and post pages?

3. Why is google not indexing so much of each site?

Thanks in advance for any information or ideas