been noticing a massive drop in crawl frequency on our deeper subdirectories lately. the main landing pages are fine, but anything more than
three clicks away from the root seems to be getting deprioritized. i checked the logs and it looks like the bot is hitting the
/sitemap_index.xml
but skipping the lower-level nodes. is anyone else seeing this with the recent core update? i tried updating our internal linking structure, but it hasn't fixed the
latency in discovery.
>it feels like we are being de-indexed by designmaybe check your robots. txt for accidental disallow rules ❓