“Discovered - presently not indexed” means Google knows astir the URL but hasn’t yet crawled oregon indexed it.

Follow this five-step process to diagnose and hole the issue.

If you lone spot a fewer pages with the “Discovered - presently not indexed” issue, effort requesting indexing via Google Search Console (GSC). To bash that, click “URL inspection” connected the paper and participate the page’s URL. If it’s not presently indexed, deed the “Request indexing” button. 

If each is good, you should spot a connection that the URL was added to the precedence crawl queue. 

If this doesn’t work, there’s astir ever an underlying contented you request to diagnose and hole earlier requesting indexing for a 2nd time. So support reading.

Crawl budget is however accelerated and however galore pages a hunt motor wants to crawl connected your site. If your crawlable URLs transcend your crawl budget, you whitethorn spot the “Discovered - presently not indexed” warning.

According to Google’s Gary Illyes, 90% of sites don’t request to interest astir it. However, though issues with crawl budgets thin to impact larger sites, circumstantial method setups, problems, and mistakes tin pb to issues connected smaller sites.

Let’s look astatine a fewer things that tin pb to crawl fund issues and however to amended them.

Do you service contented from subdomains?

Let’s accidental your main website is connected example.com, but you person assets connected a subdomain specified arsenic cdn.example.com. In this case, the plus subdomain whitethorn beryllium considered portion of your main website and grouped unneurotic for the crawl budget. 

Consider serving assets from a CDN URL with a abstracted crawl fund to solve this. 

Do you person unnecessary redirects?

Typically, erstwhile we determine to region a leafage from the website, we adhd a redirect to different applicable page. However, this isn’t ever necessary. Unless the leafage has backlinks oregon traffic, it’s amended to region oregon regenerate interior links to the deleted leafage and instrumentality a 404. 

Here’s a flowchart explaining the process:

You tin find redirected URLs with interior and outer links escaped of complaint with an Ahrefs Webmaster Tools (AWT) account. Here’s the process: 

1. Crawl your website with Ahrefs’ Site Audit
2. Go to the latest crawl
3. Go to the Redirects report
4. Click connected the fig of interior URL redirects
5. Add columns for “No. of each inlinks” and “No. of referring domains”

Do you person duplicate content?

Duplicate contented is erstwhile you person adjacent oregon nonstop copies of pages accessible astatine aggregate URLs. Examples include:

• The aforesaid pages are accessible astatine www and non-www versions of your site, arsenic good arsenic HTTPS and HTTP.
• Development oregon staging instances.
• Empty merchandise oregon class pages with boilerplate content.

The mode you lick duplicate contented issues depends connected your circumstances. 

Learn more: Duplicate Content: Why It Happens and How to Fix It

Have you utilized interior nofollow links?

Nofollow links won’t forestall the leafage from being indexed. However, utilizing them internally tells hunt engines a leafage is not important.

Here’s however to find pages with nofollowed interior links for escaped utilizing AWT:

1. Crawl your tract with Site Audit
2. Go to the Links report
3. Click the “Issues” tab
4. Look for the “​​Page has nofollow incoming interior links only” and “Page has nofollow and dofollow incoming interior links” warnings and notices

If the leafage is important, regenerate the nofollow links with followed ones. 

Do you person orphan pages?

If the lone mode to observe your caller leafage is from the sitemap and it has nary interior links, Google whitethorn see it unimportant. 

I’ll sermon this successful much item beneath erstwhile talking astir interior linking.

Google doesn’t scale everything it discovers. It prioritizes high-quality, unique, and compelling content. As Google hasn’t yet crawled pages with this warning, it can’t cognize whether the contented is debased prime oregon not. However, it whitethorn person an thought based connected akin pages that it’s already crawled—which is wherefore it whitethorn person “deprioritized” crawling.

Here are a fewer types of contented Google is improbable to index:

• Machine-translated content – The translations volition beryllium acold from cleanable if you usage Google’s Translate API oregon akin to localize content. In which case, it’s not peculiarly utile to searchers.
• Spun content – This is wherever you usage bundle to rewrite content. The effect is astir ever low-quality, plagiarized content.
• AI-generated content – AI penning tools are gaining popularity, but they seldom make utile contented without quality involvement. 
• Thin content – These are pages without overmuch unsocial content. 

If immoderate of these use to your content, usage the flowchart beneath to hole the issue:

In short, if you person bladed content, merge it with different bladed contented to make thing utile oregon delete it. Otherwise, amended the content. If the resulting contented isn’t made for integrated search, noindex it truthful hunt engines tin prioritize crawling much important pages. 

Internal links are links from 1 leafage connected your website to another. Google often sees URLs without immoderate oregon galore interior links arsenic unimportant and whitethorn not scale them. You tin cheque if a URL has interior links for escaped with AWT. Here’s how:

1. Crawl your tract with Site Audit
2. Go to the Page Explorer tool
3. Filter for “All pages” nether “Content”
4. Add a file for the “No. of each inlinks”

If you selected backlinks and/or sitemaps arsenic URL sources erstwhile mounting up your project, you whitethorn besides beryllium capable to find immoderate orphan pages. Just spell to the Links report, click the “Issues” tab, and look for the “Orphan leafage (has nary incoming interior links)” error.

You tin besides usage Ahrefs to find interior linking opportunities betwixt 2 existing pages. Here’s how:

1. Go to the Internal nexus opportunities study successful Site Audit
2. Enter a keyword related to the leafage you privation to adhd interior links to
3. Choose “Keyword” arsenic the hunt mode

For example, let’s accidental Ahrefs wrote a station astir keyword research. Entering “keyword research” finds pages connected your tract that notation that keyword and shows you the context. You tin past adhd interior contextual links wherever relevant. 

Alternatively, you tin hunt wrong the leafage substance utilizing Page Explorer to find imaginable pages to nexus from erstwhile you are publishing a new page.

However, nary of these tactics tin regenerate a bully website operation with logical interior linking. That’s thing each tract should prioritize. However, if you’re facing issues, 1 mode is to “hack” your crawl extent and guarantee each your interior pages are linked from an HTML sitemap.

An HTML sitemap is an HTML leafage that gives users a amended representation of your website operation and an easier mode to navigate. Unlike XML sitemaps, which are made to beryllium parsed by antithetic systems, HTML sitemaps are made for users. While they’re sometimes considered a happening of the past, they are inactive relevant. 

If you person a large website, you whitethorn privation to see splitting it into a logical structure, arsenic you don’t privation tens of thousands of URLs linked to from a azygous page. Check retired however LinkedIn does it for inspiration.

Backlinks are 1 of the signals Google uses to determine whether a leafage is apt to beryllium invaluable and worthy of crawling. If your leafage has nary oregon fewer high-quality backlinks, it whitethorn beryllium 1 of the reasons Google has “deprioritized” crawling.

Getting much backlinks is astir apt the hardest of each the listed, but it does wage off. Even 1 invaluable nexus tin assistance Google observe your contented and scale it faster. 

You tin spot however galore backlinks immoderate leafage connected your website has for escaped with AWT.

If you privation to cheque a circumstantial page, paste it into Ahrefs’ Site Explorer and cheque the Overview report.

If you privation to spot which pages bash oregon don’t person galore backlinks, participate your domain into Site Explorer and cheque the Best by links report. 

If an important leafage has fewer oregon nary backlinks, see trying to build more.

Keep learning

• Google’s New Search Console URL Inspection API: What It Is & How to Use It
• How to Fix “indexed, though blocked by robots.txt” in GSC