Definition
Indexing is the step after crawling where a search system processes a page, understands its content and stores it in its index. Only indexed pages can be returned in search results. Search engines may choose not to index a page because of a noindex directive, duplicate content, quality signals or technical errors.
For example, Bizbloom publishes a new integrations page. Googlebot crawls it, but it stays unindexed for weeks because it is nearly identical to an older page. Some AI assistants retrieve pages through search indexes, so an unindexed page may also be missing from AI answers.
Why it matters
Indexing sits between being crawled and being shown. Some AI assistants retrieve pages through search indexes, their own or a partner's, so pages that are not indexed have fewer paths into answers. Being indexed does not guarantee a page will be shown or cited, but it is a prerequisite for many retrieval systems. Checking index status for key pages is a quick way to rule out a basic cause of low visibility.
What to do
- Check index status for key pages in Google Search Console and Bing Webmaster Tools.
- Fix accidental noindex tags, canonical errors and duplicate pages that compete with each other.
- Submit updated sitemaps and link important new pages from existing indexed pages.
Common questions
What is the difference between crawling and indexing?
Crawling is when a bot fetches a page. Indexing is when the search system processes that page and stores it so it can appear in results. A page can be crawled but not indexed, and an indexed page is not guaranteed to be shown for any particular query.
Does Bing indexing matter for AI search?
It can. Some AI products have used Bing's search index for web retrieval, though arrangements between companies vary and can change. Checking indexing in both Google Search Console and Bing Webmaster Tools gives you a broader view of whether your pages are available to retrieval systems.