How Google Search works: crawling, indexing, ranking, in plain words
Google finds pages, understands them, then picks which to show. You do not pay or submit to be listed. Here is what happens to one page of yours and what you can influence at each stage.
By Théophile Louvart, founder of Porteur · Updated 14 September 2026 · Markdown
The short version
- Crawling: Googlebot discovers URLs from links, sitemaps and past crawls, then fetches them. It renders JavaScript with an evergreen Chromium in a second wave.
- Indexing: Google analyses text, images and video, understands the topic, groups duplicates, picks a canonical, and stores the page. Not every crawled page is indexed.
- Serving: for a query, systems rank pages by relevance, quality, usability and context. The results page adds features around them.
- There is no fee and no submission needed. A public page linked from a known page is found. A sitemap and Search Console speed discovery.
- For a new site, discovery and indexing take days to a few weeks. Ranking for competitive queries takes months. There is no confirmed sandbox.
What happens to one new page of yours
You publish
You ship /guides/getting-started on yourproduct.com. It is linked from /guides and the homepage.
Google discovers
Googlebot follows the link from your homepage or reads it from your sitemap.xml. If neither exists, discovery waits for a link from another site.
Google crawls
Googlebot fetches the HTML and static assets it sees. Heavy scripts or blocked assets delay or prevent full understanding.
Google renders
In a second wave, Google renders the page with evergreen Chromium to load client-side content. If key text only appears after user actions, Google may not see it.
Google indexes
Google decides if the page is worthy of indexing. It picks a canonical if there are duplicates and stores the page with its signals. Some pages are crawled but not indexed.
Google serves
When someone searches “getting started yourproduct” in your country, the ranking systems may show your page with a title and snippet. Features around it depend on the query.
A healthy path for /guides/getting-started: discovered from your sitemap on day 1, crawled on day 1 or 2, rendered within days, indexed within a week, first impressions within two weeks. There is no promise on timing.
Crawling: what you can influence
- Link the page from a page Google already knows. Add it to your main nav, footer and any relevant page. Use clear anchor text like “Getting started”.
- Submit a clean sitemap.xml. Include only canonical 200 URLs. Update it on publish. Point to it in robots.txt and in Search Console’s Sitemaps report.
- Keep robots.txt open. Do not block CSS, JS or images you need for rendering. Never block your whole site on production.
- Use URL Inspection’s Request indexing on one key URL. There is a small daily quota. It asks for a recrawl, not an instant ranking boost.
- Make the server fast. Return 200 for live pages, 301 for moved, 404 or 410 for gone. Avoid chains. Keep Time to First Byte low.
- Ensure mobile-first crawlability. Serve the same primary content on mobile and desktop. No interstitials that hide content on load.
What a fixed page looks like: /pricing is linked from the header, is in the sitemap, returns 200, loads key text without client-only rendering, and is not blocked by robots.txt.
Indexing: make it indexable and worth keeping
- Give each page a single canonical URL. Use rel=canonical to point to itself. Only point away if you truly want Google to index the other URL instead.
- Avoid thin duplicates. Do not ship empty tag pages or parameter variants that add no value. Consolidate with canonicals or redirects.
- Set indexability on purpose. No noindex on live pages. Avoid conflicting signals like a canonical to A but a redirect to B.
- Use a unique title and primary content that states the topic. A page with the same pitch as five others is likely to be skipped.
- Check Search Console’s Page indexing report. “Alternate page with proper canonical tag” is fine if that is your intent. Fix it only when the canonical is wrong.
- Fix “Discovered, currently not indexed” by adding internal links and improving content quality. Fix “Crawled, currently not indexed” by making the page more useful and unique.
If /guides/getting-started and /guides/start-here are the same, redirect one to the other and keep one canonical. After that, Google keeps one indexed URL.
Ranking and serving: what matters and what does not
Google lists ranking systems it uses as of 2026. They include BERT, crisis information systems, deduplication, exact match domain system, freshness systems, helpful content guidance folded into core, link analysis systems and PageRank, local news, MUM, neural matching, original content systems, removal-based demotion, page experience system, passage ranking, reviews system, RankBrain, reliable information systems, site diversity system, and spam detection systems like SpamBrain.
- What you can influence on a small site:
- Match intent. Write the page a searcher wants. If the query is “yourproduct pricing”, show plans, limits and a clear next step on /pricing.
- Be helpful, original and trustworthy. Show who wrote it, how it works, evidence, and first-hand experience where relevant.
- Earn links. Links remain a signal among many. Publish pages worth citing and earn mentions from sites in your space.
- Page experience. Serve over HTTPS, be mobile friendly, avoid intrusive interstitials, and hit Core Web Vitals: LCP about 2.5 seconds, CLS about 0.1, INP about 200 ms.
- Technical basics. Make pages crawlable, indexable, canonical, and titled. Use clear headings. Use descriptive alt text for meaningful images.
- Target the right queries. A new site will not rank for “project management” soon. It can rank for “yourproduct project templates” faster.
- What does not matter the way myths claim:
- There is no single “domain authority” score at Google. Third-party scores do not feed Google directly.
- Keyword density, meta keywords and word count targets do not drive rankings.
- Social shares are not a direct ranking signal. They can help discovery and linking.
- Lists of “200 ranking factors” are folklore. Focus on the user, not a checklist of numbers.
A fixed /pricing page ranks for “yourproduct pricing” with a clear H1, honest details, fast load and real plans. It earns links from reviews and comparisons.
How long it takes and what to expect
- Discovery and indexing take from days to a few weeks for a new site. There is no promise.
- Ranking on competitive queries takes months. A 2017 Google video said four months to a year for SEO work to show its benefit.
- Nothing in Search Console until the property is verified and crawled. Data lags about two days. A new property shows the last 16 months of what Google already had for the site.
- There is no confirmed sandbox. New sites struggle for competitive terms because others already match intent with stronger signals.
If your site does not show up
- First, search site:yourproduct.com. If nothing shows, Google may not have crawled it or it is blocked.
- In Search Console, check the Page indexing report. Then use URL Inspection on a sample URL.
- Check robots.txt and the meta robots tag. Remove a stray noindex, and never ship Disallow: / on production.
- Submit a sitemap in Search Console. Ensure it lists clean, canonical 200 URLs.
- Get at least one link from a known site. A profile or a simple mention can trigger discovery.
- If your brand name is generic, expect to add a qualifier to your query. Rankings for brand terms without uniqueness are hard.
Classic case: a staging noindex shipped to production. Fix the tag, request indexing on the homepage, and wait for the next crawl to restore listings.
How to check rankings and traffic
- Use Search Console’s Performance report. It is Google’s own source for average position by query and page.
- For a spot check, search in an incognito window in the right country. Results are personalised by location and history otherwise.
- A rank tracker can monitor terms at scale. For traffic, use Search Console for Google clicks and your analytics for all sessions by channel.
- Similarweb or a suite can estimate another site’s traffic, with limits.
- Search Console definitions: an impression is when a link to your page appears on a results page a user loaded. For web search, scrolling is not required.
- Position is the highest link to your site on that page. Average position is the mean over impressions. A page can average 8 while appearing at 3 and at 40.
- CTR is clicks divided by impressions. The queries table omits rare and anonymised queries, so its sums are below the page total. The report holds up to 16 months. The default comparison is the last 28 days against the 28 before.
Diagnose a traffic drop by date
Find the drop
In Search Console’s Performance report, compare the period to the one before. Split by page and query to see where it fell.
Check Google’s side
Look at the Google Search Status Dashboard for a core update or spam update on those dates. Check Manual actions and Security issues.
Check your side
Review deploys. Look for redirects, noindex, canonical or robots changes. Check server errors and CDN rules.
Check seasonality
Compare the same period last year. Many niches dip in holidays or off seasons.
Check the results page
Search the queries. See new rivals or new features that push organic links down, such as visual units or an AI Overview.
If /guides/getting-started lost clicks but kept position, a new feature above it may have reduced CTR. Rewrite the title to fit the query better and test again.
Features on the results page and how they affect you
- Results pages change by query. News, images, videos, shopping, local and AI Overviews can appear and shift clicks.
- Impressions can rise while clicks stay flat if you moved to page one but below new features. Expect lower CTR on crowded pages.
- Titles and descriptions matter for CTR. Keep titles under about 60 characters. Write a clear meta description of 120 to 155 characters.
A fixed /guides/getting-started shows a concise title and a meta description that matches “getting started with yourproduct”, winning a higher CTR at the same rank.
Questions
Google discovers URLs from links, sitemaps and past crawls. It crawls and then renders pages with evergreen Chromium. It analyses content, groups duplicates, picks a canonical and indexes useful pages. For each query, ranking systems order results by relevance, quality, usability and context.
No. A public page linked from a known page is found. A sitemap and a verified Search Console property help Google find new URLs faster. You can request indexing for one URL at a time with URL Inspection. There is no fee to appear in Google’s results.
Google crawls more than it indexes. Common causes are thin or duplicate content, weak internal linking, or mixed canonical and redirect signals. Improve the page so it is clearly useful and unique, add internal links, fix canonicals, then wait for the next crawl.
Discovery and indexing can be days to a few weeks. Moving up on competitive terms takes months. A 2017 Google video said four months to a year for SEO work to show benefits. Start with specific queries you can satisfy now and build from there.
Use Search Console’s URL Inspection tool for the exact status. You can also try site:yourdomain.com "slug" as a quick look, but it is not exact. If not indexed, read the index coverage details and fix the specific reason shown.
Bing accepts URLs through IndexNow, which some platforms support. Google does not use IndexNow. For Google, rely on links, sitemaps and Search Console’s Request indexing for single URLs.
Sources
Check my site, free
Want a quick read on your site’s crawlability, indexability and target searches? Paste your URL into the free check and get three findings in about thirty seconds.
- Free check, no card
- Read-only, your own accounts
- Readable by your agent
Read next
- GuideHow to use Google Search Console in ten minutes a week
- GuideWhat an impression means in Search Console, and what it does not
- GuideThe Search Console performance report, column by column
- GuideTechnical SEO checklist for a small site
- GuideCanonical tags: what they do and the mistakes that cost rankings
- GuideAlternate page with proper canonical tag: what Search Console means
- GlossarySearch engine
- GlossaryChatGPT search