How Google crawls, indexes and ranks websites

Module 1: SEO Foundations & How Search Works | Lesson 1 of 683 | 55 min read

By Michael Andrews, Wix SEO Expert UK

Before you can improve your Wix site's rankings, you need to understand the three-stage process Google uses to bring your pages into search results. Every SEO decision you make on your Wix site is ultimately about helping Google crawl your pages efficiently, index them correctly, and rank them for the right queries. Most SEO mistakes happen because people try to optimise without understanding this foundation. This lesson is the single most important foundation of the entire course.

How-to diagram showing the three stages of Google Search: Stage 1 Crawl where Googlebot scans web pages by following links, Stage 2 Index where information is stored and organised in a massive database, and Stage 3 Rank where relevant results are displayed based on hundreds of ranking factors
The Crawl → Index → Rank pipeline: every page on your Wix site must pass through all three stages before it can appear in Google search results.

The Three Stages of Google Search: The Complete Pipeline

Google Search operates as a three-stage pipeline: Crawl, Index, Rank. Each stage must complete successfully before the next one can work. If Google cannot crawl your page, it will never be indexed. If it is never indexed, it will never rank. This sequential dependency is why technical SEO matters so much, particularly on Wix where some technical elements are managed by the platform rather than by you.

The Pipeline Rule: Crawl → Index → Rank. If your page is not ranking, the first question is always: is it indexed? If it is not indexed, the question is: has it been crawled? Diagnose from left to right, never skip stages.

Stage 1: Crawling, How Googlebot Discovers Your Pages

Google uses software called Googlebot, a web crawler (also called a spider or bot), to systematically browse the internet and discover web pages. Googlebot follows links from page to page, building a map of the web. For your Wix site, this means every internal link you create is a potential pathway for Googlebot to find more of your content. Crawling is where everything begins.

Web crawler discovering links between pages on a website
Googlebot follows links from page to page across your site, just like a human clicking through navigation.

How Googlebot Actually Works

Googlebot is not a single program. It is a distributed fleet of servers running thousands of simultaneous crawling instances across Google's global infrastructure. When Googlebot visits your Wix site, it sends an HTTP request to your server (which Wix handles), receives the HTML response, parses the content, extracts all links, and adds those links to its crawl queue for future visits. This process happens continuously, 24 hours a day.

  • Googlebot Desktop: Simulates a desktop Chrome browser. Used for sites where the desktop version is the primary version
  • Googlebot Smartphone: Simulates a mobile Chrome browser. This is now the PRIMARY crawler for all websites due to mobile-first indexing
  • Googlebot Image: Specifically crawls images for Google Image Search results
  • Googlebot Video: Crawls video content for Google Video Search
  • Googlebot News: Crawls news content for Google News (requires Google News Publisher Centre registration)
  • AdsBot: Crawls landing pages for Google Ads quality checks (separate from organic search)
Mobile-First Indexing Is Now Universal: Since March 2024, Google uses Googlebot Smartphone as the primary crawler for ALL websites without exception. This means Google sees the mobile version of your Wix site first. If content, links, or structured data are missing from your mobile layout, Google may not see them at all. Always check the mobile version of every Wix page in the Wix Mobile Editor.

How Google Discovers New Wix Pages

There are four main ways Googlebot discovers pages on your Wix site, and understanding all four helps you ensure nothing gets missed:

  • XML Sitemap: Wix automatically generates and updates your sitemap at yoursite.com/sitemap.xml. When you submit this to Google Search Console, Google checks it regularly for new and updated URLs. This is the most reliable discovery method.
  • Internal Links: When Googlebot crawls one of your pages, it follows every link on that page. Strong internal linking ensures every page on your site is reachable from at least one other page.
  • External Backlinks: When another website links to one of your pages, Googlebot follows that link during its crawl of the external site. This is why backlinks accelerate indexing of new content.
  • URL Inspection Tool: You can manually request Google to crawl a specific URL using the URL Inspection tool in Google Search Console. This is useful for new pages you want indexed quickly.
Wix Sitemap Tip: Wix automatically generates and updates your XML sitemap at yoursite.com/sitemap.xml. Submit this URL in Google Search Console under Sitemaps. Once submitted, Google will check it regularly. If you add a new page to your Wix site, it is automatically added to the sitemap within minutes.

Crawl Budget: Why It Matters for Wix Sites

Crawl budget is the number of pages Googlebot will crawl on your site within a given time period. For most small Wix sites (under 500 pages), crawl budget is rarely a concern because Googlebot can crawl the entire site easily. However, understanding crawl budget matters when you have blog tag pages, empty category pages, or duplicate content that wastes Googlebot's limited attention.

Crawl budget is determined by two factors: crawl rate limit (how fast Googlebot can crawl without overloading your server, handled by Wix's infrastructure) and crawl demand (how much Google wants to crawl your site based on its perceived importance and freshness). A site that publishes new content regularly and earns backlinks gets crawled more frequently.

Crawl Budget Math: If Google allocates 100 crawls per day to your Wix site, and 40 of those are wasted on empty tag pages and duplicate content, only 60 crawls reach your actual important pages. Eliminating crawl waste is one of the fastest technical SEO wins, especially on Wix where blog tags and categories can proliferate quickly.

JavaScript Rendering: The Critical Wix Factor

Wix builds websites using JavaScript, which means the HTML that Googlebot initially receives is largely empty. The actual content is rendered by executing JavaScript in a browser-like environment. Google handles this through a two-stage process: first, Googlebot fetches the raw HTML; then, the page enters a rendering queue where Google's Web Rendering Service (WRS) executes the JavaScript and generates the final HTML with all content visible.

Wix has invested heavily in server-side rendering (SSR) to mitigate this issue. Most Wix pages now deliver pre-rendered HTML to Googlebot, meaning the content is immediately visible without waiting for JavaScript execution. However, some Wix features, particularly dynamic pages using Wix Data Collections and certain Wix apps, may still rely on client-side rendering.

Always Verify Rendering: Never assume Google can see your Wix content. For every important page, use the URL Inspection tool in GSC and click "View Tested Page" then "Screenshot" to see exactly what Google sees after rendering. If any content is missing from the screenshot, Google cannot index it.

How to verify Google can render your Wix pages correctly

  • Open Google Search Console and navigate to the URL Inspection tool
  • Enter the full URL of any important Wix page
  • Wait for the inspection to complete
  • Click "View Tested Page" in the results panel
  • Click the "Screenshot" tab to see exactly what Googlebot sees
  • Compare the screenshot to your actual page, every piece of text, image, and link should be visible
  • Click the "HTML" tab to see the rendered HTML code and verify your content is present in the source
  • If content is missing, the page may rely on client-side JavaScript that Google cannot execute properly
  • Repeat this process for your homepage, top service pages, and 3-5 blog posts

Wix Server-Side Rendering (SSR) Explained

Wix implemented server-side rendering (SSR) to solve the JavaScript rendering problem. When Googlebot (or any visitor) requests a Wix page, Wix's servers execute the JavaScript on the server side and send back fully-rendered HTML. This means Googlebot receives a complete page with all content visible, rather than an empty shell that requires JavaScript execution.

SSR on Wix works automatically for most standard page types: static pages, blog posts, product pages, and booking pages. However, certain dynamic content loaded via third-party apps, custom Wix Data Collections with complex queries, or client-side-only components may not benefit from SSR. This is why the URL Inspection verification step is critical.

Essential Crawling & Indexing Tools


Stage 2: Indexing, How Google Stores and Understands Your Pages

Once Googlebot crawls a page, Google's systems process and analyse the content. This is far more than just "storing" the page. Google reads all text content, assesses image relevance through alt text and surrounding context, parses structured data markup, evaluates content quality and uniqueness, identifies the language and geographic targeting, and determines the canonical version if duplicate URLs exist.

If the page passes Google's quality threshold, it gets added to the Google Index: a massive database of hundreds of billions of web pages stored across Google's global data centres. The index is essentially a giant catalogue that maps every word and concept to the pages that contain it, allowing near-instant retrieval during a search query.

Why Pages Get Crawled But Not Indexed

Not every crawled page gets indexed. Google explicitly states that indexing is not guaranteed. Understanding why pages are excluded helps you fix issues on your Wix site:

  • Thin Content: Pages with very little unique text content. Common on Wix sites with tag pages, empty portfolio categories, or placeholder pages
  • Duplicate Content: Pages that are substantially identical to another page on your site or elsewhere. Wix can create duplicates through www/non-www variations, tag pages, and pagination
  • Noindex Tag: Pages explicitly marked with a noindex directive in the Wix SEO panel, telling Google not to index them
  • Canonical Tag Issues: When the canonical URL points to a different page, Google may index the canonical version instead
  • Crawl Errors: Server errors (5xx) or access problems that prevent Google from fully loading the page
  • Quality Threshold: Google may choose not to index pages it deems low quality, even without explicit noindex directives. This is the "Discovered - currently not indexed" status in GSC
  • Soft 404: Pages that return a 200 status code but display error-like content (empty pages, "no results found" pages)

Understanding GSC Index Coverage Statuses

Google Search Console's Pages report (formerly Coverage report) shows exactly what is happening with every URL Google knows about on your Wix site. Here is what each key status means and how to fix it:

  • Indexed: The page is in Google's index and can appear in search results. This is the status you want for every important page.
  • Discovered - currently not indexed: Google knows about the URL but has not yet crawled it, or crawled it but decided not to index it. Often indicates low perceived quality or importance. Fix by improving content depth and adding internal links to the page.
  • Crawled - currently not indexed: Google has crawled the page but chose not to add it to the index. This typically means the content did not meet Google's quality threshold. Fix by substantially improving the page content, making it more comprehensive and unique.
  • Excluded by noindex tag: You or a Wix setting has told Google not to index this page. Check the Wix SEO (Google) panel for the page and ensure "Hide from search engines" is not enabled.
  • Duplicate without user-selected canonical: Google found duplicate content and chose a canonical URL itself. Check if the page has unique content or is genuinely duplicating another page.
  • Blocked by robots.txt: The robots.txt file is preventing Google from crawling the URL. On Wix, you cannot edit robots.txt directly, so check if a Wix app or setting is causing the block.
  • Redirect: The URL redirects to another page. This is expected for URLs you have intentionally redirected.
Priority Fix Order: In GSC Pages report, focus on fixing issues in this order: (1) Server errors on important pages, (2) Pages accidentally set to noindex, (3) "Crawled - currently not indexed" pages that should be indexed, (4) "Discovered - currently not indexed" pages with thin content that needs expanding.

Canonical Tags: How Google Handles Duplicate Content on Wix

A canonical tag (rel="canonical") tells Google which version of a page is the "official" version when multiple URLs contain similar or identical content. Wix automatically adds canonical tags to all pages, typically pointing each page to its own URL. This is correct behaviour and prevents most duplicate content issues.

However, problems can arise when Wix creates multiple URL variations for the same content, for example through blog tag pages, pagination, or URL parameters from marketing campaigns. If you notice pages in GSC marked as "Duplicate, Google chose different canonical than user", it means Google disagrees with the canonical tag and has chosen a different URL as the primary version.

Wix Canonical Tag Limitation: On standard Wix sites, you cannot manually edit canonical tags through the Wix editor. Wix sets them automatically. If you need to override a canonical tag, you must use Wix's custom code injection (Settings > Custom Code) to add a canonical tag in the page head. This is an advanced technique covered in Module 5.

Stage 3: Ranking, How Google Decides Which Pages Appear First

Ranking is the process of determining which indexed pages should appear for a given search query, and in what order. When someone types a query into Google, the search engine must evaluate potentially millions of relevant pages in its index and return the most useful results in under half a second. Google's ranking systems use hundreds of signals, weighted differently depending on the type of query.

The Five Core Ranking Signal Categories

While Google uses hundreds of individual ranking signals, they broadly fall into five categories. Understanding these helps you prioritise your SEO efforts on Wix:

  • Relevance: How well your page content matches the search query. This includes keyword usage in title tags, headings, body content, URL, and meta descriptions. Also includes semantic relevance, where Google understands related concepts beyond exact keyword matches.
  • Authority: How trustworthy and authoritative your website and specific page are. Primarily measured through backlinks from other websites, but also includes brand mentions, domain age, and overall site quality.
  • Content Quality: How comprehensive, accurate, and useful your content is. Google's Helpful Content System evaluates whether content is written for humans or primarily for search engines. First-hand experience, expertise, and original insights score highly.
  • Page Experience: User experience metrics including Core Web Vitals (LCP, CLS, INP), mobile-friendliness, HTTPS security, and absence of intrusive interstitials. Wix handles many of these at the platform level.
  • User Engagement Signals: While Google denies using direct click-through rate as a ranking signal, patterns in user behaviour (pogo-sticking, long clicks vs short clicks) are widely believed to influence rankings indirectly through feedback loops.

How Google Matches Search Intent

Google's ranking algorithm does not simply match keywords. It attempts to understand the intent behind a search query and match it with the most appropriate type of content. There are four primary intent types:

  • Informational Intent: The searcher wants to learn something. Example: "what is Wix SEO". Google tends to rank blog posts, guides, and educational content.
  • Navigational Intent: The searcher wants to find a specific website or page. Example: "Wix SEO dashboard login". Google ranks the exact page the user is looking for.
  • Commercial Investigation: The searcher is researching before a purchase. Example: "best Wix SEO expert UK". Google ranks comparison pages, reviews, and service listings.
  • Transactional Intent: The searcher wants to buy or take an action. Example: "hire Wix SEO consultant". Google ranks service pages, pricing pages, and booking pages.
Intent Alignment Is Critical: If your target keyword has informational intent but you are trying to rank a service page, you will struggle regardless of how well optimised the page is. Always Google your target keyword and observe what type of content ranks on page 1. Then create the same type of content, but better.

SERP Features and How They Affect Wix Rankings

Modern Google search results are far more than ten blue links. Understanding SERP features helps you optimise your Wix content for maximum visibility:

  • Featured Snippets: A highlighted answer box at the top of results. Optimise by answering questions concisely in your content with clear H2/H3 headings.
  • People Also Ask: Expandable question boxes. Each question you answer on your page is an opportunity to appear here.
  • Local Pack: Map results with three business listings. Critical for local Wix businesses, requires Google Business Profile optimisation.
  • Image Pack: A row of images within search results. Properly optimised images with descriptive alt text on your Wix site can appear here.
  • Knowledge Panel: An information box about an entity (person, business, topic). Built through structured data, Wikipedia presence, and consistent NAP across the web.
  • AI Overviews: Google's AI-generated summary at the top of some results. Pages cited in AI Overviews need comprehensive, well-structured content.
  • Sitelinks: Additional links beneath your main search result, showing key pages on your site. Earned through clear site structure and strong internal linking.

Common Wix Crawlability and Indexing Issues

After auditing hundreds of Wix sites, these are the most common crawling and indexing problems I find, listed in order of how frequently they occur:

  • Pages accidentally set to "noindex" in the Wix SEO panel. This happens when testing and forgetting to toggle it back. Check Settings > SEO (Google) for every important page.
  • Orphan pages with no internal links pointing to them. Google cannot discover pages that are not linked from anywhere on your site.
  • Blog tag pages and empty category pages creating crawl waste. Wix auto-generates these, and they often have thin or duplicate content.
  • Slow page load speed reducing Googlebot's willingness to fully crawl the site. Heavy images and too many Wix apps are the usual culprits.
  • Password-protected pages that Googlebot cannot access. If a page requires a login, Google cannot crawl it.
  • Content hidden behind "click to expand" or accordion elements. While Google can usually process hidden content, it may give it less weight.
  • Dynamic content from Wix Data Collections not rendering for Googlebot. Always verify with URL Inspection.
  • Redirect chains where one redirect leads to another redirect, slowing crawling and wasting crawl budget.
  • Mixed content warnings from HTTP resources loaded on HTTPS pages, though Wix largely handles this automatically.

How Often Does Google Re-Crawl Wix Pages?

Google does not crawl every page on the internet every day. It allocates crawl resources based on several factors. Understanding this helps you set realistic expectations for how quickly changes you make in the Wix editor will be reflected in Google's index.

  • Homepage: Typically re-crawled every 1-7 days for established sites. New sites may wait 1-2 weeks between crawls.
  • Key Service Pages: Usually re-crawled every 1-4 weeks, depending on how often you update them.
  • Blog Posts: New posts are typically discovered within 1-3 days if your sitemap is submitted. Older posts may be re-crawled monthly or less frequently.
  • Low-Priority Pages: Contact, privacy policy, terms pages may be re-crawled monthly or less.
Force a Re-Crawl: After making significant changes to any Wix page, use the URL Inspection tool in GSC and click "Request Indexing" to prompt Google to re-crawl the page within 24-48 hours rather than waiting for the natural crawl cycle.

Practical Exercise: Full Crawl and Index Audit of Your Wix Site

This is the most important practical exercise in the entire course. Set aside 60-90 minutes and work through every step. By the end, you will know exactly how Google sees your Wix site and will have fixed every crawling and indexing issue.

Complete Wix crawl and index audit walkthrough

  • Open Google Search Console at search.google.com/search-console and verify your Wix site ownership using the HTML tag method via Wix Settings > Marketing & SEO > Site Verification
  • Navigate to the Sitemaps section in GSC and submit your Wix sitemap URL (yoursite.com/sitemap.xml) if not already submitted. Verify it shows "Success" status.
  • Go to the Pages report (formerly Coverage) and note the total number of indexed pages, not indexed pages, and any errors
  • Click on each error or exclusion category and review the specific URLs affected. Create a spreadsheet with columns: URL, Status, Issue, Action Required
  • For pages showing "Excluded by noindex tag": Open the Wix editor, navigate to each page, click the three dots > SEO (Google), and verify "Hide from search engines" is toggled OFF
  • For pages showing "Crawled - currently not indexed": These pages need better content. Note them for content improvement in Module 4 of this course
  • For pages showing "Discovered - currently not indexed": Add 3-5 internal links from other pages to each of these URLs to increase their perceived importance
  • Use the URL Inspection tool to individually check your 10 most important pages (homepage, top services, top blog posts). Each should show "URL is on Google"
  • For each inspected page, click "View Tested Page" and check both the HTML and Screenshot tabs to verify Google can see all your content
  • Open your sitemap directly in a browser (yoursite.com/sitemap.xml) and verify all important pages are listed. Note any missing pages.
  • Run a free Screaming Frog crawl (up to 500 URLs free) of your Wix site. Export the results and check for: broken links (4xx status codes), redirect chains, orphan pages, pages with missing title tags or meta descriptions
  • Cross-reference the Screaming Frog results with your GSC data to identify any pages that are crawlable but not indexed, or indexed but with errors
  • Fix all broken internal links by updating the link destinations in the Wix editor
  • For any orphan pages (found by Screaming Frog but not linked from any other page), add at least 2-3 internal links from relevant existing pages
  • Remove or noindex any genuinely thin pages that provide no value (empty tag pages, test pages, placeholder pages) to stop them wasting crawl budget
  • After making all fixes, request re-indexing of your top 10 pages in GSC using URL Inspection
  • Set a calendar reminder for 14 days to re-check the Pages report in GSC and verify improvements
  • Set a monthly recurring reminder to repeat this audit, as new issues can emerge as you add content and Wix updates its platform

Advanced Concepts: Log File Analysis for Wix

Log file analysis involves examining your server's access logs to see exactly which pages Googlebot visited, when it visited them, and what HTTP response it received. This is the gold standard for understanding how Google crawls your site. However, Wix does not provide direct access to server logs.

Workaround: You can use Google Tag Manager (covered in Module 2) with a custom JavaScript tag that fires when Googlebot visits a page, sending data to Google Analytics. This is an advanced technique but provides invaluable crawl data for larger Wix sites. Tools like JetOctopus and OnCrawl offer cloud-based log analysis, but they require log file access that Wix does not provide natively.

Alternative for Wix Users: Since Wix does not provide server log access, rely on Google Search Console's Crawl Stats report (Settings > Crawl Stats) for aggregate crawl data. This shows total crawl requests, average response time, and crawl status codes over time. While less detailed than log file analysis, it provides useful trends.

Frequently Asked Questions

How long does it take Google to index a new Wix page?

With a submitted sitemap and Request Indexing in GSC, most new Wix pages are indexed within 24 hours to 7 days. Without these, it can take 2-6 weeks for Google to naturally discover and index a new page. Pages with strong internal links and high-quality content are indexed faster.

Can Google read content inside Wix accordions and tabs?

Yes, Google can usually render and index content inside Wix accordions, tabs, and expandable sections because it executes the JavaScript. However, some SEO studies suggest Google may give slightly less weight to content that is hidden by default. For your most important keyword-targeted content, keep it visible on page load.

Does Google crawl Wix mobile and desktop versions separately?

Since Wix uses responsive design (the same URL serves both mobile and desktop), Google only needs to crawl each URL once. Googlebot Smartphone is the primary crawler, so it sees the mobile version. Make sure all important content is visible and accessible on the mobile layout in the Wix Mobile Editor.

Will too many 301 redirects slow down Google crawling my Wix site?

Redirect chains (one redirect leading to another) do waste crawl budget and slow Googlebot. Individual 301 redirects are fine and expected when you change URLs. In Wix, check your Redirect Manager (Dashboard > SEO > URL Redirect Manager) for chains and update them to point directly to the final destination URL.


The crawl-index-rank pipeline is the foundation of everything in SEO. If you understand this lesson deeply, every other lesson in this course will make immediate sense. If you skip it, you will constantly wonder why your optimisations are not working.
Final Checkpoint: After completing this lesson and the practical exercise, every important page on your Wix site should show "URL is on Google" in the GSC URL Inspection tool. You should have a spreadsheet documenting all indexing issues and a plan to fix each one. If any page still shows as not indexed after 7 days of requesting indexing, check for noindex tags, thin content, or canonical issues before requesting indexing again.
Try it yourself: the free AI Crawler HTML Checker shows the HTML Googlebot and AI crawlers receive from any page.

Was this lesson useful?

It takes 1 minute to tell me. The course is free and I want to keep it that way, and your feedback shows me what is working and helps other people find it.

Leave quick feedback

This lesson on How Google crawls, indexes and ranks websites is part of Module 1: SEO Foundations & How Search Works in The Most Comprehensive Complete Wix SEO Course in the World (2026 Edition). Created by Michael Andrews, a Wix Marketplace Legend Partner with 14 years of hands-on experience, 800 completed Wix SEO projects and 456 verified five-star reviews.

Related