JavaScriptDynamic rendering as a workaround
Dynamic rendering was a workaround for websites experiencing issues with JavaScript-powered content.
JavaScript
Page and content metadataUse valid HTML to specify page metadata
Using valid page metadata ensures that Google can process the HTML markup of your pages. Learn which elements are valid…
meta tags and attributes that Google supports
Google supports both page-level meta tags and tag attributes. Explore a list of the special tags that Google Search can…
Meta tagsRobots meta tag, data-nosnippet, and X-Robots-Tag specifications
Learn how to add robots meta tags and read how page and text-level settings can be used to adjust how…
Meta tagsBlock Search indexing with noindex
A noindex tag can block Google from indexing a page so that it won't appear in Search results. Learn how…
Page and content metadataQualify your outbound links to Google
You might want to tell Google your relationship with outbound links on your site. Discover how to qualify outbound links…
RemovalsControl what you share with Google
You can control what content Google sees on your site and what is shown in search results. Discover the main…
Remove a page hosted on your site from Google
If you need to remove a page that's hosted on your website from Google Search, you can submit a request…
RemovalsRemove images hosted on your site from search results
A robots.txt file can prevent images from appearing in search results. Discover how to remove and hide images on your…
RemovalsKeep redacted information out of Google Search
Learn best practices for how to redact information from documents that you don't want to be indexed and made discoverable…
Site moves and changesRedirects and Google Search
Learn about the different types of redirects, how Google can interpret them, and how they can be useful in Google…
Changing your hosting
Discover how to minimize the impact on your Google Search performance when transferring your site's hosting infrastructure without changing your…
How to move a site
Learn how to change the URLs of existing site pages, including domain name changes. Explore moving a website with little…
Minimize A/B testing impact in Google Search
Discover how to ensure A/B testing has minimal impact on Search by following website testing best practices for AB testing,…
Site moves and changesTemporarily pause or disable a website
If you are considering closing your business website, learn how to pause your site temporarily or disable it completely with…
Crawling and indexingDiagnosing Crawl Errors
Reading what Search Console reports, and separating errors that matter from ones that are working as intended.
Crawling and indexingGoogle Crawlers and How to Verify Them
Which user agents Google operates, and how to confirm a request claiming to be Googlebot really is.
Crawling and indexingHow Google Interprets robots.txt
Matching rules, wildcards, precedence and the size limit, the details that decide whether your file does what you think.
Crawling and indexingMobile-First Indexing
Google indexes the mobile version. What that means for content parity and markup.
Crawling and indexingRemoving Outdated Content You Do Not Control
When the page has changed or gone but Google still shows the old version.
Crawling infrastructureAPIs-Google user agent
APIs-Google is the user agent used by Google APIs to deliver push notifications. Explore this guide to learn how APIs-Google…
Crawling infrastructureAuthenticate requests with Web Bot Auth (experimental)
Learn what Web Bot Auth is, the current status of Google's implementation, and how you can implement verification during Google's…
Crawling infrastructureChangelog
Track major updates to Google's crawling documentation, including changes to Google's list of user agents, crawlers, and user-triggered fetchers.
Crawling infrastructureDebug network and DNS errors for Google’s crawlers
See how different network and DNS errors can affect Google's crawlers and how to debug network and DNS errors.
Crawling infrastructureFeedfetcher
Feedfetcher is how Google grabs site feeds. Explore this guide to learn what Google Feedfetcher is and how this user-controlled…
Crawling infrastructureGoogle Read Aloud user agent
Google-Read-Aloud is the user agent for the Google Read Aloud service. Learn more about how this service can work for…
Crawling infrastructureHow Google interprets the robots.txt specification
Learn specific details about the different robots.txt file rules and how Google interprets the robots.txt specification.
Crawling infrastructureHow HTTP status codes affect Google’s crawlers
See how different HTTP status codes can affect Google's crawlers.
Crawling infrastructureHow to write and submit a robots.txt file
A robots.txt file lives at the root of your site. Learn how to create a robots.txt file, see examples, and…
Crawling infrastructureList of Google user-triggered fetchers
Google user-triggered fetchers perform actions on behalf of users. This overview will help you understand the user-triggered fetchers Google uses.
Crawling infrastructureList of Google’s common crawlers
Google crawlers discover and scan websites. This overview will help you understand the common Google crawlers including the Googlebot user…
Crawling infrastructureList of Google’s special-case crawlers
Google special-case crawlers are used by specific Google products where there's an agreement between the crawled site and the product…
Crawling infrastructureManaging crawling of faceted navigation URLs
Learn what faceted navigation is and how you can optimize Google's crawling of large number of faceted navigation URLs.
Crawling infrastructureOptimize your crawl budget
Learn what crawl budget is and how you can optimize Google's crawling of large and frequently updated websites.
Overview of Google crawlers and fetchers (user agents)
Understand the technical properties of Google crawlers and fetchers, including supported transfer protocols, caching, and file size limits.
Crawling infrastructureReduce the Google crawl rate
If Google's crawl rate overwhelms your server, explore this document to learn how to reduce Google's crawl rate and stop…
Things to know about Google’s web crawling
Learn about how Google crawls the web.
Crawling infrastructureUpdate your robots.txt file
With the robots.txt report, you can check whether Google can process your robots.txt files. Follow these steps to submit updated…
Crawling infrastructureVerify requests from Google crawlers and fetchers
You can check if a web crawler really is Googlebot (or another Google user agent). Follow these steps to verify…