JavaScript
The Impact of JavaScript Frameworks on Googlebot Crawl Budget
Discover how JavaScript frameworks impact Googlebot crawl budget and learn practical optimization methods for better search engine indexation.
Crawler management
Tracking Mobile vs Desktop Googlebot via Server Log Analysis
Server log analysis allows you to track Googlebot activity by separating mobile and desktop user agents to optimize your crawl…
AMP
Transitioning from AMP to Responsive Web Design Safely
Migrating from AMP to a single responsive web design requires careful technical planning to protect search rankings and traffic. This…
AMP
Troubleshooting Common Google Search Console AMP Errors
Learn how to identify and fix validation issues in Google Search Console to keep your AMP pages active. This guide…
robots.txt
Troubleshooting Common Syntax Errors in Robots.txt Files
Learn how to fix syntax errors in your robots.txt file to ensure proper crawler access and protect your SEO performance.
Canonicalization
Troubleshooting Google Ignoring Canonical Tags With URL Parameters
Google ignores canonical tags when URL parameters alter page content or conflict with other signals. This guide helps you align…
Page and content metadata
Troubleshooting Google Search Console Indexing Errors with Canonical Tags
Google Search Console indexing errors linked to canonical tags occur when search engines encounter conflicting signals. Aligning your technical setup…
Crawling infrastructure
Troubleshooting Googlebot Crawl Timeouts and Connectivity Issues
Address Googlebot crawl timeout errors by identifying server-side bottlenecks. Ensure your content remains indexed by optimizing server response times.
Sitemaps
Troubleshooting Sitemaps Report Errors in Google Search Console
Fixing sitemap errors in Google Search Console is vital for site crawling. Follow this guide to identify, diagnose, and resolve…
Meta tags
Understanding the max-image-preview Meta Tag for Discover
The max-image-preview meta tag informs Google about the preferred size of image previews in Discover. It is a key setting…
Site moves and changes
Updating Canonical Tags During Domain or Platform Migrations
Updating canonical tags during a migration requires point-to-point mapping to ensure Googlebot correctly identifies the new primary version of your…
Crawling and indexing
Using HTTP 429 and Retry-After to Control Googlebot Rate Limit
Manage Googlebot crawl rates using HTTP 429 status codes and Retry-After headers. Protect your server performance during peak traffic periods.
robots.txt
Using Robots.txt to Prevent Crawling of Faceted Navigation
Learn how to use robots.txt disallow rules to prevent Googlebot from spending crawl budget on endless faceted search navigation query…
Page and content metadata
Using the indexifembedded Tag to Control Content Indexing
The indexifembedded tag allows site owners to permit indexing of their media content when it is embedded on third-party pages,…
Meta tags
Using the nosnippet Meta Tag: Pros, Cons, and SEO Impacts
The nosnippet meta tag prevents Google from displaying a text snippet or video preview in search results for a specific…
Page and content metadata
Using the nosubjectaltlink and noscript Meta Tags Effectively for Googlebot
Master the nosubjectaltlink and noscript tags to control Googlebot crawling behavior, refine your technical SEO strategy, and protect your site…
Page and content metadata
Using the unavailable_after Meta Tag for Time-Sensitive Content
The unavailable_after meta tag informs Googlebot when to stop showing a page in search results. This guide explains its implementation…
Meta tags
Using the unavailable_after Meta Tag for Time-Sensitive Content
The unavailable_after meta tag instructs search engines to remove a page from results after a specific time, ensuring only active…
Removals
Using X-Robots-Tag to Remove PDFs and Non-HTML Files
To remove PDFs and non-HTML files from Google Search, configure your server to return an X-Robots-Tag: noindex HTTP header for…
Sitemap extensions
Using XML Sitemaps to Expedite Google Indexing for Large Sites
XML sitemaps help Google discover content faster by providing a clear map of your pages. Learn how to optimize sitemap…
Google crawlers
Verifying Googlebot: How to Perform Reverse DNS Lookups for Security
You can verify Googlebot by performing a reverse DNS lookup on the IP address. This confirms the request is a…
Meta tags
When to Use the nositelinkssearchbox Meta Tag for Homepages
Learn when to use the nositelinkssearchbox meta tag on your homepage to prevent Google from displaying an unwanted site search…
Canonicalization
Why Every Page Needs a Self-Referential Canonical Tag
A self-referential canonical tag signals that a page is the preferred version, preventing indexing issues from tracking parameters or URL…
Google crawlers
Why Googlebot Ignores Your Noindex Tags: Common Errors
Googlebot might index pages despite noindex tags due to robots.txt blocks or JavaScript delays. Learn why these errors happen and…
Crawling and indexingOverview of crawling and indexing topics
Crawling and indexing help your site rank in search results. Browse topics to understand what it means for Google to…
Crawling and indexingFile types indexable by Google
Google can index the content of most types of pages and files. Explore a list of the most common file…
Crawling and indexingURL structure best practices for Google Search
It's a good idea to keep your site's URL structure as simple as possible. Learn more about the URL format…
Crawling and indexingLink best practices for Google
Google uses links as a signal when determining the relevancy of pages and to find new pages to crawl. Learn…
SitemapsLearn about sitemaps
A sitemap provides information that helps Google more intelligently crawl your site. Discover how a sitemap works and determine if…
Build and submit a sitemap
Google supports several sitemap formats. Follow this guide to learn about formats, how to build a sitemap, and how to…
SitemapsManage your sitemaps with a sitemap index file
You can submit multiple sitemaps at once with a sitemaps index file. Learn how to manage large sitemaps.
Sitemap extensionsImage sitemaps
Image sitemaps help Google discover images. Follow these best practices on how to create an image sitemap and review image…
Sitemap extensionsNews sitemaps
Learn how to create and submit a News sitemap by reviewing the requirements, example entries, and news-specific tag definitions.
Sitemap extensionsVideo sitemaps and alternatives
Video sitemaps help Google display videos in Search. Review these guidelines to learn more and browse video xml sitemap examples.
Sitemap extensionsHow to combine sitemap extensions
Learn how to combine different kinds of sitemap extensions in one single XML sitemap.
Crawler managementAsk Google to recrawl your URLs
If you've recently added or made changes to a page on your site, you can request that Google re-index it…
Crawler managementTroubleshoot Google Search crawling errors
Learn how to troubleshoot crawling errors.
Google crawlersGooglebot
Googlebot is the generic name of the web crawler used by Google Search. Discover what Googlebot is, how it accesses…
robots.txtIntroduction to robots.txt
Robots.txt is used to manage crawler traffic. Explore this robots.txt introduction guide to learn what robot.txt files are and how…
CanonicalizationWhat is canonicalization
Learn what canonicalization is, how Google chooses a canonical URL, and whether it matters for your site.
How to specify a canonical URL with rel=”canonical” and other methods
When a site has duplicate content, Google chooses the canonical URL. Learn more about canonical URLs and how to consolidate…
CanonicalizationFix canonicalization issues
Learn how to debug the most common canonicalization issues in Google Search.
Crawling and indexingMobile site and mobile-first indexing best practices
Discover what Google mobile-first indexing is and explore best practices designed to improve user experience in Google Search.
AMPAbout AMP on Google Search
Google Search indexes AMP pages just like other web pages. Explore this page for commonly asked questions and guidelines for…
AMPGoogle検索におけるAMPコンテンツを最適化する
Google検索におけるAMPコンテンツは、いくつかの簡単なステップで強化できます。AMPページの作成と最適化に関するAlien Roadのヒントをご覧ください。
AMPValidate your AMP content
Explore this guide to learn how to validate AMP content, how to fix AMP errors, and for more AMP resources.
AMPRemove your AMP pages from Google Search
Discover the different options for removing all versions of your AMP pages from Google Search, including AMP and non-AMP pages.
JavaScriptUnderstand the JavaScript SEO basics
Discover how Google Search processes JavaScript and explore best practices for improving JavaScript web apps for Google Search.
JavaScriptFix Search-related JavaScript problems
Read this guide to learn how you can identify and fix Search-related JavaScript problems that may be blocking your page…
JavaScriptFix lazy-loaded content
Lazy loading is a common website performance and UX best practice. Learn how to test and fix lazy loaded content…