List of Google user-triggered fetchers

User-triggered fetchers are initiated by users to perform a fetching function within a Google
product. For example,
Google Site Verifier
acts on a user’s request, or a site hosted on Google Cloud (GCP) has a feature that allows the
site’s users to retrieve an external RSS feed. Because the fetch was requested by a user, these
fetchers generally ignore robots.txt rules. The general
technical properties
of Google’s crawlers also apply to the user-triggered fetchers.

The IP ranges the user-triggered fetchers use are
published in the
user-triggered-fetchers.json,
user-triggered-fetchers-google.json,
and user-triggered-agents.json
objects. The user-triggered fetchers’ reverse DNS mask, depending on whether the fetcher is Google
or user owned, matches ***-***-***-***.gae.googleusercontent.com или
google-proxy-***-***-***-***.google.com respectively.

The following list shows the user-triggered fetchers, their user agent strings as they appear in
the HTTP requests, and the products they are associated with. The list is not exhaustive, it only
covers the requestors that are more likely to show up in log files and that we’ve received
questions about.

Chrome Web Store

User-Agent in HTTP requests
Associated products	The Chrome Web Store fetcher requests URLs that developers provide in the metadata of their Chrome extensions and themes.

Feedfetcher

User-Agent in HTTP requests
Associated products	Feedfetcher is used for crawling RSS or Atom feeds for Google News and WebSub.

Gemini Notebook

User-Agent in HTTP requests	Mobile agent Desktop agent Former agent (supported until August 2026) Google-NotebookLM
Associated products	The Gemini Notebook fetcher requests individual URLs that Gemini Notebook users have provided as sources for their projects.

Google-Agent

User-Agent in HTTP requests	Mobile agent Desktop agent
Associated products	Google-Agent is used by agents hosted on Google infrastructure to navigate the web and perform actions upon user request. It uses IP ranges from user-triggered-agents.json.

Google Messages

User-Agent in HTTP requests
Associated products	Google Messages fetcher is used to generate link previews for URLs sent in chat messages.

Google Pinpoint

User-Agent in HTTP requests
Associated products	The Google-Pinpoint fetcher requests individual URLs that Pinpoint users specified as sources for their personal collections of documents.

Google Publisher Center

User-Agent in HTTP requests
Associated products	Google Publisher Center fetches and processes feeds that publishers explicitly supplied for use in Google News landing pages.

Google Read Aloud

User-Agent in HTTP requests	Mobile agent Desktop agent Former agent (deprecated) google-speakr
Associated products	Upon user request, Google Read Aloud fetches and reads out web pages using text-to-speech (TTS).

Google Site Verifier

User-Agent in HTTP requests
Associated products	Google Site Verifier fetches Search Console verification tokens.