{"id":25668,"date":"2026-09-06T00:47:43","date_gmt":"2026-09-05T21:47:43","guid":{"rendered":"https:\/\/alienroad.com\/google-bilgi-bankasi\/list-of-googles-special-case-crawlers\/"},"modified":"2026-09-06T00:51:36","modified_gmt":"2026-09-05T21:51:36","slug":"list-of-googles-special-case-crawlers","status":"publish","type":"ar_kb","link":"https:\/\/alienroad.com\/google-bilgi-bankasi\/list-of-googles-special-case-crawlers\/","title":{"rendered":"Google'\u0131n \u00f6zel durum taray\u0131c\u0131lar\u0131n\u0131n listesi"},"content":{"rendered":"<p>\n  \u00d6zel durum taray\u0131c\u0131lar\u0131, taranan site ile \u00fcr\u00fcn aras\u0131nda tarama s\u00fcreci konusunda bir anla\u015fman\u0131n bulundu\u011fu belirli Google \u00fcr\u00fcnleri taraf\u0131ndan kullan\u0131l\u0131r. \u00d6rne\u011fin, <code>AdsBot<\/code> genel robots.txt kullan\u0131c\u0131 arac\u0131s\u0131n\u0131 (<code>*<\/code>) reklam yay\u0131nc\u0131s\u0131n\u0131n izniyle yoksayar. Google taray\u0131c\u0131lar\u0131n\u0131n genel<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/overview-of-google-crawlers-and-fetchers-user-agents\/#crawl-technical-props\">teknik \u00f6zellikleri<\/a><br \/>\n  \u00f6zel durum taray\u0131c\u0131lar\u0131 i\u00e7in de ge\u00e7erlidir.\n<\/p>\n<p>\n  \u00d6zel durum taray\u0131c\u0131lar\u0131 robots.txt kurallar\u0131n\u0131 yoksayabilir ve bu nedenle ortak taray\u0131c\u0131lardan farkl\u0131 bir IP aral\u0131\u011f\u0131ndan \u00e7al\u0131\u015f\u0131rlar. IP aral\u0131klar\u0131<br \/>\n  <a href=\"https:\/\/developers.google.com\/static\/crawling\/ipranges\/special-crawlers.json\">special-crawlers.json<\/a> nesnesinde yay\u0131nlanm\u0131\u015ft\u0131r. \u00d6zel durum taray\u0131c\u0131lar\u0131n\u0131n ters DNS maskesi<br \/>\n  <code>rate-limited-proxy-***-***-***-***.google.com<\/code>.\n<\/p>\n<p>\n  A\u015fa\u011f\u0131daki liste \u00f6zel durum taray\u0131c\u0131lar\u0131n\u0131, HTTP isteklerinde g\u00f6r\u00fcnd\u00fckleri \u015fekliyle kullan\u0131c\u0131 arac\u0131s\u0131 dizelerini, robots.txt dosyas\u0131ndaki <code>User-agent:<\/code> sat\u0131r\u0131 i\u00e7in kullan\u0131c\u0131 arac\u0131s\u0131 belirte\u00e7lerini ve taray\u0131c\u0131ya y\u00f6nelik tarama tercihlerinden etkilenen \u00fcr\u00fcnleri g\u00f6sterir. Liste kapsaml\u0131 de\u011fildir; yaln\u0131zca g\u00fcnl\u00fck dosyalar\u0131nda g\u00f6r\u00fcnme olas\u0131l\u0131\u011f\u0131 daha y\u00fcksek olan ve hakk\u0131nda sorular ald\u0131\u011f\u0131m\u0131z istek sahiplerini kapsar.\n<\/p>\n<aside class=\"caution\">\n  <b>Dikkat<\/b>: Kullan\u0131c\u0131 arac\u0131s\u0131 dizesi taklit edilebilir.<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/verify-requests-from-google-crawlers-and-fetchers\/\">Bir istek sahibinin Google&#8217;dan gelip gelmedi\u011fini nas\u0131l do\u011frulayaca\u011f\u0131n\u0131z\u0131 \u00f6\u011frenin<\/a>.<br \/>\n<\/aside>\n<dl>\n<dt>\n<h2 class=\"add-link\" id=\"apis-google\" tabindex=\"-1\"><a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/apis-google-user-agent\/\">APIs-Google<\/a><\/h2>\n<\/dt>\n<dd>\n<table class=\"responsive\">\n<colgroup>\n<col width=\"20%\">\n<col>\n<col>\n      <\/colgroup>\n<tbody>\n<tr>\n<td><b>HTTP isteklerinde User-Agent<\/b><\/td>\n<td>\n            <span><\/span><\/p>\n<div><\/div>\n<\/td>\n<\/tr>\n<tr>\n<td><b>robots.txt<\/b><\/td>\n<td>\n<table class=\"nested fixed vertical-rules\">\n<tr>\n<td width=\"30%\">robots.txt dosyas\u0131ndaki User-agent belirteci<\/td>\n<td>\n<p><code>APIs-Google<\/code><\/p>\n<hr>\n<p>Genel kullan\u0131c\u0131 arac\u0131s\u0131 (<code>*<\/code>) yoksay\u0131l\u0131r.<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td>\u00d6rnek robots.txt grubu<\/td>\n<td>\n                  <span><\/span><\/p>\n<div><\/div>\n<\/td>\n<\/tr>\n<\/table>\n<\/td>\n<\/tr>\n<tr>\n<td><b>Etkilenen \u00fcr\u00fcnler<\/b><\/td>\n<td>\n            \u015eu kullan\u0131c\u0131 arac\u0131s\u0131na y\u00f6nelik tarama tercihleri: <code>APIs-Google<\/code> Google API&#8217;leri taraf\u0131ndan anl\u0131k bildirim mesajlar\u0131n\u0131n iletilmesini etkiler.\n          <\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/dd>\n<dt>\n<h2 class=\"add-link\" id=\"adsbot-mobile-web\" tabindex=\"-1\">AdsBot Mobile Web<\/h2>\n<\/dt>\n<dd>\n<table class=\"responsive\">\n<colgroup>\n<col width=\"20%\">\n<col>\n<col>\n      <\/colgroup>\n<tbody>\n<tr>\n<td><b>HTTP isteklerinde User-Agent<\/b><\/td>\n<td>\n            <span><\/span><\/p>\n<div><\/div>\n<\/td>\n<\/tr>\n<tr>\n<td><b>robots.txt<\/b><\/td>\n<td>\n<table class=\"nested fixed vertical-rules\">\n<tr>\n<td width=\"30%\">robots.txt dosyas\u0131ndaki User-agent belirteci<\/td>\n<td>\n<p><code>AdsBot-Google-Mobile<\/code><\/p>\n<hr>\n<p>Genel kullan\u0131c\u0131 arac\u0131s\u0131 (<code>*<\/code>) yoksay\u0131l\u0131r.<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td>\u00d6rnek robots.txt grubu<\/td>\n<td>\n                  <span><\/span><\/p>\n<div><\/div>\n<\/td>\n<\/tr>\n<\/table>\n<\/td>\n<\/tr>\n<tr>\n<td><b>Etkilenen \u00fcr\u00fcnler<\/b><\/td>\n<td>\n            \u015eu kullan\u0131c\u0131 arac\u0131s\u0131na y\u00f6nelik tarama tercihleri: <code>AdsBot-Google-Mobile<\/code> Google Ads&#8217;in<br \/>\n            <a href=\"https:\/\/support.google.com\/google-ads\/answer\/2404197\" class=\"external-link\">web sayfas\u0131 reklam kalitesini<\/a>.\n          <\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/dd>\n<dt>\n<h2 class=\"add-link\" id=\"adsbot\" tabindex=\"-1\">AdsBot<\/h2>\n<\/dt>\n<dd>\n<table class=\"responsive\">\n<colgroup>\n<col width=\"20%\">\n<col>\n<col>\n      <\/colgroup>\n<tbody>\n<tr>\n<td><b>HTTP isteklerinde User-Agent<\/b><\/td>\n<td>\n            <span><\/span><\/p>\n<div><\/div>\n<\/td>\n<\/tr>\n<tr>\n<td><b>robots.txt<\/b><\/td>\n<td>\n<table class=\"nested fixed vertical-rules\">\n<tr>\n<td width=\"30%\">robots.txt dosyas\u0131ndaki User-agent belirteci<\/td>\n<td>\n<p><code>AdsBot-Google<\/code><\/p>\n<hr>\n<p>Genel kullan\u0131c\u0131 arac\u0131s\u0131 (<code>*<\/code>) yoksay\u0131l\u0131r.<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td>\u00d6rnek robots.txt grubu<\/td>\n<td>\n                  <span><\/span><\/p>\n<div><\/div>\n<\/td>\n<\/tr>\n<\/table>\n<\/td>\n<\/tr>\n<tr>\n<td><b>Etkilenen \u00fcr\u00fcnler<\/b><\/td>\n<td>\n            \u015eu kullan\u0131c\u0131 arac\u0131s\u0131na y\u00f6nelik tarama tercihleri: <code>AdsBot-Google<\/code> Google Ads&#8217;in<br \/>\n            <a href=\"https:\/\/support.google.com\/google-ads\/answer\/2404197\" class=\"external-link\">web sayfas\u0131 reklam kalitesini<\/a>.\n          <\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/dd>\n<dt>\n<h2 class=\"add-link\" id=\"adsense\" tabindex=\"-1\"><a href=\"https:\/\/support.google.com\/adsense\/answer\/99376\" class=\"external-link\">AdSense<\/a><\/h2>\n<\/dt>\n<dd>\n<table class=\"responsive\">\n<colgroup>\n<col width=\"20%\">\n<col>\n<col>\n      <\/colgroup>\n<tbody>\n<tr>\n<td><b>HTTP isteklerinde User-Agent<\/b><\/td>\n<td>\n<table class=\"nested fixed vertical-rules\">\n<tr>\n<td width=\"30%\">Masa\u00fcst\u00fc arac\u0131s\u0131<\/td>\n<td>\n                  <span><\/span><\/p>\n<div><\/div>\n<\/td>\n<\/tr>\n<tr>\n<td>Mobil arac\u0131<\/td>\n<td>\n                  <span><\/span><\/p>\n<div><\/div>\n<\/td>\n<\/tr>\n<\/table>\n<\/td>\n<\/tr>\n<tr>\n<td><b>robots.txt<\/b><\/td>\n<td>\n<table class=\"nested fixed vertical-rules\">\n<tr>\n<td width=\"30%\">robots.txt dosyas\u0131ndaki User-agent belirteci<\/td>\n<td>\n                  <code>Mediapartners-Google<\/code><\/p>\n<hr>\n<p>Genel kullan\u0131c\u0131 arac\u0131s\u0131 (<code>*<\/code>) yoksay\u0131l\u0131r.<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td>\u00d6rnek robots.txt grubu<\/td>\n<td>\n                  <span><\/span><\/p>\n<div><\/div>\n<\/td>\n<\/tr>\n<\/table>\n<\/td>\n<\/tr>\n<tr>\n<td><b>Etkilenen \u00fcr\u00fcnler<\/b><\/td>\n<td>\n            \u015eu kullan\u0131c\u0131 arac\u0131s\u0131na y\u00f6nelik tarama tercihleri: <code>Mediapartners-Google<\/code> Google AdSense&#8217;i etkiler. AdSense taray\u0131c\u0131s\u0131, kat\u0131l\u0131mc\u0131 sitelere alakal\u0131 reklamlar sunmak i\u00e7in bu siteleri ziyaret eder.\n          <\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/dd>\n<dt>\n<h2 class=\"add-link\" id=\"google-safety\" tabindex=\"-1\">Google-Safety<\/h2>\n<\/dt>\n<dd>\n<table class=\"responsive\">\n<colgroup>\n<col width=\"20%\">\n<col>\n<col>\n      <\/colgroup>\n<tbody>\n<tr>\n<td><b>HTTP isteklerinde User-Agent<\/b><\/td>\n<td>\n            <span><\/span><\/p>\n<div><\/div>\n<\/td>\n<\/tr>\n<tr>\n<td><b>robots.txt<\/b><\/td>\n<td>\n            Google-Safety kullan\u0131c\u0131 arac\u0131s\u0131 robots.txt kurallar\u0131n\u0131 yoksayar.\n          <\/td>\n<\/tr>\n<tr>\n<td><b>Etkilenen \u00fcr\u00fcnler<\/b><\/td>\n<td>\n            Google-Safety kullan\u0131c\u0131 arac\u0131s\u0131, Google m\u00fclklerinde herkese a\u00e7\u0131k olarak yay\u0131nlanan ba\u011flant\u0131lar i\u00e7in k\u00f6t\u00fc ama\u00e7l\u0131 yaz\u0131l\u0131m ke\u015ffi gibi k\u00f6t\u00fcye kullan\u0131m odakl\u0131 tarama i\u015flemlerini y\u00fcr\u00fct\u00fcr. Bu nedenle tarama tercihlerinden etkilenmez.\n          <\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/dd>\n<\/dl>\n","protected":false},"excerpt":{"rendered":"<p>Google \u00f6zel durum taray\u0131c\u0131lar\u0131, taranan site ile \u00fcr\u00fcn aras\u0131nda tarama s\u00fcreci konusunda bir anla\u015fman\u0131n bulundu\u011fu belirli Google \u00fcr\u00fcnleri taraf\u0131ndan kullan\u0131l\u0131r. Bu genel bak\u0131\u015f, AdsBot kullan\u0131c\u0131 arac\u0131s\u0131 da dahil olmak \u00fczere \u00f6zel durum Google taray\u0131c\u0131lar\u0131n\u0131 anlaman\u0131za yard\u0131mc\u0131 olacakt\u0131r.<\/p>\n","protected":false},"menu_order":7000,"template":"","meta":{"footnotes":""},"ar_kb_kategori":[708],"ar_kb_etiket":[],"class_list":["post-25668","ar_kb","type-ar_kb","status-publish","has-post-thumbnail","hentry","ar_kb_kategori-crawling-infrastructure-crawling-and-indexing"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25668","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_kb"}],"version-history":[{"count":1,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25668\/revisions"}],"predecessor-version":[{"id":25689,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25668\/revisions\/25689"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/27663"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=25668"}],"wp:term":[{"taxonomy":"ar_kb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_kategori?post=25668"},{"taxonomy":"ar_kb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_etiket?post=25668"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}