{"id":25707,"date":"2026-09-06T00:50:29","date_gmt":"2026-09-05T21:50:29","guid":{"rendered":"https:\/\/alienroad.com\/google-bilgi-bankasi\/things-to-know-about-googles-web-crawling\/"},"modified":"2026-09-06T00:50:29","modified_gmt":"2026-09-05T21:50:29","slug":"things-to-know-about-googles-web-crawling","status":"publish","type":"ar_kb","link":"https:\/\/alienroad.com\/google-bilgi-bankasi\/things-to-know-about-googles-web-crawling\/","title":{"rendered":"Google'\u0131n web tarama s\u00fcre\u00e7leri hakk\u0131nda bilinmesi gerekenler"},"content":{"rendered":"<p>\n  Google, a\u00e7\u0131k web&#8217;i taramaya<br \/>\n  <a href=\"https:\/\/groups.google.com\/g\/comp.lang.java\/c\/aSPAJO05LIU\/m\/ushhUIQQ-ogJ\" class=\"external-link\">30 y\u0131l\u0131 a\u015fk\u0131n s\u00fcredir devam ediyor<\/a>ve bize d\u00fczenli olarak web taray\u0131c\u0131lar\u0131m\u0131z\u0131n nas\u0131l \u00e7al\u0131\u015ft\u0131\u011f\u0131na dair sorular geliyor. Bunlardan baz\u0131lar\u0131n\u0131 yan\u0131tlamak i\u00e7in, Google&#8217;\u0131n taray\u0131c\u0131lar\u0131 ve d\u00fcnya \u00fczerindeki bilgileri d\u00fczenleyerek insanlar\u0131 web&#8217;in d\u00f6rt bir yan\u0131ndaki i\u00e7eriklerle nas\u0131l bulu\u015fturdu\u011fumuz hakk\u0131nda birka\u00e7 ger\u00e7e\u011fi burada bulabilirsiniz.\n<\/p>\n<h2 class=\"numbered\" id=\"what-is-crawling-in-short,-crawling-is-how-google-sees-the-web\" data-text=\"What is crawling? In short, crawling is how Google &quot;sees&quot; the web\" tabindex=\"-1\">Tarama nedir? K\u0131saca tarama, Google&#8217;\u0131n web&#8217;i nas\u0131l &#8220;g\u00f6rd\u00fc\u011f\u00fcd\u00fcr&#8221;<\/h2>\n<p>\n  Tarama, yeni web sayfalar\u0131n\u0131 ke\u015ffetmek ve anlamak i\u00e7in otomatik yaz\u0131l\u0131m kullanma s\u00fcrecidir. Bu sayede, bir web sayfas\u0131 bulmak i\u00e7in Google&#8217;a geldi\u011finizde, sayfan\u0131n var oldu\u011funu biliriz ve onu arama sonu\u00e7lar\u0131n\u0131za dahil edebiliriz. T\u00fcm arama motorlar\u0131, hangi sayfalar\u0131n ve bilgilerin mevcut oldu\u011funu bilmek i\u00e7in taramaya g\u00fcvenir. Videomuzu izleyebilirsiniz: <a href=\"https:\/\/www.youtube.com\/watch?v=JuK7NnfyEuc&amp;t=49s\" class=\"external-link\">Google Arama sayfalar\u0131 nas\u0131l tarar<\/a><br \/>\n  daha fazla bilgi edinmek i\u00e7in.\n<\/p>\n<h2 class=\"numbered\" id=\"we-have-many-crawlers;-they-each-have-important-jobs\" tabindex=\"-1\">Bir\u00e7ok taray\u0131c\u0131m\u0131z var; her birinin \u00f6nemli g\u00f6revleri bulunuyor<\/h2>\n<p>\n  Googlebot en bilinen taray\u0131c\u0131m\u0131zd\u0131r ve Google Arama sonu\u00e7lar\u0131n\u0131 taze ve g\u00fcncel tutmak i\u00e7in kullan\u0131l\u0131r. Ayr\u0131ca Google G\u00f6rseller ve Google Al\u0131\u015fveri\u015f gibi di\u011fer y\u00fczeylerimize \u00f6zel taray\u0131c\u0131lar\u0131m\u0131z da mevcuttur. En yayg\u0131n kullan\u0131lan taray\u0131c\u0131lar\u0131m\u0131z ve bunlar\u0131n ne i\u015fe yarad\u0131\u011f\u0131 hakk\u0131nda <a href=\"https:\/\/developers.google.com\/crawling\">tam dok\u00fcmantasyon<\/a><br \/>\n  sa\u011fl\u0131yoruz. Taray\u0131c\u0131lar\u0131m\u0131z, kolayca tan\u0131mlanabilir kullan\u0131c\u0131 arac\u0131s\u0131 (user-agent) adlar\u0131 ve bilinen internet adresleri kullan\u0131r. Bu sayede site sahipleri, g\u00f6rd\u00fckleri Google taray\u0131c\u0131lar\u0131n\u0131n me\u015fru oldu\u011fundan emin olabilirler.\n<\/p>\n<h2 class=\"numbered\" id=\"we-perform-repeat-crawls-to-find-the-latest-updates-and-to-provide-the-freshest-search-results\" tabindex=\"-1\">En son g\u00fcncellemeleri bulmak ve en taze arama sonu\u00e7lar\u0131n\u0131 sunmak i\u00e7in tekrar taramalar ger\u00e7ekle\u015ftiriyoruz<\/h2>\n<p>\n  Son dakika haberlerini yakalamak i\u00e7in haber ana sayfalar\u0131n\u0131 birka\u00e7 dakikada bir yeniden tarayabiliriz. Di\u011fer durumlarda, y\u0131llard\u0131r hi\u00e7bir \u015feyin de\u011fi\u015fmedi\u011fini g\u00f6rd\u00fc\u011f\u00fcm\u00fczde, yeniden taramak i\u00e7in bir ay bekleyebiliriz. Site sahipleri, yeniden tarama s\u0131kl\u0131\u011f\u0131n\u0131 <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/build-submit-sitemap\/\" class=\"external-link\">site haritas\u0131<\/a><br \/>\n  dosyalar\u0131n\u0131 kullanarak etkileyebilir ve bize yeni veya g\u00fcncellenmi\u015f sayfalar hakk\u0131nda bilgi verebilirler.\n<\/p>\n<h2 class=\"numbered\" id=\"frequent-crawling-is-a-good-sign\" tabindex=\"-1\">S\u0131k tarama iyi bir i\u015farettir!<\/h2>\n<p>Sitenizi s\u0131k tar\u0131yorsak, bu sayfalar\u0131n\u0131z\u0131n insanlar\u0131n bulmak istedi\u011fi taze veya olduk\u00e7a alakal\u0131 i\u00e7eriklere sahip oldu\u011funun ve sistemlerimizin bu talebi tan\u0131d\u0131\u011f\u0131n\u0131n bir g\u00f6stergesidir. Online al\u0131\u015fveri\u015f buna harika bir \u00f6rnektir: E-ticaret sitelerini s\u0131k tarar\u0131z, b\u00f6ylece sonu\u00e7lar\u0131m\u0131z perakendecilerin en g\u00fcncel fiyatlar\u0131n\u0131, promosyonlar\u0131n\u0131 ve stok durumlar\u0131n\u0131 g\u00f6sterir.\n<\/p>\n<h2 class=\"numbered\" id=\"googles-crawling-has-grown-over-time-as-pages-have-become-more-complex\" tabindex=\"-1\">Sayfalar karma\u015f\u0131kla\u015ft\u0131k\u00e7a Google&#8217;\u0131n tarama s\u00fcre\u00e7leri de zamanla geli\u015fti<\/h2>\n<p>\n  S\u0131k yeniden tarama yapmam\u0131z\u0131n bir di\u011fer nedeni, bir web sayfas\u0131n\u0131n zenginli\u011fini ve sunduklar\u0131n\u0131 tam olarak anlamakt\u0131r. Taray\u0131c\u0131lar\u0131m\u0131z, bir siteyi t\u0131pk\u0131 ger\u00e7ek bir ki\u015finin g\u00f6rece\u011fi gibi &#8220;g\u00f6rmek&#8221; i\u00e7in sayfay\u0131 tamamen y\u00fckleyen i\u015fleme (rendering) adl\u0131 bir teknik kullan\u0131r. Y\u0131llar ge\u00e7tik\u00e7e web sayfalar\u0131 daha sofistike hale geldi;<br \/>\n  <a href=\"https:\/\/almanac.httparchive.org\/en\/2024\/page-weight#requests-volume\" class=\"external-link\">medyan mobil sayfa<\/a><br \/>\n  boyutu 816 kilobayttan <a href=\"https:\/\/almanac.httparchive.org\/en\/2024\/page-weight#request-bytes\" class=\"external-link\">2.3 megabayta<\/a>y\u00fckseldi <a href=\"https:\/\/almanac.httparchive.org\/en\/2024\/page-weight#requests-volume\" class=\"external-link\">ve y\u00fcklenecek 60&#8217;tan fazla farkl\u0131 dosya<\/a><br \/>\n  i\u00e7eriyor; g\u00f6rsellerden etkile\u015fimli bile\u015fenlere kadar. Bu nedenle, bir web sayfas\u0131n\u0131n t\u00fcm ihti\u015fam\u0131yla temsili bir anl\u0131k g\u00f6r\u00fcnt\u00fcs\u00fcn\u00fc almak i\u00e7in ayn\u0131 sayfay\u0131 birka\u00e7 kez veya yeni \u00f6\u011feler s\u00fcrekli eklendi\u011fi i\u00e7in daha fazla taramam\u0131z gerekebilir.\n<\/p>\n<h2 class=\"numbered\" id=\"we-optimize-crawling-automatically\" tabindex=\"-1\">Taramay\u0131 otomatik olarak optimize ediyoruz<\/h2>\n<p>\n  Taray\u0131c\u0131lar\u0131m\u0131z verimlilik i\u00e7in tasarlanm\u0131\u015ft\u0131r ve site sahipleri \u00fczerindeki etkiyi en aza indirmek i\u00e7in kendilerini ayarlarlar. \u00d6rne\u011fin, bir site yava\u015flad\u0131\u011f\u0131nda veya hata d\u00f6nd\u00fcrd\u00fc\u011f\u00fcnde,<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/crawl-budget\/\" class=\"external-link\">tarama h\u0131z\u0131 otomatik olarak de\u011fi\u015fir<\/a><br \/>\n  b\u00f6ylece sitenin sunucular\u0131na a\u015f\u0131r\u0131 y\u00fck bindirilmesi \u00f6nlenir. Taranan i\u00e7eri\u011fi \u00f6nbelle\u011fe alarak gereksiz taramay\u0131 s\u0131n\u0131rlamaya \u00e7al\u0131\u015f\u0131yoruz. Taray\u0131c\u0131lar\u0131m\u0131z bir web sitesini daha fazla ke\u015ffettik\u00e7e, daha az tarama ile kapsanabilecek b\u00f6l\u00fcmleri de tan\u0131yabilirler; \u00f6rne\u011fin, 9999 y\u0131l\u0131na kadar giden takvimlerin tamam\u0131n\u0131n taranmas\u0131na muhtemelen gerek yoktur. Site sahipleri, <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/robots-txt-intro\/\" class=\"external-link\">nelerin taranmas\u0131na gerek olmad\u0131\u011f\u0131n\u0131 belirterek<\/a><br \/>\n  yard\u0131mc\u0131 olabilirler; bu, altyap\u0131 maliyetlerini d\u00fc\u015f\u00fcrerek web sitelerine tasarruf sa\u011flar ve interneti bir b\u00fct\u00fcn olarak daha verimli hale getirir.\n<\/p>\n<h2 class=\"numbered\" id=\"google-crawlers-never-go-into-paywall-or-subscription-content-without-permission\" tabindex=\"-1\">Google taray\u0131c\u0131lar\u0131 izin almadan asla \u00f6deme duvar\u0131 veya abonelik i\u00e7eri\u011fine girmez<\/h2>\n<p>\n  Varsay\u0131lan olarak, bir sayfa a\u00e7\u0131k web&#8217;de eri\u015filebilir de\u011filse (\u00f6rne\u011fin, i\u00e7erik bir giri\u015f sayfas\u0131n\u0131n arkas\u0131ndaysa), taray\u0131c\u0131lar\u0131m\u0131z da ona eri\u015femez.<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/flexible-sampling-general-guidance\/\" class=\"external-link\">Site sahipleri i\u00e7in rehberimiz<\/a> mevcuttur; e\u011fer abonelik sayfalar\u0131na a\u00e7\u0131k\u00e7a eri\u015fim izni vermek isterlerse (\u00f6rne\u011fin, Google&#8217;\u0131n kullan\u0131c\u0131lar\u0131 bu i\u00e7eri\u011fe y\u00f6nlendirebilmesi i\u00e7in). Taray\u0131c\u0131lar\u0131m\u0131za abonelik eri\u015fimi sa\u011flamay\u0131 se\u00e7erseniz,<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/flexible-sampling-general-guidance\/#how-to-indicate-paywalled-content\" class=\"external-link\">yap\u0131land\u0131r\u0131lm\u0131\u015f verileri kullanabilir<\/a><br \/>\n  ve insan ziyaret\u00e7ilere giri\u015f ekran\u0131n\u0131 g\u00f6stermeye devam ederken<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/spam-policies\/\" class=\"external-link\">spam kurallar\u0131m\u0131z\u0131<\/a>tetiklemekten ka\u00e7\u0131nabilirsiniz. Ayr\u0131ca,<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/snippets\/#nosnippet\" class=\"external-link\">\u00f6nizleme kontrollerinden<\/a>.\n<\/p>\n<h2 class=\"numbered\" id=\"site-owners-have-control-over-what-gets-crawled,-and-how\" tabindex=\"-1\">yararlanarak abonelik i\u00e7eri\u011finin sayfa \u00f6nizlemelerinde g\u00f6r\u00fcnmesini engelleyebilirsiniz.<\/h2>\n<p>Site sahipleri, nelerin nas\u0131l taranaca\u011f\u0131 konusunda kontrole sahiptir <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/robots-txt-intro\/\" class=\"external-link\">A\u00e7\u0131k web standartlar\u0131na sayg\u0131 duyuyoruz, \u00f6rne\u011fin<\/a>robots.txt <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/robots-meta-tag\/\" class=\"external-link\">gibi; bu basit metin dosyas\u0131, site sahiplerinin bizimki gibi taray\u0131c\u0131lar\u0131n sayfalar\u0131yla nas\u0131l etkile\u015fime girmesi gerekti\u011fini beyan etmelerini sa\u011flar. Robots.txt,<\/a>robots meta etiketleri <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/build-submit-sitemap\/\" class=\"external-link\">ile birlikte, web sitelerinin Google ve di\u011fer hizmetlere i\u00e7eriklerine nas\u0131l eri\u015feceklerini kolayca iletmelerini sa\u011flar. Sayfalar\u0131n Arama&#8217;da g\u00f6r\u00fcnmesini engelleyebilirler. Taranmas\u0131n\u0131 istedikleri yeni i\u00e7erikleri<\/a>site haritalar\u0131<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/optimize-your-crawl-budget\/\">arac\u0131l\u0131\u011f\u0131yla bize bildirebilirler. Ve sitelerini ne s\u0131kl\u0131kla tarayaca\u011f\u0131m\u0131z\u0131<\/a>.\n<\/p>\n<h2 class=\"numbered\" id=\"our-standard-crawlers-always-respect-websites-choices-about-how-their-content-is-accessed-and-used\" tabindex=\"-1\">tarama b\u00fct\u00e7eleri <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/list-of-googles-common-crawlers\/\">\u00fczerinden y\u00f6netebilirler.<\/a><br \/>\n  Standart taray\u0131c\u0131lar\u0131m\u0131z<\/h2>\n<p>her zaman web sitelerinin i\u00e7eriklerine nas\u0131l eri\u015filece\u011fi ve kullan\u0131laca\u011f\u0131 konusundaki tercihlerine sayg\u0131 duyar. Bir taramadan sonra, sitelerde gereksiz tekrar istekleri azaltmak i\u00e7in taranan verileri birden \u00e7ok kez kullanabiliriz. Bu verileri yeniden kullansak bile, sitelerin robots.txt arac\u0131l\u0131\u011f\u0131yla yapt\u0131\u011f\u0131 se\u00e7imlere ve a\u00e7\u0131k web protokol\u00fc \u00fczerinden sundu\u011fumuz kontrollere sayg\u0131 duymaya devam ederiz. \u00d6rne\u011fin, siteler <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/list-of-googles-common-crawlers\/#google-extended\">Google-Extended<\/a><br \/>\n  kullanarak robots.txt i\u00e7inde, di\u011fer \u015feylerin yan\u0131 s\u0131ra, i\u00e7eriklerinin Gemini modellerinin gelecekteki s\u00fcr\u00fcmlerini e\u011fitip e\u011fitmeyece\u011fini kontrol edebilirler. Google-Extended kullan\u0131m\u0131, bir sitenin Arama&#8217;ya dahil edilmesini etkilemez ve Google-Extended&#8217;\u0131 Arama&#8217;da bir s\u0131ralama sinyali olarak kullanmay\u0131z.\n<\/p>\n<p>\n  Site sahiplerinin Google tarama deneyimlerini y\u00f6netmeleri i\u00e7in bir\u00e7ok ara\u00e7 sunuyoruz, bunlardan biri de<br \/>\n  <a href=\"https:\/\/search.google.com\/search-console\/about\" class=\"external-link\">Google Search Console<\/a>olup, site sahiplerine \u00fccretsiz olarak sunulmaktad\u0131r. Bu ara\u00e7,<br \/>\n  <a href=\"https:\/\/support.google.com\/webmasters\/answer\/9679690\" class=\"external-link\">ne kadar tarama yapt\u0131\u011f\u0131m\u0131z ve nedenleri<\/a>hakk\u0131nda bilgi sa\u011flar. Ayr\u0131ca sitelerin sunucu kesintisi veya h\u0131z sorunlar\u0131 gibi problemleri te\u015fhis etmesine yard\u0131mc\u0131 olur. Ek olarak, Search Console, bir sitenin sayfalar\u0131n\u0131n Arama&#8217;da nas\u0131l g\u00f6r\u00fcnd\u00fc\u011f\u00fc ve kullan\u0131c\u0131lar\u0131n onlarla nas\u0131l etkile\u015fimde bulundu\u011fu hakk\u0131nda kapsaml\u0131 bilgiler sunar.\n<\/p>\n<p>\n  Taray\u0131c\u0131lar\u0131m\u0131z, insanlar\u0131 web&#8217;in en iyileriyle bulu\u015fturmaya yard\u0131mc\u0131 olur ve onlar\u0131 daha yetenekli ve verimli hale getirmenin yollar\u0131n\u0131 her zaman ar\u0131yoruz.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Google&#8217;\u0131n web&#8217;i nas\u0131l tarad\u0131\u011f\u0131 hakk\u0131nda bilgi edinin.<\/p>\n","protected":false},"menu_order":7000,"template":"","meta":{"footnotes":""},"ar_kb_kategori":[708],"ar_kb_etiket":[],"class_list":["post-25707","ar_kb","type-ar_kb","status-publish","has-post-thumbnail","hentry","ar_kb_kategori-crawling-infrastructure-crawling-and-indexing"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25707","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_kb"}],"version-history":[{"count":0,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25707\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/27674"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=25707"}],"wp:term":[{"taxonomy":"ar_kb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_kategori?post=25707"},{"taxonomy":"ar_kb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_etiket?post=25707"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}