{"id":28221,"date":"2026-09-08T21:52:59","date_gmt":"2026-09-08T18:52:59","guid":{"rendered":"https:\/\/alienroad.com\/baidu-bilgi-bankasi\/robots-txt-and-baiduspider\/"},"modified":"2026-09-09T02:55:31","modified_gmt":"2026-09-08T23:55:31","slug":"robots-txt-and-baiduspider","status":"publish","type":"ar_bkb","link":"https:\/\/alienroad.com\/baidu-bilgi-bankasi\/robots-txt-and-baiduspider\/","title":{"rendered":"robots.txt ve Baiduspider"},"content":{"rendered":"\n

Baiduspider, tarama yapmadan \u00f6nce alan ad\u0131n\u0131n k\u00f6k dizinindeki robots.txt<\/code> dosyas\u0131n\u0131 kontrol eder. S\u00f6z dizimi standart protokol\u00fc takip eder; a\u015fa\u011f\u0131daki detaylar, Baidu’nun di\u011fer arama motorlar\u0131ndan farkl\u0131la\u015ft\u0131\u011f\u0131 veya daha net oldu\u011fu noktalard\u0131r.<\/p>\n\n\n\n

\u00c7o\u011fu sitenin yanl\u0131\u015f yapt\u0131\u011f\u0131 kural<\/h2>\n\n\n\n

Baidu bunu a\u00e7\u0131k\u00e7a belirtir: her \u015feyin indekslenmesini istiyorsan\u0131z, hi\u00e7 robots.txt<\/code> dosyas\u0131 olu\u015fturmay\u0131n.<\/strong> Dosya yaln\u0131zca hari\u00e7 tutmak i\u00e7in vard\u0131r. Bo\u015f veya mevcut olmayan bir dosya, siteyi tamamen a\u00e7\u0131k b\u0131rak\u0131r; bu, \u00e7o\u011fu site i\u00e7in do\u011fru yap\u0131land\u0131rmad\u0131r ve insanlar\u0131n yar\u0131m yamalak hat\u0131rlad\u0131klar\u0131 \u015fablonlarla de\u011fi\u015ftirdikleri \u015feydir.<\/p>\n\n\n\n

Engellemek, kald\u0131rmak de\u011fildir<\/h2>\n\n\n\n

robots.txt<\/code> i\u00e7inde engellenen bir sayfa, di\u011fer siteler ona ba\u011flant\u0131 verdi\u011finde Baidu sonu\u00e7lar\u0131nda yine de g\u00f6r\u00fcnebilir.<\/strong> \u0130\u00e7eri\u011fi taranmaz, indekslenmez veya g\u00f6r\u00fcnt\u00fclenmez; g\u00f6r\u00fcnen \u015fey, di\u011fer sitelerin onun hakk\u0131ndaki a\u00e7\u0131klamas\u0131d\u0131r. Engelleme taramay\u0131 kontrol eder; varl\u0131\u011f\u0131 kontrol etmez.<\/p>\n\n\n\n

Y\u00f6nerge hassasiyeti<\/h2>\n\n\n\n
  • Disallow: \/help<\/code> ifadesi \/help.html<\/code>, \/helpabc.html<\/code> ve<\/em> \/help\/index.html<\/code> sayfalar\u0131n\u0131 engeller.<\/li>\n
  • Disallow: \/help\/<\/code> ifadesi yaln\u0131zca \/help\/index.html<\/code> sayfas\u0131n\u0131 engeller; ilk ikisi taranabilir kal\u0131r.<\/li>\n
  • Bo\u015f bir Disallow:<\/code> her \u015feye izin verir; ge\u00e7erli bir dosyada en az bir Disallow<\/code> kayd\u0131 bulunmas\u0131 zorunludur.<\/li>\n
  • S\u0131ralama \u00f6nemlidir:<\/strong> robot, e\u015fle\u015fen ilk Allow<\/code> veya Disallow<\/code> sat\u0131r\u0131n\u0131<\/em> uygular. Bu, di\u011fer arama motorlar\u0131n\u0131n kulland\u0131\u011f\u0131 “en uzun e\u015fle\u015fme” kural\u0131 de\u011fildir ve Google i\u00e7in yaz\u0131lm\u0131\u015f bir dosya burada farkl\u0131 davranabilir.<\/li>\n
  • Joker karakterler: *<\/code> herhangi bir diziyi, $<\/code> sat\u0131r sonunu e\u015fle\u015ftirir.<\/li>\n
  • E\u015fle\u015ftirme b\u00fcy\u00fck\/k\u00fc\u00e7\u00fck harfe duyarl\u0131d\u0131r ve kesindir.<\/strong> Baidu, b\u00fcy\u00fck\/k\u00fc\u00e7\u00fck harf uyumsuzlu\u011funun kural\u0131 etkisiz hale getirdi\u011fi konusunda uyar\u0131r.<\/li><\/ul>\n\n\n\n

    Baidu’ya \u00f6zg\u00fc meta y\u00f6nergeleri<\/h2>\n\n\n\n
    • <meta name=\"robots\" content=\"nofollow\"><\/code> \u2014 ba\u011flant\u0131lar\u0131 takip etme veya de\u011fer aktarma; <meta name=\"Baiduspider\" content=\"nofollow\"><\/code> bunu yaln\u0131zca Baidu ile k\u0131s\u0131tlar.<\/li>\n
    • <meta name=\"robots\" content=\"noarchive\"><\/code> \u2014 \u00f6nbellek anl\u0131k g\u00f6r\u00fcnt\u00fcs\u00fc alma; yaln\u0131zca Baidu’ya \u00f6zg\u00fc bi\u00e7imi <meta name=\"Baiduspider\" content=\"noarchive\"><\/code> \u015feklindedir. noarchive’in yaln\u0131zca anl\u0131k g\u00f6r\u00fcnt\u00fcy\u00fc engelledi\u011fini<\/strong> unutmay\u0131n; sayfa yine de indekslenir ve bir \u00f6zetle g\u00f6sterilir.<\/li>\n
    • rel=\"nofollow\"<\/code> ile ba\u011flant\u0131 bazl\u0131 kontrol desteklenir.<\/li><\/ul>\n\n\n\n

      Ger\u00e7ek Baiduspider’\u0131 tan\u0131mlama<\/h2>\n\n\n\n

      Baidu, IP aral\u0131klar\u0131n\u0131 yay\u0131nlamaz; bu aral\u0131klar de\u011fi\u015fir. Do\u011frulama, kullan\u0131c\u0131 arac\u0131s\u0131 (user agent) ve ters DNS sorgusu ile yap\u0131l\u0131r. mobil<\/strong>, PC<\/strong> ve mini-program<\/strong> olmak \u00fczere \u00fc\u00e7 kullan\u0131c\u0131 arac\u0131s\u0131 ailesi vard\u0131r ve render i\u015flemleri i\u00e7in Baiduspider-render<\/code> varyantlar\u0131 bulunur. IP \u00fczerinden engelleme desteklenen bir strateji de\u011fildir; \u00f6nce kullan\u0131c\u0131 arac\u0131s\u0131n\u0131 kontrol edip DNS ile do\u011frulamak desteklenen y\u00f6ntemdir.<\/p>\n","protected":false},"excerpt":{"rendered":"

      Baiduspider, tarama yapmadan \u00f6nce alan ad\u0131n\u0131n k\u00f6k dizinindeki robots.txt dosyas\u0131n\u0131 kontrol eder. S\u00f6z dizimi standart protokol\u00fc takip eder; a\u015fa\u011f\u0131daki detaylar, Baidu’nun di\u011fer arama motorlar\u0131ndan farkl\u0131la\u015ft\u0131\u011f\u0131 veya daha net oldu\u011fu noktalard\u0131r. \u00c7o\u011fu sitenin yanl\u0131\u015f yapt\u0131\u011f\u0131 kural Baidu bunu a\u00e7\u0131k\u00e7a belirtir: her \u015feyin indekslenmesini istiyorsan\u0131z, hi\u00e7 robots.txt dosyas\u0131 olu\u015fturmay\u0131n. Dosya yaln\u0131zca hari\u00e7 tutmak i\u00e7in vard\u0131r. Bo\u015f veya […]<\/p>\n","protected":false},"menu_order":9,"template":"","meta":{"footnotes":""},"ar_bkb_kategori":[744],"ar_bkb_etiket":[],"class_list":["post-28221","ar_bkb","type-ar_bkb","status-publish","has-post-thumbnail","hentry","ar_bkb_kategori-indexing-and-submission"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_bkb\/28221","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_bkb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_bkb"}],"version-history":[{"count":2,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_bkb\/28221\/revisions"}],"predecessor-version":[{"id":29220,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_bkb\/28221\/revisions\/29220"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/28985"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=28221"}],"wp:term":[{"taxonomy":"ar_bkb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_bkb_kategori?post=28221"},{"taxonomy":"ar_bkb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_bkb_etiket?post=28221"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}