{"id":25672,"date":"2026-09-06T00:47:45","date_gmt":"2026-09-05T21:47:45","guid":{"rendered":"https:\/\/alienroad.com\/google-bilgi-bankasi\/how-to-write-and-submit-a-robots-txt-file\/"},"modified":"2026-09-06T00:51:44","modified_gmt":"2026-09-05T21:51:44","slug":"how-to-write-and-submit-a-robots-txt-file","status":"publish","type":"ar_kb","link":"https:\/\/alienroad.com\/google-bilgi-bankasi\/how-to-write-and-submit-a-robots-txt-file\/","title":{"rendered":"robots.txt fayl\u0131n\u0131 nec\u0259 yazmaq v\u0259 g\u00f6nd\u0259rm\u0259k olar"},"content":{"rendered":"<aside class=\"key-point\">\n<p>\n    <b>\u018fg\u0259r Wix v\u0259 ya Blogger kimi sayt hostinq xidm\u0259tind\u0259n istifad\u0259 edirsinizs\u0259<\/b>, robots.txt fayl\u0131n\u0131z\u0131 birba\u015fa redakt\u0259 etm\u0259yiniz\u0259 ehtiyac olmaya bil\u0259r (v\u0259 ya buna imkan\u0131n\u0131z olmaya bil\u0259r). Bunun \u0259v\u0259zin\u0259, provayderiniz axtar\u0131\u015f sisteml\u0259rin\u0259 s\u0259hif\u0259nizi taray\u0131b-taramayacaqlar\u0131n\u0131 bildirm\u0259k \u00fc\u00e7\u00fcn axtar\u0131\u015f parametrl\u0259ri s\u0259hif\u0259si v\u0259 ya ba\u015fqa bir mexanizm t\u0259qdim ed\u0259 bil\u0259r.\n  <\/p>\n<p>\n    S\u0259hif\u0259l\u0259rinizd\u0259n birini axtar\u0131\u015f sisteml\u0259rind\u0259n gizl\u0259tm\u0259k v\u0259 ya g\u00f6st\u0259rm\u0259k ist\u0259yirsinizs\u0259, hostinq xidm\u0259tinizd\u0259 s\u0259hif\u0259 g\u00f6r\u00fcn\u00fcrl\u00fc\u011f\u00fcn\u00fc d\u0259yi\u015fdirm\u0259kl\u0259 ba\u011fl\u0131 t\u0259limatlar\u0131 axtar\u0131n; m\u0259s\u0259l\u0259n, &#8220;wix hide page from search engines&#8221; kimi axtar\u0131\u015f edin.\n  <\/p>\n<\/aside>\n<p>\n  Siz robots.txt fayl\u0131 il\u0259 sayt\u0131n\u0131zdak\u0131 <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/robots-txt-intro\/\">krolerl\u0259rin hans\u0131 fayllara daxil ola bil\u0259c\u0259yin\u0259 n\u0259zar\u0259t ed\u0259 bil\u0259rsiniz<\/a>.\n<\/p>\n<p>\n  robots.txt fayl\u0131 sayt\u0131n\u0131z\u0131n k\u00f6k qovlu\u011funda yerl\u0259\u015fir. Bel\u0259likl\u0259, <code>www.example.com<\/code> sayt\u0131 \u00fc\u00e7\u00fcn robots.txt fayl\u0131 <code>www.example.com\/robots.txt<\/code> \u00fcnvan\u0131nda yerl\u0259\u015fir. robots.txt, <a href=\"https:\/\/en.wikipedia.org\/wiki\/Robots_exclusion_standard#About_the_standard\" class=\"external-link\">Robots Exclusion Standard<\/a> qaydalar\u0131na tabe olan sad\u0259 m\u0259tn fayl\u0131d\u0131r. robots.txt fayl\u0131 bir v\u0259 ya bir ne\u00e7\u0259 qaydadan ibar\u0259tdir. H\u0259r bir qayda, robots.txt fayl\u0131n\u0131n yerl\u0259\u015fdiyi domen v\u0259 ya alt domend\u0259ki m\u00fc\u0259yy\u0259n bir fayl yoluna b\u00fct\u00fcn krolerl\u0259rin v\u0259 ya x\u00fcsusi bir krolerin giri\u015fini bloklay\u0131r v\u0259 ya icaz\u0259 verir. Siz robots.txt fayl\u0131n\u0131zda ba\u015fqa c\u00fcr qeyd etm\u0259diyiniz m\u00fcdd\u0259tc\u0259, b\u00fct\u00fcn fayllar\u0131n krol edilm\u0259sin\u0259 dolay\u0131 yolla icaz\u0259 verilir.\n<\/p>\n<p>Budur iki qaydas\u0131 olan sad\u0259 bir robots.txt fayl\u0131:<\/p>\n<div><\/div>\n<p><b>Bu robots.txt fayl\u0131n\u0131n m\u0259nas\u0131 budur:<\/b><\/p>\n<ol>\n<li>\n    Googlebot adl\u0131 istifad\u0259\u00e7i agentin\u0259 <code>https:\/\/example.com\/nogooglebot\/<\/code> il\u0259 ba\u015flayan he\u00e7 bir URL-i krol etm\u0259y\u0259 icaz\u0259 verilmir.\n  <\/li>\n<li>\n    B\u00fct\u00fcn dig\u0259r istifad\u0259\u00e7i agentl\u0259rin\u0259 b\u00fct\u00fcn sayt\u0131 krol etm\u0259y\u0259 icaz\u0259 verilir. Bu hiss\u0259ni yazmasan\u0131z da n\u0259tic\u0259 eyni olard\u0131; standart davran\u0131\u015f odur ki, istifad\u0259\u00e7i agentl\u0259rin\u0259 b\u00fct\u00fcn sayt\u0131 krol etm\u0259y\u0259 icaz\u0259 verilir.\n  <\/li>\n<li>\n    Sayt\u0131n <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/sitemaps-overview\/\">sitemap fayl\u0131<\/a> <code>https:\/\/www.example.com\/sitemap.xml<\/code> \u00fcnvan\u0131nda yerl\u0259\u015fir.\n  <\/li>\n<\/ol>\n<p>Daha \u00e7ox n\u00fcmun\u0259 \u00fc\u00e7\u00fcn <a href=\"#create_rules\">sintaksis<\/a> b\u00f6lm\u0259sin\u0259 bax\u0131n.<\/p>\n<h2 id=\"learn_robots_txt_syntax\" tabindex=\"-1\">robots.txt fayl\u0131 yaratmaq \u00fc\u00e7\u00fcn \u0259sas qaydalar<\/h2>\n<p>\n  robots.txt fayl\u0131 yaratmaq v\u0259 onu \u0259l\u00e7atan v\u0259 faydal\u0131 etm\u0259k d\u00f6rd add\u0131mdan ibar\u0259tdir:\n<\/p>\n<ol>\n<li><a href=\"#format_location\">robots.txt adl\u0131 fayl yarad\u0131n<\/a>.<\/li>\n<li><a href=\"#create_rules\">robots.txt fayl\u0131na qaydalar \u0259lav\u0259 edin<\/a>.<\/li>\n<li><a href=\"#upload\">robots.txt fayl\u0131n\u0131 sayt\u0131n\u0131z\u0131n k\u00f6k qovlu\u011funa y\u00fckl\u0259yin<\/a>.<\/li>\n<li><a href=\"#testing\">robots.txt fayl\u0131n\u0131 test edin<\/a>.<\/li>\n<\/ol>\n<h2 id=\"format_location\" tabindex=\"-1\">robots.txt fayl\u0131 yarad\u0131n<\/h2>\n<p>\n  robots.txt fayl\u0131 yaratmaq \u00fc\u00e7\u00fcn dem\u0259k olar ki, ist\u0259nil\u0259n m\u0259tn redaktorundan istifad\u0259 ed\u0259 bil\u0259rsiniz. M\u0259s\u0259l\u0259n, Notepad, TextEdit, vi v\u0259 emacs etibarl\u0131 robots.txt fayllar\u0131 yarada bil\u0259r. M\u0259tn prosessorlar\u0131ndan istifad\u0259 etm\u0259yin; m\u0259tn prosessorlar\u0131 fayllar\u0131 \u00e7ox vaxt x\u00fcsusi formatda saxlay\u0131r v\u0259 krolerl\u0259r \u00fc\u00e7\u00fcn probleml\u0259r yarada bil\u0259n q\u0131vr\u0131m d\u0131rnaq i\u015far\u0259l\u0259ri kimi g\u00f6zl\u0259nilm\u0259z simvollar \u0259lav\u0259 ed\u0259 bil\u0259r. Fayl\u0131 saxlayark\u0259n sor\u011fu g\u0259l\u0259rs\u0259, UTF-8 kodla\u015fd\u0131rmas\u0131 il\u0259 saxlad\u0131\u011f\u0131n\u0131zdan \u0259min olun.\n<\/p>\n<p><b>Format v\u0259 yerl\u0259\u015fm\u0259 qaydalar\u0131:<\/b><\/p>\n<ul>\n<li>Fayl\u0131n ad\u0131 m\u00fctl\u0259q robots.txt olmal\u0131d\u0131r.<\/li>\n<li>Sayt\u0131n\u0131zda yaln\u0131z bir robots.txt fayl\u0131 ola bil\u0259r.<\/li>\n<li>\n    robots.txt fayl\u0131 t\u0259tbiq olundu\u011fu sayt hostunun k\u00f6k qovlu\u011funda yerl\u0259\u015fm\u0259lidir. M\u0259s\u0259l\u0259n, <code>https:\/\/www.example.com\/<\/code> alt\u0131ndak\u0131 b\u00fct\u00fcn URL-l\u0259rd\u0259 krol etm\u0259y\u0259 n\u0259zar\u0259t etm\u0259k \u00fc\u00e7\u00fcn robots.txt fayl\u0131 <code>https:\/\/www.example.com\/robots.txt<\/code> \u00fcnvan\u0131nda yerl\u0259\u015fm\u0259lidir. O, alt qovluqda (m\u0259s\u0259l\u0259n, <code>https:\/\/example.com\/pages\/robots.txt<\/code> \u00fcnvan\u0131nda) yerl\u0259\u015fdiril\u0259 <i>bilm\u0259z<\/i>. Sayt\u0131n k\u00f6k qovlu\u011funa nec\u0259 daxil olaca\u011f\u0131n\u0131zdan \u0259min deyilsinizs\u0259 v\u0259 ya bunun \u00fc\u00e7\u00fcn icaz\u0259y\u0259 ehtiyac\u0131n\u0131z varsa, veb hostinq xidm\u0259ti provayderinizl\u0259 \u0259laq\u0259 saxlay\u0131n. Sayt\u0131n k\u00f6k qovlu\u011funa daxil ola bilmirsinizs\u0259, <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/block-search-indexing-with-noindex\/\"><code>meta<\/code> teql\u0259ri<\/a> kimi alternativ bloklama metodundan istifad\u0259 edin.\n  <\/li>\n<li>\n    robots.txt fayl\u0131 alt domend\u0259 (m\u0259s\u0259l\u0259n, <code>https:\/\/<b>site<\/b>.example.com\/robots.txt<\/code>) v\u0259 ya standart olmayan portlarda (m\u0259s\u0259l\u0259n, <code>https:\/\/example.com:<b>8181<\/b>\/robots.txt<\/code>) yerl\u0259\u015fdiril\u0259 bil\u0259r.\n  <\/li>\n<li>robots.txt fayl\u0131 yaln\u0131z yerl\u0259\u015fdirildiyi protokol, host v\u0259 port daxilind\u0259ki yollara t\u0259tbiq olunur. Y\u0259ni, <code>https:\/\/example.com\/robots.txt<\/code> fayl\u0131ndak\u0131 qaydalar yaln\u0131z <code>https:\/\/example.com\/<\/code> daxilind\u0259ki fayllara t\u0259tbiq olunur, <code>https:\/\/m.example.com\/<\/code> kimi alt domenl\u0259r\u0259 v\u0259 ya <code>http:\/\/example.com\/<\/code> kimi alternativ protokollara \u015famil edilmir.\n  <\/li>\n<li>\n    robots.txt fayl\u0131 UTF-8 kodla\u015fd\u0131r\u0131lm\u0131\u015f m\u0259tn fayl\u0131 olmal\u0131d\u0131r (ASCII daxil olmaqla). Google, UTF-8 diapazonuna daxil olmayan simvollar\u0131 n\u0259z\u0259r\u0259 almaya bil\u0259r v\u0259 bu, robots.txt qaydalar\u0131n\u0131 etibars\u0131z ed\u0259 bil\u0259r.\n  <\/li>\n<\/ul>\n<h2 id=\"create_rules\" tabindex=\"-1\">robots.txt qaydalar\u0131n\u0131 nec\u0259 yazmal\u0131<\/h2>\n<p>\n  Qaydalar krolerl\u0259r \u00fc\u00e7\u00fcn sayt\u0131n\u0131z\u0131n hans\u0131 hiss\u0259l\u0259rini krol ed\u0259 bil\u0259c\u0259kl\u0259ri bar\u0259d\u0259 t\u0259limatlard\u0131r. robots.txt fayl\u0131n\u0131za qaydalar \u0259lav\u0259 ed\u0259rk\u0259n bu t\u0259limatlara \u0259m\u0259l edin:\n<\/p>\n<ul>\n<li>robots.txt fayl\u0131 bir v\u0259 ya bir ne\u00e7\u0259 qrupdan (qaydalar toplusu) ibar\u0259tdir.<\/li>\n<li>\n    H\u0259r qrup bir ne\u00e7\u0259 qaydadan (direktivl\u0259r kimi d\u0259 tan\u0131n\u0131r) ibar\u0259tdir, h\u0259r s\u0259tird\u0259 bir qayda olur. H\u0259r qrup qrupun h\u0259d\u0259fini m\u00fc\u0259yy\u0259n ed\u0259n <code>User-agent<\/code> s\u0259tri il\u0259 ba\u015flay\u0131r.\n  <\/li>\n<li>Bir qrup a\u015fa\u011f\u0131dak\u0131 m\u0259lumatlar\u0131 verir:\n<ul>\n<li>Qrupun kim\u0259 t\u0259tbiq olundu\u011fu (istifad\u0259\u00e7i agenti).<\/li>\n<li>H\u0259min agentin hans\u0131 qovluqlara v\u0259 ya fayllara daxil <i>ola bil\u0259c\u0259yi<\/i>.<\/li>\n<li>H\u0259min agentin hans\u0131 qovluqlara v\u0259 ya fayllara daxil <i>ola bilm\u0259y\u0259c\u0259yi<\/i>.<\/li>\n<\/ul>\n<\/li>\n<li>\n    Krolerl\u0259r qruplar\u0131 yuxar\u0131dan a\u015fa\u011f\u0131ya do\u011fru emal edir. Bir istifad\u0259\u00e7i agenti yaln\u0131z bir qaydalar toplusuna uy\u011fun g\u0259l\u0259 bil\u0259r; bu, verilmi\u015f istifad\u0259\u00e7i agentin\u0259 uy\u011fun g\u0259l\u0259n ilk v\u0259 \u0259n spesifik qrupdur. Eyni istifad\u0259\u00e7i agenti \u00fc\u00e7\u00fcn bir ne\u00e7\u0259 qrup varsa, qruplar emal edilm\u0259zd\u0259n \u0259vv\u0259l vahid bir qrupda birl\u0259\u015fdiril\u0259c\u0259k.\n  <\/li>\n<li>\n    Standart f\u0259rziyy\u0259 odur ki, istifad\u0259\u00e7i agenti <code>disallow<\/code> qaydas\u0131 il\u0259 bloklanmayan ist\u0259nil\u0259n s\u0259hif\u0259ni v\u0259 ya qovlu\u011fu krol ed\u0259 bil\u0259r.\n  <\/li>\n<li>\n    Qaydalar b\u00f6y\u00fck-ki\u00e7ik h\u0259rf\u0259 h\u0259ssasd\u0131r. M\u0259s\u0259l\u0259n, <code>disallow: \/file.asp<\/code> qaydas\u0131 <code>https:\/\/www.example.com\/file.asp<\/code> \u00fcnvan\u0131na t\u0259tbiq olunur, lakin <code>https:\/\/www.example.com\/FILE.asp<\/code> \u00fcnvan\u0131na t\u0259tbiq olunmur.\n  <\/li>\n<li>\n    <code>#<\/code> simvolu \u015f\u0259rhin ba\u015flan\u011f\u0131c\u0131n\u0131 bildirir. \u015e\u0259rhl\u0259r emal zaman\u0131 n\u0259z\u0259r\u0259 al\u0131nm\u0131r.\n  <\/li>\n<\/ul>\n<p><b>Google-un krolerl\u0259ri robots.txt fayllar\u0131nda a\u015fa\u011f\u0131dak\u0131 qaydalar\u0131 d\u0259st\u0259kl\u0259yir:<\/b><\/p>\n<ul>\n<li>\n    <code>user-agent:<\/code> [T\u0259l\u0259b olunur, h\u0259r qrup \u00fc\u00e7\u00fcn bir v\u0259 ya daha \u00e7ox] Bu qayda, qaydan\u0131n t\u0259tbiq olundu\u011fu axtar\u0131\u015f sistemi kroleri kimi tan\u0131nan avtomatik m\u00fc\u015ft\u0259rinin ad\u0131n\u0131 m\u00fc\u0259yy\u0259n edir. Bu, ist\u0259nil\u0259n qayda qrupu \u00fc\u00e7\u00fcn ilk s\u0259tirdir. Google istifad\u0259\u00e7i agentl\u0259rinin adlar\u0131 <a href=\"https:\/\/developers.google.com\/crawling\/docs\/crawlers-fetchers\/overview-google-crawlers\">Google istifad\u0259\u00e7i agentl\u0259ri siyah\u0131s\u0131nda<\/a> verilmi\u015fdir. Ulduz i\u015far\u0259sind\u0259n (<code>*<\/code>) istifad\u0259 etm\u0259k, a\u00e7\u0131q \u015f\u0259kild\u0259 adland\u0131r\u0131lmal\u0131 olan m\u00fcxt\u0259lif AdsBot krolerl\u0259ri istisna olmaqla, b\u00fct\u00fcn krolerl\u0259r\u0259 uy\u011fun g\u0259lir. M\u0259s\u0259l\u0259n:<\/p>\n<div><\/div>\n<\/li>\n<li>\n    <code>disallow:<\/code> [H\u0259r qayda \u00fc\u00e7\u00fcn \u0259n az\u0131 bir v\u0259 ya daha \u00e7ox <code>disallow<\/code> v\u0259 ya <code>allow<\/code> giri\u015fi] K\u00f6k domen\u0259 nisb\u0259t\u0259n istifad\u0259\u00e7i agentinin krol etm\u0259sini ist\u0259m\u0259diyiniz qovluq v\u0259 ya s\u0259hif\u0259. \u018fg\u0259r qayda bir s\u0259hif\u0259y\u0259 aiddirs\u0259, bu, brauzerd\u0259 g\u00f6st\u0259rildiyi kimi tam s\u0259hif\u0259 ad\u0131 olmal\u0131d\u0131r. O, <code>\/<\/code> simvolu il\u0259 ba\u015flamal\u0131d\u0131r v\u0259 \u0259g\u0259r qovlu\u011fa aiddirs\u0259, <code>\/<\/code> i\u015far\u0259si il\u0259 bitm\u0259lidir.\n  <\/li>\n<li>\n    <code>allow:<\/code> [H\u0259r qayda \u00fc\u00e7\u00fcn \u0259n az\u0131 bir v\u0259 ya daha \u00e7ox <code>disallow<\/code> v\u0259 ya <code>allow<\/code> giri\u015fi] K\u00f6k domen\u0259 nisb\u0259t\u0259n, yuxar\u0131da qeyd olunan istifad\u0259\u00e7i agenti t\u0259r\u0259find\u0259n krol edil\u0259 bil\u0259n qovluq v\u0259 ya s\u0259hif\u0259. Bu, bloklanm\u0131\u015f qovluqdak\u0131 alt qovlu\u011fun v\u0259 ya s\u0259hif\u0259nin krol edilm\u0259sin\u0259 icaz\u0259 verm\u0259k \u00fc\u00e7\u00fcn <code>disallow<\/code> qaydas\u0131n\u0131 l\u0259\u011fv etm\u0259k \u00fc\u00e7\u00fcn istifad\u0259 olunur. T\u0259k bir s\u0259hif\u0259 \u00fc\u00e7\u00fcn brauzerd\u0259 g\u00f6st\u0259rildiyi kimi tam s\u0259hif\u0259 ad\u0131n\u0131 qeyd edin. O, <code>\/<\/code> simvolu il\u0259 ba\u015flamal\u0131d\u0131r v\u0259 \u0259g\u0259r qovlu\u011fa aiddirs\u0259, <code>\/<\/code> i\u015far\u0259si il\u0259 bitm\u0259lidir.\n  <\/li>\n<li>\n    <code>sitemap:<\/code> [\u0130st\u0259y\u0259 ba\u011fl\u0131, h\u0259r fayl \u00fc\u00e7\u00fcn s\u0131f\u0131r v\u0259 ya daha \u00e7ox] Bu sayt \u00fc\u00e7\u00fcn sitemap-in yeri. Sitemap URL-i tam keyfiyy\u0259tli URL olmal\u0131d\u0131r; Google http\/https\/www\/non-www alternativl\u0259rini f\u0259rz etmir v\u0259 ya yoxlam\u0131r. Sitemap-l\u0259r, Google-un hans\u0131 m\u0259zmunu krol ed\u0259 bil\u0259c\u0259yind\u0259n v\u0259 ya ed\u0259 bilm\u0259y\u0259c\u0259yind\u0259n f\u0259rqli olaraq, hans\u0131 m\u0259zmunu krol etm\u0259li oldu\u011funu g\u00f6st\u0259rm\u0259k \u00fc\u00e7\u00fcn yax\u015f\u0131 bir yoldur.<br \/>\n    <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/sitemaps-overview\/\">Sitemap-l\u0259r haqq\u0131nda daha \u00e7ox m\u0259lumat \u0259ld\u0259 edin.<\/a><br \/>\n    <b>N\u00fcmun\u0259:<\/b><\/p>\n<div><\/div>\n<\/li>\n<\/ul>\n<p>\n  <code>sitemap<\/code> istisna olmaqla, b\u00fct\u00fcn qaydalar yol prefiksi, suffiksi v\u0259 ya tam s\u0259tir \u00fc\u00e7\u00fcn <code>*<\/code> joker simvolunu d\u0259st\u0259kl\u0259yir.\n<\/p>\n<p>Bu qaydalar\u0131n he\u00e7 birin\u0259 uy\u011fun g\u0259lm\u0259y\u0259n s\u0259tirl\u0259r n\u0259z\u0259r\u0259 al\u0131nm\u0131r.<\/p>\n<p>\n  H\u0259r bir qaydan\u0131n tam t\u0259sviri \u00fc\u00e7\u00fcn <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/how-google-interprets-the-robots-txt-specification\/\">Google-un robots.txt spesifikasiyas\u0131n\u0131 \u015f\u0259rh etm\u0259si<\/a> haqq\u0131nda s\u0259hif\u0259mizi oxuyun.\n<\/p>\n<h2 id=\"upload\" tabindex=\"-1\">robots.txt fayl\u0131n\u0131 y\u00fckl\u0259yin<\/h2>\n<p>\n  robots.txt fayl\u0131n\u0131z\u0131 komp\u00fcterinizd\u0259 saxlad\u0131qdan sonra onu axtar\u0131\u015f sistemi krolerl\u0259ri \u00fc\u00e7\u00fcn \u0259l\u00e7atan etm\u0259y\u0259 haz\u0131rs\u0131n\u0131z. Bunun \u00fc\u00e7\u00fcn vahid bir al\u0259t yoxdur, \u00e7\u00fcnki robots.txt fayl\u0131n\u0131 sayt\u0131n\u0131za nec\u0259 y\u00fckl\u0259y\u0259c\u0259yiniz sayt\u0131n\u0131zdan v\u0259 server arxitekturan\u0131zdan as\u0131l\u0131d\u0131r. Hostinq \u015firk\u0259tinizl\u0259 \u0259laq\u0259 saxlay\u0131n v\u0259 ya hostinq \u015firk\u0259tinizin s\u0259n\u0259dl\u0259rini axtar\u0131n; m\u0259s\u0259l\u0259n, &#8220;upload files infomaniak&#8221; kimi axtar\u0131\u015f edin.\n<\/p>\n<p>\n  robots.txt fayl\u0131n\u0131 y\u00fckl\u0259dikd\u0259n sonra onun ictimaiyy\u0259t\u0259 a\u00e7\u0131q olub-olmad\u0131\u011f\u0131n\u0131 v\u0259 Google-un onu t\u0259hlil ed\u0259 bil\u0259c\u0259yini yoxlay\u0131n.\n<\/p>\n<h2 id=\"testing\" tabindex=\"-1\">\n  robots.txt i\u015far\u0259l\u0259m\u0259sini test edin<br \/>\n<\/h2>\n<p>\n  Yeni y\u00fckl\u0259nmi\u015f robots.txt fayl\u0131n\u0131z\u0131n ictimaiyy\u0259t\u0259 a\u00e7\u0131q olub-olmad\u0131\u011f\u0131n\u0131 yoxlamaq \u00fc\u00e7\u00fcn brauzerinizd\u0259 <a href=\"https:\/\/support.google.com\/chrome\/answer\/95464\" class=\"external-link\">gizli rejim p\u0259nc\u0259r\u0259si<\/a> (v\u0259 ya ekvivalenti) a\u00e7\u0131n v\u0259 robots.txt fayl\u0131n\u0131n yerl\u0259\u015fdiyi yer\u0259 ke\u00e7in. M\u0259s\u0259l\u0259n, <code>https:\/\/example.com\/robots.txt<\/code>. \u018fg\u0259r robots.txt fayl\u0131n\u0131z\u0131n m\u0259zmununu g\u00f6r\u00fcrs\u00fcn\u00fczs\u0259, i\u015far\u0259l\u0259m\u0259ni test etm\u0259y\u0259 haz\u0131rs\u0131n\u0131z.\n<\/p>\n<p>Google, robots.txt i\u015far\u0259l\u0259m\u0259si il\u0259 ba\u011fl\u0131 probleml\u0259ri h\u0259ll etm\u0259k \u00fc\u00e7\u00fcn iki se\u00e7im t\u0259klif edir:<\/p>\n<ol>\n<li>\n    Search Console-da <a href=\"https:\/\/support.google.com\/webmasters\/answer\/6062598\" class=\"external-link\">robots.txt hesabat\u0131<\/a>. Siz bu hesabatdan yaln\u0131z sayt\u0131n\u0131zda art\u0131q \u0259l\u00e7atan olan robots.txt fayllar\u0131 \u00fc\u00e7\u00fcn istifad\u0259 ed\u0259 bil\u0259rsiniz.\n  <\/li>\n<li>\n    \u018fg\u0259r t\u0259rtibat\u00e7\u0131s\u0131n\u0131zsa, Google Axtar\u0131\u015f\u0131nda da istifad\u0259 olunan <a href=\"https:\/\/github.com\/google\/robotstxt\" class=\"external-link\">Google-un a\u00e7\u0131q m\u0259nb\u0259li robots.txt kitabxanas\u0131n\u0131<\/a> yoxlay\u0131n v\u0259 qurun. Siz bu al\u0259td\u0259n robots.txt fayllar\u0131n\u0131 yerli olaraq komp\u00fcterinizd\u0259 test etm\u0259k \u00fc\u00e7\u00fcn istifad\u0259 ed\u0259 bil\u0259rsiniz.\n  <\/li>\n<\/ol>\n<h2 id=\"submit\" tabindex=\"-1\">robots.txt fayl\u0131n\u0131 Google-a t\u0259qdim edin<\/h2>\n<p>\n  robots.txt fayl\u0131n\u0131z\u0131 y\u00fckl\u0259dikd\u0259n v\u0259 test etdikd\u0259n sonra Google-un krolerl\u0259ri avtomatik olaraq robots.txt fayl\u0131n\u0131z\u0131 tapacaq v\u0259 istifad\u0259 etm\u0259y\u0259 ba\u015flayacaqlar. He\u00e7 n\u0259 etm\u0259yiniz\u0259 ehtiyac yoxdur. \u018fg\u0259r robots.txt fayl\u0131n\u0131z\u0131 yenil\u0259misinizs\u0259 v\u0259 Google-un ke\u015fl\u0259nmi\u015f n\u00fcsx\u0259sini m\u00fcmk\u00fcn q\u0259d\u0259r tez yenil\u0259m\u0259lisinizs\u0259, <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/update-your-robots-txt-file\/\">yenil\u0259nmi\u015f robots.txt fayl\u0131n\u0131 nec\u0259 t\u0259qdim ed\u0259c\u0259yinizi<\/a> \u00f6yr\u0259nin.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>robots.txt fayl\u0131 sayt\u0131n\u0131z\u0131n k\u00f6k qovlu\u011funda yerl\u0259\u015fir. robots.txt fayl\u0131n\u0131 nec\u0259 yaratma\u011f\u0131 \u00f6yr\u0259nin, n\u00fcmun\u0259l\u0259r\u0259 bax\u0131n v\u0259 robots.txt qaydalar\u0131n\u0131 k\u0259\u015ff edin.<\/p>\n","protected":false},"menu_order":7000,"template":"","meta":{"footnotes":""},"ar_kb_kategori":[708],"ar_kb_etiket":[],"class_list":["post-25672","ar_kb","type-ar_kb","status-publish","has-post-thumbnail","hentry","ar_kb_kategori-crawling-infrastructure-crawling-and-indexing"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25672","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_kb"}],"version-history":[{"count":1,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25672\/revisions"}],"predecessor-version":[{"id":25693,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25672\/revisions\/25693"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/27667"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=25672"}],"wp:term":[{"taxonomy":"ar_kb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_kategori?post=25672"},{"taxonomy":"ar_kb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_etiket?post=25672"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}