{"id":25331,"date":"2024-12-09T00:00:00","date_gmt":"2024-12-09T00:00:00","guid":{"rendered":"https:\/\/alienroad.com\/google-bilgi-bankasi\/crawling-december-http-caching\/"},"modified":"2024-12-09T00:00:00","modified_gmt":"2024-12-09T00:00:00","slug":"crawling-december-http-caching","status":"publish","type":"ar_kb","link":"https:\/\/alienroad.com\/google-bilgi-bankasi\/crawling-december-http-caching\/","title":{"rendered":"Dekabr ay\u0131 \u00fczr\u0259 krol: HTTP ke\u015fl\u0259m\u0259"},"content":{"rendered":"<p class=\"gargardate\">9 dekabr 2024-c\u00fc il, Bazar ert\u0259si<\/p>\n<p>\nZ\u0259hm\u0259t olmasa, ke\u015fl\u0259m\u0259y\u0259 icaz\u0259 verin.\n<\/p>\n<p>\n  \u0130nternet ill\u0259r \u0259rzind\u0259 b\u00f6y\u00fcd\u00fckc\u0259, Google-un indeksl\u0259m\u0259 (crawl) h\u0259cmi d\u0259 artd\u0131. Google-un indeksl\u0259m\u0259 infrastrukturu evristik ke\u015fl\u0259m\u0259 mexanizml\u0259rini d\u0259st\u0259kl\u0259s\u0259 d\u0259 v\u0259 \u0259slind\u0259 h\u0259mi\u015f\u0259 d\u0259st\u0259kl\u0259mi\u015f olsa da, yerli ke\u015fl\u0259rd\u0259n geri qaytar\u0131la bil\u0259n sor\u011fular\u0131n say\u0131 azal\u0131b: 10 il \u0259vv\u0259l \u00fcmumi sor\u011fular\u0131n t\u0259xmin\u0259n 0,026%-i ke\u015fl\u0259n\u0259 bil\u0259n idi ki, bu da el\u0259 d\u0259 t\u0259sirli r\u0259q\u0259m deyil; bu g\u00fcn is\u0259 bu r\u0259q\u0259m 0,017%-dir.\n<\/p>\n<h2 id=\"why-is-caching-important\" tabindex=\"-1\">Ke\u015fl\u0259m\u0259 niy\u0259 vacibdir?<\/h2>\n<p>\n  Ke\u015fl\u0259m\u0259 internet adl\u0131 b\u00f6y\u00fck tapmacan\u0131n kritik bir hiss\u0259sidir. Ke\u015fl\u0259m\u0259 s\u0259hif\u0259l\u0259rin t\u0259krar ziyar\u0259t zaman\u0131 ild\u0131r\u0131m s\u00fcr\u0259ti il\u0259 y\u00fckl\u0259nm\u0259sin\u0259 imkan verir, hesablama resurslar\u0131na v\u0259 bununla da t\u0259bii resurslara q\u0259na\u0259t edir, h\u0259m\u00e7inin h\u0259m m\u00fc\u015ft\u0259ril\u0259r, h\u0259m d\u0259 serverl\u0259r \u00fc\u00e7\u00fcn k\u00fclli miqdarda bahal\u0131 bant geni\u015fliyin\u0259 (bandwidth) q\u0259na\u0259t edir.\n<\/p>\n<p>\n  X\u00fcsusil\u0259, f\u0259rdi URL-l\u0259r alt\u0131nda nadir hallarda d\u0259yi\u015f\u0259n m\u0259zmuna malik b\u00f6y\u00fck bir sayt\u0131n\u0131z varsa, yerli ke\u015fl\u0259m\u0259y\u0259 icaz\u0259 verm\u0259k sayt\u0131n\u0131z\u0131n daha s\u0259m\u0259r\u0259li indeksl\u0259nm\u0259sin\u0259 k\u00f6m\u0259k ed\u0259 bil\u0259r. Google-un indeksl\u0259m\u0259 infrastrukturu <a href=\"https:\/\/www.rfc-editor.org\/rfc\/rfc9111.html\" class=\"external-link\">HTTP ke\u015fl\u0259m\u0259 standart\u0131<\/a> t\u0259r\u0259find\u0259n m\u00fc\u0259yy\u0259n edildiyi kimi, x\u00fcsusil\u0259 <code>ETag<\/code> cavab v\u0259 <code>If-None-Match<\/code> sor\u011fu ba\u015fl\u0131\u011f\u0131, h\u0259m\u00e7inin <code>Last-Modified<\/code> cavab v\u0259 <code>If-Modified-Since<\/code> sor\u011fu ba\u015fl\u0131\u011f\u0131 vasit\u0259sil\u0259 evristik HTTP ke\u015fl\u0259m\u0259ni d\u0259st\u0259kl\u0259yir.\n<\/p>\n<p>\n  Biz <code>ETag<\/code> istifad\u0259 etm\u0259yi \u015fidd\u0259tl\u0259 t\u00f6vsiy\u0259 edirik, \u00e7\u00fcnki o, s\u0259hvl\u0259r\u0259 daha az meyillidir (d\u0259y\u0259ri <code>Last-Modified<\/code> d\u0259y\u0259rind\u0259n f\u0259rqli olaraq strukturla\u015fd\u0131r\u0131lmay\u0131b). V\u0259 \u0259g\u0259r imkan\u0131n\u0131z varsa, h\u0259r ikisini qurun: internet siz\u0259 t\u0259\u015f\u0259kk\u00fcr ed\u0259c\u0259k. B\u0259lk\u0259 d\u0259.\n<\/p>\n<p>\n  M\u00fc\u015ft\u0259ril\u0259rin ke\u015fl\u0259rini yenil\u0259m\u0259sini t\u0259l\u0259b ed\u0259n bir d\u0259yi\u015fiklik kimi n\u0259yi n\u0259z\u0259rd\u0259 tutma\u011f\u0131n\u0131z siz\u0259 ba\u011fl\u0131d\u0131r. Bizim t\u00f6vsiy\u0259miz budur ki, m\u0259zmununuzda \u0259h\u0259miyy\u0259tli d\u0259yi\u015fiklikl\u0259r olduqda ke\u015f yenil\u0259nm\u0259sini t\u0259l\u0259b ed\u0259siniz; \u0259g\u0259r sad\u0259c\u0259 s\u0259hif\u0259nizin alt\u0131ndak\u0131 m\u00fc\u0259llif h\u00fcququ tarixini yenil\u0259misinizs\u0259, bu, y\u0259qin ki, \u0259h\u0259miyy\u0259tli deyil.\n<\/p>\n<h2 id=\"etag-and-if-none-match\" tabindex=\"-1\"><code>ETag<\/code> v\u0259 <code>If-None-Match<\/code><\/h2>\n<p>\n  Google-un botlar\u0131 <code>ETag<\/code> \u0259sasl\u0131 \u015f\u0259rti sor\u011fular\u0131 tam olaraq <a href=\"https:\/\/www.rfc-editor.org\/rfc\/rfc9111.html\" class=\"external-link\">HTTP ke\u015fl\u0259m\u0259 standart\u0131nda<\/a> m\u00fc\u0259yy\u0259n edildiyi kimi d\u0259st\u0259kl\u0259yir. Y\u0259ni, Google-un botlar\u0131na ke\u015fl\u0259m\u0259 se\u00e7imini bildirm\u0259k \u00fc\u00e7\u00fcn <code>Etag<\/code> d\u0259y\u0259rini daxil olunan URL t\u0259r\u0259find\u0259n yerl\u0259\u015fdiril\u0259n m\u0259zmunun t\u0259sviri \u00fc\u00e7\u00fcn unikal olan ist\u0259nil\u0259n ixtiyari ASCII s\u0259trin\u0259 (ad\u0259t\u0259n m\u0259zmunun he\u015fi v\u0259 ya versiya n\u00f6mr\u0259si, lakin \u03c0-nin bir hiss\u0259si d\u0259 ola bil\u0259r, siz\u0259 qalm\u0131\u015fd\u0131r) t\u0259yin edin. M\u0259s\u0259l\u0259n, eyni m\u0259zmunun f\u0259rqli versiyalar\u0131n\u0131 eyni URL alt\u0131nda yerl\u0259\u015fdirirsinizs\u0259 (m\u0259s\u0259l\u0259n, mobil v\u0259 masa\u00fcst\u00fc versiya), h\u0259r versiyan\u0131n \u00f6z unikal <code>ETag<\/code> d\u0259y\u0259ri ola bil\u0259r.\n<\/p>\n<p>\n  Ke\u015fl\u0259m\u0259ni d\u0259st\u0259kl\u0259y\u0259n Google botlar\u0131, h\u0259min URL-in \u0259vv\u0259lki indeksl\u0259nm\u0259si \u00fc\u00e7\u00fcn qaytar\u0131lan <code>ETag<\/code> d\u0259y\u0259rini <code>If-None-Match<\/code> ba\u015fl\u0131\u011f\u0131nda g\u00f6nd\u0259r\u0259c\u0259k. \u018fg\u0259r bot t\u0259r\u0259find\u0259n g\u00f6nd\u0259ril\u0259n <code>ETag<\/code> d\u0259y\u0259ri serverin yaratd\u0131\u011f\u0131 cari d\u0259y\u0259rl\u0259 uy\u011fun g\u0259lirs\u0259, serveriniz HTTP <code>304<\/code> (D\u0259yi\u015fdirilm\u0259yib) status kodunu he\u00e7 bir HTTP g\u00f6vd\u0259si olmadan qaytarmal\u0131d\u0131r. Bu son hiss\u0259, y\u0259ni HTTP g\u00f6vd\u0259sinin olmamas\u0131, bir ne\u00e7\u0259 s\u0259b\u0259b\u0259 g\u00f6r\u0259 vacibdir:\n<\/p>\n<ul>\n<li>\n    serveriniz m\u0259zmun yaratmaq \u00fc\u00e7\u00fcn hesablama resurslar\u0131 s\u0259rf etm\u0259k m\u0259cburiyy\u0259tind\u0259 qalm\u0131r; y\u0259ni pula q\u0259na\u0259t edirsiniz\n  <\/li>\n<li>\n    serveriniz HTTP g\u00f6vd\u0259sini \u00f6t\u00fcrm\u0259k m\u0259cburiyy\u0259tind\u0259 qalm\u0131r; y\u0259ni pula q\u0259na\u0259t edirsiniz\n  <\/li>\n<\/ul>\n<p>\n  M\u00fc\u015ft\u0259ri t\u0259r\u0259find\u0259, m\u0259s\u0259l\u0259n, istifad\u0259\u00e7inin brauzeri v\u0259 ya Googlebot-da, h\u0259min URL alt\u0131ndak\u0131 m\u0259zmun m\u00fc\u015ft\u0259rinin daxili ke\u015find\u0259n g\u00f6t\u00fcr\u00fcl\u00fcr. He\u00e7 bir m\u0259lumat \u00f6t\u00fcr\u00fclm\u0259si olmad\u0131\u011f\u0131 \u00fc\u00e7\u00fcn bu, ild\u0131r\u0131m s\u00fcr\u0259ti il\u0259 ba\u015f verir, istifad\u0259\u00e7il\u0259ri xo\u015fb\u0259xt edir v\u0259 potensial olaraq onlar \u00fc\u00e7\u00fcn d\u0259 b\u0259zi resurslara q\u0259na\u0259t edir.\n<\/p>\n<h2 id=\"last-modified-and-if-modified-since\" tabindex=\"-1\"><code>Last-Modified<\/code> v\u0259 <code>If-Modified-Since<\/code><\/h2>\n<p>\n  <code>ETag<\/code>-\u0259 b\u0259nz\u0259r \u015f\u0259kild\u0259, Google-un botlar\u0131 <code>Last-Modified<\/code> \u0259sasl\u0131 \u015f\u0259rti sor\u011fular\u0131 da tam olaraq HTTP Ke\u015fl\u0259m\u0259 standart\u0131nda m\u00fc\u0259yy\u0259n edildiyi kimi d\u0259st\u0259kl\u0259yir. Bu, semantik bax\u0131mdan <code>ETag<\/code> il\u0259 eyni \u015f\u0259kild\u0259 i\u015fl\u0259yir &mdash; resursun ke\u015fl\u0259n\u0259 bil\u0259n olub-olmad\u0131\u011f\u0131n\u0131 m\u00fc\u0259yy\u0259n etm\u0259k \u00fc\u00e7\u00fcn bir identifikator istifad\u0259 olunur &mdash; v\u0259 m\u00fc\u015ft\u0259ri t\u0259r\u0259find\u0259 <code>ETag<\/code> il\u0259 eyni faydalar\u0131 t\u0259min edir.\n<\/p>\n<p>\n  \u018fg\u0259r <code>Last-Modified<\/code>-i ke\u015fl\u0259m\u0259 direktivi kimi istifad\u0259 edirsinizs\u0259, bir ne\u00e7\u0259 t\u00f6vsiy\u0259miz var:\n<\/p>\n<ol>\n<li>\n    <code>Last-Modified<\/code> ba\u015fl\u0131\u011f\u0131ndak\u0131 tarix <a href=\"https:\/\/www.rfc-editor.org\/rfc\/rfc9110.html\" class=\"external-link\">HTTP standart\u0131na<\/a> uy\u011fun formatlanmal\u0131d\u0131r. T\u0259hlil probleml\u0259rinin qar\u015f\u0131s\u0131n\u0131 almaq \u00fc\u00e7\u00fcn a\u015fa\u011f\u0131dak\u0131 tarix format\u0131ndan istifad\u0259 etm\u0259yi t\u00f6vsiy\u0259 edirik:<br \/>\n    &#8220;H\u0259ft\u0259 g\u00fcn\u00fc, <span>GG Ay YYYY SS:DD:SN<\/span> Zaman qur\u015fa\u011f\u0131&#8221;. M\u0259s\u0259l\u0259n,<br \/>\n    &#8220;<span>Fri, 4 Sep 1998 19:15:56 GMT<\/span>&#8220;.\n  <\/li>\n<li>\n    M\u0259cburi olmasa da, botlar\u0131n konkret URL-i n\u0259 vaxt yenid\u0259n indeksl\u0259y\u0259c\u0259yini m\u00fc\u0259yy\u0259n etm\u0259sin\u0259 k\u00f6m\u0259k etm\u0259k \u00fc\u00e7\u00fcn <code>Cache-Control<\/code> ba\u015fl\u0131\u011f\u0131n\u0131n <code>max-age<\/code> sah\u0259sini d\u0259 t\u0259yin etm\u0259yi d\u00fc\u015f\u00fcn\u00fcn. <code>max-age<\/code> sah\u0259sinin d\u0259y\u0259rini m\u0259zmunun d\u0259yi\u015fm\u0259z qalaca\u011f\u0131 g\u00f6zl\u0259nil\u0259n saniy\u0259 say\u0131 il\u0259 t\u0259yin edin. M\u0259s\u0259l\u0259n, <code>Cache-Control: max-age=94043<\/code>.\n  <\/li>\n<\/ol>\n<h2 id=\"examples\" tabindex=\"-1\">N\u00fcmun\u0259l\u0259r<\/h2>\n<p>\n  \u018fg\u0259r m\u0259nim kimi d\u00fc\u015f\u00fcn\u00fcrs\u00fcn\u00fczs\u0259, evristik ke\u015fl\u0259m\u0259nin nec\u0259 i\u015fl\u0259diyini anlamaq \u00e7\u0259tindir, lakin sor\u011fu v\u0259 cavab z\u0259ncirinin n\u00fcmun\u0259sini g\u00f6st\u0259rm\u0259k m\u0259n\u0259 k\u00f6m\u0259k edir. Budur iki z\u0259ncir &mdash; biri <code>ETag<\/code>\/<code>If-None-Match<\/code>, dig\u0259ri is\u0259 <code>Last-Modified<\/code>\/<code>If-Modified-Since<\/code> \u00fc\u00e7\u00fcn &mdash; nec\u0259 i\u015fl\u0259m\u0259li oldu\u011funu vizualla\u015fd\u0131rmaq \u00fc\u00e7\u00fcn:\n<\/p>\n<table class=\"fixed vertical-rules full-width\">\n<tr>\n<th width=\"33%\"><\/th>\n<th><code>ETag<\/code>\/<code>If-None-Match<\/code><\/th>\n<th><code>Last-Modified<\/code>\/<code>If-Modified-Since<\/code><\/th>\n<\/tr>\n<tr>\n<td>\n      <strong>Serverin indeksl\u0259m\u0259 sor\u011fusuna cavab\u0131:<\/strong> Bu, botun <code>ETag<\/code> v\u0259 <code>Last-Modified<\/code> ilkin \u015f\u0259rt ba\u015fl\u0131\u011f\u0131 sah\u0259l\u0259rini saxlaya bil\u0259c\u0259yi cavabd\u0131r.\n    <\/td>\n<td>\n<div><\/div>\n<\/td>\n<td>\n<div><\/div>\n<\/td>\n<\/tr>\n<tr>\n<td>\n      <strong>Botun sonrak\u0131 \u015f\u0259rti sor\u011fusu:<\/strong> \u015e\u0259rti sor\u011fu \u0259vv\u0259lki sor\u011fudan saxlan\u0131lan ilkin \u015f\u0259rt ba\u015fl\u0131\u011f\u0131 d\u0259y\u0259rl\u0259rin\u0259 \u0259saslan\u0131r. D\u0259y\u0259rl\u0259r yoxlama \u00fc\u00e7\u00fcn <code>If-None-Match<\/code> v\u0259 <code>If-Modified-Since<\/code> sor\u011fu ba\u015fl\u0131qlar\u0131nda server\u0259 geri g\u00f6nd\u0259rilir.\n    <\/td>\n<td>\n<div><\/div>\n<\/td>\n<td>\n<div><\/div>\n<\/td>\n<\/tr>\n<tr>\n<td>\n      <strong>Serverin \u015f\u0259rti sor\u011fuya cavab\u0131:<\/strong> Bot t\u0259r\u0259find\u0259n g\u00f6nd\u0259ril\u0259n ilkin \u015f\u0259rt ba\u015fl\u0131\u011f\u0131 d\u0259y\u0259rl\u0259ri server t\u0259r\u0259find\u0259 yoxlan\u0131ld\u0131\u011f\u0131 \u00fc\u00e7\u00fcn server bota <code>304<\/code> HTTP status kodu (HTTP g\u00f6vd\u0259si olmadan) qaytar\u0131r. Bu, ilkin \u015f\u0259rtl\u0259r yoxlan\u0131lana q\u0259d\u0259r (server t\u0259r\u0259find\u0259 <code>ETag<\/code> v\u0259 ya <code>Last-Modified<\/code> tarixi d\u0259yi\u015f\u0259n\u0259 q\u0259d\u0259r) h\u0259r sonrak\u0131 sor\u011fuda ba\u015f ver\u0259c\u0259k.\n    <\/td>\n<td>\n<div><\/div>\n<\/td>\n<td>\n<div><\/div>\n<\/td>\n<\/tr>\n<\/table>\n<p>\n  \u018fg\u0259r istifad\u0259\u00e7il\u0259rinizi xo\u015fb\u0259xt etm\u0259k ist\u0259yirsinizs\u0259 v\u0259 b\u0259lk\u0259 d\u0259 hostinq x\u0259rcl\u0259riniz\u0259 bir az q\u0259na\u0259t etm\u0259k ist\u0259yirsinizs\u0259, hostinq v\u0259 ya CMS provayderinizl\u0259 v\u0259 ya t\u0259rtibat\u00e7\u0131lar\u0131n\u0131zla sayt\u0131n\u0131z \u00fc\u00e7\u00fcn HTTP ke\u015fl\u0259m\u0259ni nec\u0259 aktivl\u0259\u015fdirm\u0259k bar\u0259d\u0259 dan\u0131\u015f\u0131n. He\u00e7 olmasa, istifad\u0259\u00e7il\u0259riniz sizi bir az daha \u00e7ox sev\u0259c\u0259k.\n<\/p>\n<p>\n  Ke\u015fl\u0259m\u0259 haqq\u0131nda s\u00f6hb\u0259t etm\u0259k ist\u0259yirsinizs\u0259, \u0259n yax\u0131n <a href=\"https:\/\/goo.gle\/sc-forum\" class=\"external-link\">Search Central yard\u0131m icmas\u0131na<\/a> ba\u015f \u00e7\u0259kin v\u0259 \u0259g\u0259r ke\u015fl\u0259m\u0259 il\u0259 ba\u011fl\u0131 \u015f\u0259rhl\u0259riniz varsa, bu bloq yaz\u0131s\u0131 il\u0259 birlikd\u0259 d\u0259rc etdiyimiz <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/google-crawlers\/#http-caching\">ke\u015fl\u0259m\u0259 haqq\u0131nda s\u0259n\u0259dl\u0259r\u0259<\/a> r\u0259y bildirin.\n<\/p>\n<p class=\"byline-author\">\n  M\u00fc\u0259llif: <a href=\"https:\/\/developers.google.com\/search\/blog\/authors\/gary-illyes\">Gary Illyes<\/a>\n<\/p>\n<hr class=\"full-width\">\n<h2 id=\"want-to-learn-more-about-crawling-check-out-the-entire-crawling-december-series:\" tabindex=\"-1\">\u0130ndeksl\u0259m\u0259 haqq\u0131nda daha \u00e7ox \u00f6yr\u0259nm\u0259k ist\u0259yirsiniz? B\u00fct\u00fcn &#8220;Crawling December&#8221; silsil\u0259sin\u0259 n\u0259z\u0259r sal\u0131n:<\/h2>\n","protected":false},"excerpt":{"rendered":"<p>9 dekabr 2024-c\u00fc il, Bazar ert\u0259si Z\u0259hm\u0259t olmasa, ke\u015fl\u0259m\u0259y\u0259 icaz\u0259 verin. \u0130nternet ill\u0259r \u0259rzind\u0259 b\u00f6y\u00fcd\u00fckc\u0259, Google-un indeksl\u0259m\u0259 (crawl) h\u0259cmi d\u0259 artd\u0131. Google-un indeksl\u0259m\u0259 infrastrukturu evristik ke\u015fl\u0259m\u0259 mexanizml\u0259rini d\u0259st\u0259kl\u0259s\u0259 d\u0259 v\u0259 \u0259slind\u0259 h\u0259mi\u015f\u0259 d\u0259st\u0259kl\u0259mi\u015f olsa da, yerli ke\u015fl\u0259rd\u0259n geri qaytar\u0131la bil\u0259n sor\u011fular\u0131n say\u0131 azal\u0131b: 10 il \u0259vv\u0259l \u00fcmumi sor\u011fular\u0131n t\u0259xmin\u0259n 0,026%-i ke\u015fl\u0259n\u0259 bil\u0259n idi ki, bu [&hellip;]<\/p>\n","protected":false},"menu_order":79934,"template":"","meta":{"footnotes":""},"ar_kb_kategori":[665],"ar_kb_etiket":[],"class_list":["post-25331","ar_kb","type-ar_kb","status-publish","has-post-thumbnail","hentry","ar_kb_kategori-blog"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25331","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_kb"}],"version-history":[{"count":0,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25331\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/27451"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=25331"}],"wp:term":[{"taxonomy":"ar_kb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_kategori?post=25331"},{"taxonomy":"ar_kb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_etiket?post=25331"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}