{"id":25236,"date":"2022-06-28T00:00:00","date_gmt":"2022-06-28T00:00:00","guid":{"rendered":"https:\/\/alienroad.com\/google-bilgi-bankasi\/googlebot-and-the-15-mb-thing\/"},"modified":"2022-06-28T00:00:00","modified_gmt":"2022-06-28T00:00:00","slug":"googlebot-and-the-15-mb-thing","status":"publish","type":"ar_kb","link":"https:\/\/alienroad.com\/google-bilgi-bankasi\/googlebot-and-the-15-mb-thing\/","title":{"rendered":"Googlebot and the 15 MB thing"},"content":{"rendered":"<p class=\"gargardate\">Tuesday, June 28, 2022<\/p>\n<p>\n  Over the last few days we&#8217;ve received a great deal of questions about a recent update to<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/googlebot\/\">our documentation about Googlebot<\/a>.<br \/>\n  Namely, we&#8217;ve documented that Googlebot only ever &#8220;sees&#8221; the first 15<br \/>\n  <a href=\"https:\/\/en.wikipedia.org\/wiki\/Megabyte#-_-\" class=\"external-link\">megabytes<\/a> (MB)<br \/>\n  when fetching<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/file-types-indexed\/\">certain file types<\/a>.<br \/>\n  This threshold is not new; it&#8217;s been around for many years. We just added it to our documentation<br \/>\n  because it might be helpful for some folks when debugging, and because it rarely ever changes.\n<\/p>\n<p>\n  This limit only applies to the<br \/>\n  <a href=\"https:\/\/en.wikipedia.org\/wiki\/Byte#;)\" class=\"external-link\">bytes<\/a> (content)<br \/>\n  received for the initial request Googlebot makes, not the referenced resources within the page.\n<\/p>\n<aside class=\"note\">\n  <b>March 16, 2023<\/b>: To further clarify, each individual subresource fetch (in particular CSS<br \/>\n  and JavaScript) is bound to the 15MB limit.<br \/>\n<\/aside>\n<p>\n  For example, when you open <code>https:\/\/example.com\/puppies.html<\/code>, your browser will<br \/>\n  initially download the bytes of the HTML file, and based on those bytes it might make further<br \/>\n  requests for external JavaScript, images, or whatever else is referenced with a URL in the HTML.<br \/>\n  Googlebot does the same thing.\n<\/p>\n<p>\n  <strong>What does this 15 MB limit mean to me?<\/strong><br \/>\n  Most likely nothing. There are<br \/>\n  <a href=\"https:\/\/twitter.com\/paulcalvano\/status\/1541402096897069056\" class=\"external-link\">very few pages<\/a><br \/>\n  on the internet that are bigger in size. You, dear reader, are unlikely to be the owner of one,<br \/>\n  since the<br \/>\n  <a href=\"https:\/\/httparchive.org\/reports\/page-weight#bytesHtml\" class=\"external-link\">median size of a HTML file is about 500 times smaller<\/a>:<br \/>\n  30 <a href=\"https:\/\/en.m.wikipedia.org\/wiki\/Kilobyte\" class=\"external-link\">kilobytes (kB)<\/a>.<br \/>\n  However, if you are the owner of an HTML page that&#8217;s over 15 MB, perhaps you could at least move<br \/>\n  some inline scripts and CSS dust to external files, pretty please.\n<\/p>\n<p>\n  <strong>What happens to the content after 15 MB?<\/strong><br \/>\n  The content after the first 15 MB is dropped by Googlebot, and only the first 15 MB gets forwarded<br \/>\n  to indexing.\n<\/p>\n<p>\n  <strong>What content types does the 15 MB limit apply to?<\/strong><br \/>\n  The 15 MB limit applies to fetches made by Googlebot (Googlebot Smartphone and Googlebot Desktop)<br \/>\n  when fetching<br \/>\n  <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/file-types-indexed\/\">file types supported by Google Search<\/a>.\n<\/p>\n<p>\n  <strong>Does this mean Googlebot doesn&#8217;t see my image or video?<\/strong><br \/>\n  No. Googlebot fetches videos and images that are referenced in the HTML with a URL (for example,<br \/>\n  <code>&lt;img src=\"https:\/\/example.com\/images\/puppy.jpg\" alt=\"cute puppy looking very disappointed\" \/><\/code><br \/>\n  separately with consecutive fetches.\n<\/p>\n<p>\n  <strong>Do data URIs add to the HTML file size?<\/strong><br \/>\n  Yes. Using<br \/>\n  <a href=\"https:\/\/en.wikipedia.org\/wiki\/Data_URI_scheme\" class=\"external-link\"><span>data URIs<\/span><\/a><br \/>\n  will contribute to the HTML file size since they are in the HTML file.\n<\/p>\n<p>\n  <strong>How can I look up the size of a page?<\/strong><br \/>\n  There are a number of ways, but the easiest is probably using your own browser and its Developer<br \/>\n  Tools. Load the page as you normally would, then launch the Developer Tools and switch to the<br \/>\n  Network tab. Reload the page, and you should see all the requests your browser had to make to<br \/>\n  render the page. The top request is what you&#8217;re looking for, with the byte size of the page in<br \/>\n  the Size column.\n<\/p>\n<p>\n  For example, in the<br \/>\n  <a href=\"https:\/\/developer.chrome.com\/docs\/devtools\" class=\"external-link\">Chrome Developer Tools<\/a><br \/>\n  might look something like this, with 150 kB in the size column:\n<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/alienroad.com\/wp-content\/uploads\/kb-gorsel\/g-481504e6f725.png\" loading=\"lazy\" alt=\"The Network tab in Chrome Developer Tools\"><\/p>\n<p>\n  If you&#8217;re more adventurous, you can use <a href=\"https:\/\/curl.se\/\" class=\"external-link\">cURL<\/a><br \/>\n  from a command line:\n<\/p>\n<div><\/div>\n<p>\n  If you have more questions, you can find us on<br \/>\n  <a href=\"https:\/\/twitter.com\/googlesearchc\" class=\"external-link\">Twitter<\/a><br \/>\n  and in the<br \/>\n  <a href=\"https:\/\/support.google.com\/webmasters\/community\" class=\"external-link\">Search Central Forums<\/a>,<br \/>\n  and if you need more clarification about our documentation, leave us feedback on the pages<br \/>\n  themselves.\n<\/p>\n<p class=\"byline-author\">Posted by <a href=\"https:\/\/garyillyes.com\/+\" class=\"external-link\">Gary Illyes<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Tuesday, June 28, 2022 Over the last few days we&#8217;ve received a great deal of questions about a recent update to our documentation about Googlebot. Namely, we&#8217;ve documented that Googlebot only ever &#8220;sees&#8221; the first 15 megabytes (MB) when fetching certain file types. This threshold is not new; it&#8217;s been around for many years. We [&hellip;]<\/p>\n","protected":false},"menu_order":80829,"template":"","meta":{"footnotes":""},"ar_kb_kategori":[665],"ar_kb_etiket":[],"class_list":["post-25236","ar_kb","type-ar_kb","status-publish","has-post-thumbnail","hentry","ar_kb_kategori-blog"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25236","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_kb"}],"version-history":[{"count":0,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25236\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/27357"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=25236"}],"wp:term":[{"taxonomy":"ar_kb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_kategori?post=25236"},{"taxonomy":"ar_kb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_etiket?post=25236"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}