{"id":25674,"date":"2026-09-06T00:47:46","date_gmt":"2026-09-05T21:47:46","guid":{"rendered":"https:\/\/alienroad.com\/google-bilgi-bankasi\/debug-network-and-dns-errors-for-googles-crawlers\/"},"modified":"2026-09-06T00:50:36","modified_gmt":"2026-09-05T21:50:36","slug":"debug-network-and-dns-errors-for-googles-crawlers","status":"publish","type":"ar_kb","link":"https:\/\/alienroad.com\/google-bilgi-bankasi\/debug-network-and-dns-errors-for-googles-crawlers\/","title":{"rendered":"Debug network and DNS errors for Google&#8217;s crawlers"},"content":{"rendered":"<p>\n  Network and DNS errors have quick, negative effects on whether Google is able to successfully<br \/>\n  crawl a URL. Google treats network timeouts, connection reset, and DNS errors similarly to<br \/>\n  <code>5xx<\/code> server errors. In case of network errors, crawling immediately starts<br \/>\n  slowing down, as a network error is a sign that the server may not be able to handle the<br \/>\n  serving load. Since Google couldn&#8217;t reach the server hosting the site, Google also hasn&#8217;t<br \/>\n  received any content from the server.\n<\/p>\n<p>\n  For Google Search, the lack of content means that Google can&#8217;t index the crawled URLs, and<br \/>\n  already indexed URLs that are unreachable will be removed from Google&#8217;s index within days.<br \/>\n  Search Console may generate errors for each respective error.\n<\/p>\n<aside class=\"note\">\n  If you&#8217;re not hosting your website yourself, ask your hosting or CDN provider for help.<br \/>\n<\/aside>\n<h2 id=\"debug-network-errors\" tabindex=\"-1\">Debug network errors<\/h2>\n<p>\n  These errors happen before Google starts crawling a URL or while Google is crawling the URL.<br \/>\n  Since the errors may occur before the server can respond and so there&#8217;s no status code that<br \/>\n  can hint at issues, diagnosing these errors can be more challenging. To debug timeout and<br \/>\n  connection reset errors:\n<\/p>\n<ul>\n<li>\n    <b>Look at your firewall settings and logs<\/b>. There may be an overly-broad<br \/>\n    blocking rule set. Make sure that<br \/>\n    <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/verify-requests-from-google-crawlers-and-fetchers\/#use-automatic-solutions\">Google IP addresses<\/a><br \/>\n    are not blocked by any firewall rule.\n  <\/li>\n<li>\n    <b>Look at the network traffic<\/b>. Use tools like<br \/>\n    <a href=\"https:\/\/www.tcpdump.org\/manpages\/tcpdump.1.html\" class=\"external-link\">tcpdump<\/a> and<br \/>\n    <a href=\"https:\/\/www.wireshark.org\/\" class=\"external-link\">Wireshark<\/a> to capture and analyze<br \/>\n    TCP packets, and look for anomalies that point to a specific network component or server<br \/>\n    module.\n  <\/li>\n<li>\n    <b>If you can&#8217;t find anything suspicious, contact your hosting company<\/b>.\n  <\/li>\n<\/ul>\n<p>\n  The error may be in any server component that handles network traffic. For example, overloaded<br \/>\n  network interfaces may drop packets leading to timeouts (inability to establish a connection)<br \/>\n  and reset connections (<code>RST<\/code> packet sent because a port was mistakenly closed).\n<\/p>\n<h2 id=\"debug-dns-errors\" tabindex=\"-1\">Debug DNS errors<\/h2>\n<p>\n  DNS errors are most commonly caused by misconfiguration, but they may be also caused by a<br \/>\n  firewall rule that&#8217;s blocking Google DNS queries. To debug DNS errors, do the following:\n<\/p>\n<ul>\n<li>\n    <b>Inspect your firewall rules<\/b>. Make sure that<br \/>\n    <a href=\"https:\/\/alienroad.com\/google-bilgi-bankasi\/verify-requests-from-google-crawlers-and-fetchers\/#use-automatic-solutions\">none of Google&#8217;s IPs<\/a><br \/>\n    are blocked by any firewall rule, and that both <code>UDP<\/code> and <code>TCP<\/code><br \/>\n    requests are allowed.\n  <\/li>\n<li>\n    <b>Look at your DNS records<\/b>. Double check that your <code>A<\/code> and<br \/>\n    <code>CNAME<\/code> records are pointing to the right IP addresses and hostname,<br \/>\n    respectively. For example:<\/p>\n<div><\/div>\n<div><\/div>\n<\/li>\n<li>\n    <b>Check that all your name servers are pointing to the correct IP addresses of your<br \/>\n      site<\/b>. For example:<\/p>\n<div><\/div>\n<\/li>\n<li>\n    <b>If you&#8217;ve made changes to your DNS configuration within the last 72 hours<\/b>,<br \/>\n    you may need to wait for your changes to propagate across the global DNS network. To speed up propagation, you can<br \/>\n      <a href=\"https:\/\/developers.google.com\/speed\/public-dns\/faq#update_cache\" class=\"external-link\">flush Google&#8217;s Public DNS cache<\/a>.\n  <\/li>\n<li>\n    <b>If you&#8217;re running your own DNS server<\/b>, make sure it&#8217;s healthy and that it&#8217;s<br \/>\n    not overloaded.\n  <\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>See how different network and DNS errors can affect Google&#8217;s crawlers and how to debug network and DNS errors.<\/p>\n","protected":false},"menu_order":7000,"template":"","meta":{"footnotes":""},"ar_kb_kategori":[708],"ar_kb_etiket":[],"class_list":["post-25674","ar_kb","type-ar_kb","status-publish","has-post-thumbnail","hentry","ar_kb_kategori-crawling-infrastructure-crawling-and-indexing"],"_links":{"self":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25674","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb"}],"about":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/types\/ar_kb"}],"version-history":[{"count":1,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25674\/revisions"}],"predecessor-version":[{"id":25713,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb\/25674\/revisions\/25713"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media\/27669"}],"wp:attachment":[{"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/media?parent=25674"}],"wp:term":[{"taxonomy":"ar_kb_kategori","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_kategori?post=25674"},{"taxonomy":"ar_kb_etiket","embeddable":true,"href":"https:\/\/alienroad.com\/wp-json\/wp\/v2\/ar_kb_etiket?post=25674"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}