Google updated their Googlebot Developers Support Page to reflect that Google is now able to try downloading pages via the latest HTTP/2 protocol. This is effective November 2020. The Googlebot ...

Make sure you are prepared for the new GoogleBot user agent, which launches this December. Google announced that starting in December Google will update Google’s user agent to represent the version of ...

Googlebot, the giant webcrawler that Google uses to scan webpages and update its index, is ditching its iPhone disguise to become an Android. Rather ironically, the tool has been masquerading as an ...

You can't block Googlebot from crawling specific sections of an HTML page. Using the data-nosnippet HTML attribute or an iframe can control how content appears in search snippets. A disallow rule in ...

Tucked away in the Settings section of Google Search Console is a report few SEO professionals discuss, but I like to monitor. These reports are known as Crawl Stats. Here, you’ll find an interesting ...

Google announced that starting in November 2020 it may begin to crawl some sites over HTTP/2. Google wrote "today we're announcing that starting mid November 2020, Googlebot will support crawling over ...

Google announced it is changing the user agent name of the current GoogleBot in December. We knew this was coming when Google launched the new Evergreen GoogleBot. Google didn't change the user agent ...

According to new research released today by Incapsula, a web security firm, millions of these “evil twins” are used for distributed denial-of-service (DDoS) attacks, hacking, spam, content theft and ...

Matthew Hughes is a freelance writer and software developer from Liverpool, England. When he's not hunting down bugs and typos, he's planning his upcoming wedding. He likes cooking, Apple computers ...