In 2018, John Mueller of Google mentioned Google doesn’t use cache-control headers when crawling. He mentioned then that the has no affect on GoogleBot and the way it crawls your internet pages. He mentioned that once more as we speak, on the finish of 2022, however added, “at most, they may be utilized in rendering for embedded content material.”
John wrote on Mastodon, “Cache management headers do not apply to Google’s crawling & indexing, they’re for browsers.” However then he added that “at most, they may be utilized in rendering for embedded content material.”
The Cache-Management HTTP header discipline holds directives, in each requests and responses, that management caching in browsers and shared caches (e.g. Proxies, CDNs). It’s an HTTP header used to specify browser caching insurance policies in each consumer requests and server responses.
Discussion board dialogue at Mastodon.
