Definition
A search engine cache is a stored snapshot of a web page that a search engine’s crawler retrieves and saves at the time of indexing. The cached version is served to users when the original page is unavailable, has changed, or when the user requests a view of the page as it existed at the time of crawling.
Overview
Search engines such as Google, Bing, and Yahoo periodically crawl the World Wide Web to discover and index new or updated content. During this process, the crawler may retain a copy of the page’s HTML, images, and other resources in a data repository known as the cache. Cached pages enable several functions:
- Access to content when the live site is down, blocked, or removed.
- Reference to earlier versions of a page for research, fact‑checking, or archival purposes.
- Performance enhancement, allowing the search engine to quickly display a preview of the page while loading the live version.
Users typically access cached pages via a link labeled “Cached” in search engine results pages (SERPs). The cached view often includes a timestamp indicating when the snapshot was taken and may offer a “View source” or “View full page” option.
Etymology/Origin
The term combines “search engine,” referring to software systems that retrieve information from the Internet based on user queries, and “cache,” which originates from the French word cacher (“to hide”) and entered English through computing terminology to denote a temporary storage area for faster data retrieval. The phrase “search engine cache” emerged in the early 2000s as major search engines began providing cached page links alongside search results.
Characteristics
| Feature | Description |
|---|---|
| Temporal snapshot | Represents the page as it appeared at the time of the last crawl; does not update in real time. |
| Storage format | Usually stored as raw HTML and associated resources; some engines strip scripts or dynamic elements for security. |
| Availability | May be limited by robots.txt directives, meta tags (e.g., noarchive), or legal requests to remove cached copies. |
| Size limit | Search engines impose size thresholds; extremely large pages may be partially cached or excluded. |
| Security considerations | Cached pages are publicly accessible; confidential or sensitive information inadvertently cached can pose privacy risks. |
| Refresh frequency | Determined by the search engine’s crawling schedule, which varies based on site popularity, update frequency, and crawl budget. |
| User interface | Typically accessed via a “Cached” hyperlink; some engines display a banner indicating the cache date and a link to the live page. |
Related Topics
- Web crawling – The automated process by which search engines discover and retrieve web content.
- Indexing (search engines) – The organization of retrieved data to facilitate fast query responses.
- Robots exclusion protocol (robots.txt) – A standard for informing crawlers which parts of a site may be accessed or cached.
- Meta robots tag – HTML directives (e.g., noarchive) that control caching behavior on a per‑page basis.
- Wayback Machine – A digital archive of web pages maintained by the Internet Archive, offering historical snapshots similar to but independent of search engine caches.
- Content delivery network (CDN) cache – A distributed network that stores copies of web resources to improve load times for end users, distinct from search engine caching.
Note: The information presented reflects commonly documented practices and specifications of major search engines as of the latest publicly available sources.