When Google visits your website, it’s not browsing — it’s reading. Understanding what it reads (and what it ignores) explains a lot about why some sites are invisible to Google despite looking perfectly normal to humans.
What is Googlebot?
Googlebot is Google’s web crawler — an automated program that visits websites, reads their content, and sends the information back to Google’s servers. Google uses this information to decide whether to index a page and how to rank it.
Googlebot visits pages by following links. It starts from a list of known URLs and follows every link it finds to discover new pages.
What does Googlebot actually read?
Googlebot reads text. It reads HTML — the underlying code of a web page — not the visual design. Specifically, it pays attention to:
- The title tag — the text in the browser tab and the clickable headline in search results
- Headings (H1, H2, H3) — the structure and main topics of the page
- Body text — the actual written content
- Links — both where they point and what text is used for them
- Meta description — the short text shown under a result in Google
- Image alt text — the written description of images
What does Googlebot struggle with?
| Content type | How well Google reads it |
|---|---|
| Plain HTML text | Very well |
| Text in images | Poorly — images are not readable as text |
| JavaScript-rendered content | Partially — Google can process some JS but often misses content loaded dynamically |
| Content behind a login | Not at all |
| PDFs | Reasonably well, but not as well as HTML |
This is why a website built entirely as images, or one that loads its main content through JavaScript, can be nearly invisible to Google even if it looks fine in a browser.
How does Googlebot decide how often to visit?
Google visits popular, frequently updated sites more often than small, rarely changed ones. A site with new content published regularly will be crawled more frequently — meaning new pages get indexed faster.
For a brand new site with no external links pointing to it, Google may not find it at all unless the owner submits it via Google Search Console.
Does Googlebot see your site the same way on mobile and desktop?
No. Google now primarily uses mobile-first indexing — it uses the mobile version of your page as the basis for indexing and ranking. If your mobile site is missing content that appears on desktop, Google may not index that content.
→ Back to the full picture: Why your website doesn’t show up on Google
→ Related: What does it mean for your website to be indexed?
GhostSite checks whether Google can read your site properly — including technical issues that prevent Googlebot from accessing your content.