Google's Martin Splitt and John Mueller fair posted a Search Off the Record podcast on the topic of PDFs, it is named PDFs in Search: Indexing, AI & Pitfalls. It goes complete how PDFs are converted for crawling and indexing, how Google processes links, images, what are the document limits and do they position in hunt and AI search.
The podcast is damaged into these chapters:
- 00:50 – Can you preserve an LLMs.txt document as a PDF?
- 01:56 – Plain content vs. Binary container: What makes PDFs distinct from HTML?
- 03:08 – Inside Google's converter pipeline: Turning PDFs into HTML for indexing.
- 05:08 – Extracting images and links from PDF files.
- 06:04 – Crawling limits, document sizes, and evaluation cut-off thresholds.
- 08:35 – When does it create awareness to publish a PDF?
- 09:33 – Do PDFs position in Search, AI Overviews, and AI mode?
- 11:22 – Technical pitfalls: Rasterized pages, scanned images, and accessibility.
- 12:53 – Mobile association delays, layout locking, and zoom issues.
- 14:12 – Canonicalization challenges alongside copy "binary blobs".
- 15:57 – Metadata, password protection, and updating PDF files.
- 18:59 – The issue alongside energetic CMS PDF generation.
- 21:08 – The eatery list debate: PDF vs. HTML web pages.
- 23:00 – PDFs for GEO (Generative Engine Optimization) & AI grounding.
Truth is, we covered most of this stuff, perchance exterior of the GEO/AI hunt aspect, which Google didn't say much about.
Here is our old safety of what Google stated on PDFs, I am certain I am missing stuff:
- Google Converts PDFs To HTML For Indexing In Search
- Google: You Can Publish Both PDF & HTML Formats
- Duplicate Content Between HTML & PDF Pages? Google Should Figure It Out
- Google: Don't Worry About Duplicate Content With PDFs & Web Pages
- Google: No Problem Having Downloadable PDFs That Match Your Web Content
- Google Indexes PDF Documents But Refreshes Them Slowly
- Google: Links Within PDF Documents Pass PageRank
- Googlebot File Limit Is 15MB But 64MB For PDF & 2MB For Other File Types
- Did Google Just Say Links In PDFs Treated As Nofollow Links?
- Google: PDFs Are Not Mobile Friendly
Here is how I'd sum it up following listening to it twice and study the transcript:
How Google Processes and Ranks PDFs:
- HTML Conversion: PDFs are binary receptacle records fairly than plain text. During the indexing pipeline, Google uses a converter component to rotate PDFs into an HTML representation, allowing inner hunt systems to grip them akin regular web pages.
- Links and Embedded Media: Because PDFs are converted to HTML, embedded content links are preserved and crawled normally. However, images embedded in PDFs deficiency standalone URLs, so they mostly cannot be processed into Google Image Search the identical way as norm web images.
- Search and AI Visibility: Converted PDFs position and indicator using the identical essential systems as norm HTML documents. They can appear in AI Overviews and are accessible to AI models for training and grounding.
- Crawl Size Limits: The crawling bounds for PDFs is larger than the bounds for norm HTML pages. Google deliberately does not document an exact cutoff since crawl thresholds are adjusted complete period as document size norms evolve. Although, Google does document that.
Technical Pitfalls and UX Challenges:
- Rasterized and Scanned Documents: If a PDF is composed of scanned images or rasterized pages fairly than text, hunt engines cannot peruse the satisfied without OCR. Site owners can test this by highlighting, copying, and pasting content from the PDF into a content editor.
- Mobile and Accessibility Issues: PDFs must download entirely before rendering on mobile devices and have fixed imprint layouts that do not reflow content whenever zoomed. They can additionally current barriers for display readers if not organized accessibly.
- Canonicalization and Duplication: Because identical PDFs are exact binary duplicates, cross-domain canonicalization is difficult. Publishers can mitigate copy satisfied issues by using rel=canonical HTTP headers, populating PDF metadata fields, and placing notable links rear to their website in the document header.
- Access Restrictions: Password safety blocks hunt motor bots from study or indexing PDF content.
Crawl Frequency and Updates:
- Slower Recrawl Rates: Google treats PDFs as comparatively fixed binary records (similar to images) and recrawls them much small frequently than HTML.
- Changing File Names for Updates: Because recrawls obtain longer, publishers needing to indicator an updated PDF quickly should publish it under a new URL or document name fairly than overwriting the existing file.
- Avoiding Auto-Generated "Print" PDFs: Automated CMS tools that create PDF duplicates of live web pages can logic the two versions to vie in hunt results, leaving the PDF type outdated since it is recrawled small often.
SEO Recommendations:
- Default to HTML: HTML is easier to edit, receptive on mobile screens, and faster to index.
- Use PDFs Selectively: PDFs are suitable whenever satisfied requires rigid imprint formatting, downloadable offline forms, or document documentation. For small businesses akin restaurants, a PDF list is satisfactory if creating an HTML equal is impractical.
- Keep llms.txt Plain Text: Files intended for device use (like llms.txt) should never be formatted as PDFs, as the complete intent of the format is to provision simple, lightweight plain text.
Forum conversation at X.
