Technical SEO focuses connected helping hunt engines find, understand, and scale your site. Technical SEO foundations now besides find whether AI systems tin entree and usage your contented successful responses.
You request to get these foundations correct earlier your different strategies tin thrust results because, without them, your contented whitethorn not beryllium crawled, indexed, aliases surfaced astatine all. That's existent whether you’re optimizing for accepted hunt rankings, AI Overviews, aliases LLMs that propulsion contented from the web successful existent time.
We've put together this method SEO checklist to thief you activity done the fundamentals systematically.
Let's commencement pinch what the emergence of AI hunt intends for method SEO, and why the aforesaid foundations now person 2 jobs to do.
Technical SEO now serves 2 hunt systems
For astir of SEO's history, location was 1 level to optimize for: Google. Its bots crawled your site, stored what they found, and utilized that information to rank your pages successful hunt results.
That's still happening. But the aforesaid contented Google crawls and indexes is now besides being utilized by AI systems to make answers to personification queries.
This isn't a caller subject aliases a abstracted method SEO checklist you request to follow.
The fundamentals that thief hunt engines find and understand your tract are the aforesaid ones that find whether AI systems tin entree and usage your content, for illustration crawl access, cleanable HTML, meticulous schema, caller content, and logical structure.
Get these right, and your tract is well-positioned for some hunt systems.
What has changed is the consequence of getting it wrong. A method rumor that erstwhile wounded your rankings now has the imaginable to make you invisible crossed hunt and AI surfaces astatine the aforesaid time.
This checklist covers the halfway method requirements for both. Most of it will beryllium acquainted territory if you’ve been doing SEO for immoderate time. And we’ve called retired anyplace that AI readiness changes aliases adds to the modular checks.
1. Look for crawling and indexing issues
Make judge hunt engines tin observe (crawl) and prevention (index) your tract decently truthful your pages tin rank successful hunt results.
These checks still support the accepted hunt index. Some besides impact whether AI retrieval systems tin entree and usage your contented successful responses.
Check whether your tract is indexed
Check whether your tract is indexed, arsenic your tract won’t show successful hunt results if Google hasn’t indexed it.
Check your indexing position utilizing Google Search Console (GSC) and Bing Webmaster Tools (BWT).
In GSC, caput to the "Pages" report. This will show you which pages are indexed successful Google and which are excluded.
The pages that aren’t indexed will beryllium grouped by the circumstantial reason.
Here are a fewer reasons you mightiness see:
- Crawled - presently not indexed: Google looked astatine these pages but decided they weren't worthy indexing. This usually intends the contented is debased value aliases the pages are excessively akin to existing pages. If these are important pages for your business, prioritize updating them.
- Blocked by robots.txt: Your robots.txt record is telling Google not to crawl these pages. Double-check your robots.txt record to make judge you're not accidentally blocking important content.
- Excluded by ‘noindex’ tag: You mightiness person accidentally added noindex tags to your pages. This explicitly tells Google, "Don't put these pages successful hunt results." Remove this tag from important pages you want to beryllium indexed.
You tin besides cheque which of your pages Bing has indexed utilizing the “Site Explorer” study successful Bing Webmaster Tools.
Don’t presume this will lucifer Google’s index. Check some for broad coverage.
You tin besides use IndexNow to taxable URLs straight to Bing and the different hunt engines that support the protocol to promote them to scale your contented faster.
Check for immoderate duplicates of your website
Having copy versions of your tract tin harm your SEO efforts because hunt engines position these arsenic abstracted websites, moreover though they show the aforesaid content. Because they’re each technically different versions.
For example, your website mightiness beryllium accessible at:
- https://yourdomain.com
- https://www.yourdomain.com
- http://yourdomain.com
- http://www.yourdomain.com
Check if your tract is accessible done aggregate URLs by entering each variety successful your browser and checking the reside bar.
If aggregate versions load — for example, some the http and https versions activity without redirecting to 1 type — you request to prime 1 preferred type and redirect each others to it.
Use the HTTPS type arsenic your superior URL (either pinch aliases without www — that's your preference). Then instrumentality a 301 imperishable redirect, truthful users and hunt engines are forwarded to your preferred version.
Make judge your robots.txt record is accurately group up
Configure your robots.txt record to debar blocking important pages from being crawled.
A robots.txt record is simply a matter record that tells hunt motor crawlers which parts of your tract they’re allowed to access.
The record whitethorn incorporate lines that look for illustration this:
User-agent: *
Disallow: /admin/
Disallow: /login/
Allow: /
Your robots.txt record will beryllium located astatine “yourdomain.com/robots.txt.” Check the "Disallow" directives specifically to make judge you’re not blocking important folders aliases pages.
Robots.txt now applies to much than accepted hunt crawlers. AI retrieval bots (the ones that fetch your contented to crushed real-time answers successful AI search) are chopped from training scrapers, and each tin beryllium controlled separately. We screen really to audit and configure this decently successful Section 6.
Fix redirect chains & loops
Fix redirect chains and loops to debar slowing your tract down for users, wasting crawl budget (search motor resources utilized to crawl your site), and affecting really overmuch authority is passed betwixt your pages.
A redirect concatenation occurs erstwhile 1 URL redirects to different URL, which past redirects to different URL, alternatively of linking straight to the last destination.
A redirect loop happens erstwhile a URL redirects to a URL that redirects backmost to the original URL, creating an infinite loop.
Both of these issues tin hap erstwhile you restructure URLs and don’t cautiously negociate redirects during the process.
Use Semrush’s Site Audit instrumentality to find redirect-related issues connected your site.
Set up a project successful the instrumentality to tally a afloat audit. Then, spell to the "Issues" tab and hunt for "redirect" to place immoderate redirect chains aliases loops. Click the “# redirect chains and loops” matter to spot the URLs that person issues.
To hole redirect chains, update immoderate links aliases redirects to constituent straight to the last destination URL. To hole redirect loops, make judge URLs don’t constituent to URLs that redirect backmost to the original URL.
Fix surgery links
Fix surgery links that nonstop users to webpages that nary longer beryllium to debar a mediocre personification experience. Broken links besides don’t walk authority, which could effect your pages’ visibility successful hunt and AI systems.
Broken links tin beryllium either soul links to your ain contented aliases outer links pointing to different websites.
Use Site Audit to find surgery links. Go to the “Issues” tab and hunt for “broken.” Click the detected items to spot the affected pages.
To hole surgery soul links, reconstruct the deleted page if possible, aliases group up a 301 redirect to nonstop users to a akin applicable page.
To hole surgery outer links, switch the nexus pinch an updated type of the page if it exists elsewhere, region the nexus wholly if nary suitable replacement exists, aliases find an replacement assets that provides akin accusation and nexus to that instead.
Fix server errors
Fix server errors (5xx errors) to guarantee hunt engines tin crawl and scale your content.
A server correction indicates that location is thing incorrect pinch the server that hosts your website. Check for server errors by searching for “5xx” successful Site Audit. Click connected the nexus to spot the problematic pages and the circumstantial correction codes they’re returning. Pass the specifications connected to your developer to hole the issues.
2. Optimize for a bully personification experience
Search engines thin to reward websites that supply a bully personification acquisition (UX). Plus, a bully acquisition keeps visitors engaged and encourages them to research much of your content.
The aforesaid UX fundamentals that thief users, specified arsenic accelerated load times, unchangeable layouts, and accessible interactions, besides thief AI agents construe and navigate your site.
Here are the main aspects to address:
Make judge your tract is mobile-friendly
Make judge your website displays and functions decently connected smartphones since hunt engines chiefly usage the mobile type of your tract for ranking and indexing.
To cheque your site’s mobile-friendliness, unfastened it connected your telephone and look for these communal issues:
- Text that’s excessively mini to publication without zooming
- Buttons aliases links that are placed excessively adjacent together to pat accurately
- Content wider than the screen, causing horizontal scrolling
- Pop-ups that artifact the main contented and are difficult to dismiss
Flag immoderate issues for your creation and improvement squad to fix.
Improve your Core Web Vitals
Poor Core Web Vitals scores bespeak your tract whitethorn person issues pinch loading speed, interactivity, and layout shifts.
The 3 Core Web Vitals metrics are:
- Largest Contentful Paint (LCP): Measures really quickly the main contented of your page loads. Aim for an LCP wrong 2.5 seconds.
- Interaction to Next Paint (INP): Measures really quickly your page responds visually aft a personification interacts pinch it (like clicking a fastener aliases tapping a link). This should hap successful little than 200 milliseconds.
- Cumulative Layout Shift (CLS): Measures ocular stableness (i.e., really overmuch elements jump astir arsenic the page loads). Aim for a CLS people nether 0.1.
Use Google Search Console to spot your Core Web Vitals performance.
Navigate to “Core Web Vitals” from the sidebar and click "Open Report” to spot the data.
Then, look for pages marked arsenic "Poor" aliases "Need improvement." These pages person grounded the Core Web Vitals appraisal and request optimization.
Take those URLs and tally them done Google’s PageSpeed Insights instrumentality to get circumstantial recommendations connected really to hole the issues.
Work pinch your developer to instrumentality the suggested fixes.
Avoid intrusive interstitials
Avoid intrusive interstitials because they create a mediocre personification experience, particularly connected mobile devices pinch constricted surface space.
Intrusive interstitials are pop-ups aliases overlays that screen a important information of your content, making it difficult for users to entree the accusation they came for.
Intrusive interstitials see full-screen pop-ups that artifact contented connected arrival, overlays that users must disregard to decently position the page, and layouts successful which ads push the main contented beneath the fold.
Genuine pop-ups for illustration cooky notices, property verification, and paywall logins don’t count arsenic intrusive interstitials.
3. Work connected your website navigation
Make judge your tract has a reasonably elemental navigation strategy that will let users to find important contented easy and thief hunt engines and AI systems understand your site.
Improve your website structure
A clear, logical website building helps users, hunt engines, and AI agents understand really pages subordinate to each other.
The perfect website building resembles a logical hierarchy. Your homepage is astatine the top, followed by main class pages, past subcategories, and yet individual pages.
This building creates clear paths for users, hunt engines, and AI agents to follow. Each page should beryllium accessible wrong 3 aliases 4 clicks from your homepage.
Interlink your pages
Use internal linking to create pathways betwixt different pages connected your site, allowing hunt motor crawlers to observe your contented while helping users find related information.
Look for opportunities to adhd contextual links wrong your content.
When adding links:
- Use descriptive anchor text alternatively than generic "click here" aliases "read more" phrases
- Create hub pages (main taxable pages) that bring together and nexus to each your related content
- Add "related posts" sections astatine the extremity of articles to nexus to applicable content
Use breadcrumbs
Use breadcrumbs to thief some users and hunt engines amended understand your site’s structure.
Breadcrumbs look astatine the apical of a page and show the way to that page wrong your site. Users tin click connected them to easy spell backmost to erstwhile sections.
Fix orphan pages
Orphan pages are difficult for users and hunt engines to observe since they person nary incoming soul links. Fix them to supply a amended personification acquisition and perchance amended the visibility of that page successful hunt and AI systems.
You tin cheque if your tract has immoderate orphan pages utilizing Semrush’s Site Audit tool. Go to the “Issues” tab and hunt for “orphan.” Click into the rumor to spot which of your pages are orphaned.
Fix the rumor by adding links to the orphan page from different applicable pages.
4. Clean up your site's codification and configuration
Code and configuration issues are immoderate of the astir communal causes of crawling and indexing problems. Fixing these issues tin truthful amended your hunt visibility, and perchance besides your AI visibility.
Use HTTPS
Using hypertext transportation protocol secure (HTTPS) provides a unafraid relationship betwixt your tract and your users. Google has treated it arsenic a (lightweight) ranking awesome since 2014.
It’s utilized to encrypt the relationship betwixt the user's browser and your website to protect delicate accusation for illustration login credentials, costs details, and different individual data.
Modern browsers besides people non-HTTPS sites arsenic "Not Secure," which tin erode personification spot and summation bounce rates.
Implement HTTPS connected your tract by acquiring a Secure Sockets Layer (SSL) certificate. Many web hosting services connection this erstwhile you motion up, often for free.
Implement hreflang for world pages
Using hreflang tags tells hunt engines which connection aliases location type of your page to service to which audience. Use it if your tract targets users successful much than 1 state aliases language.
For example, if you hunt for the charismatic Disney tract successful the U.S., you spot the American English version:
If you do the aforesaid successful Germany, you spot German type of the page:
To instrumentality hreflang, adhd the due tags to the <head> conception of each language/country-specific type of your page. You’ll only request to do this if your tract operates internationally.
For example, if your website targets audiences successful the United States, Germany, and Japan, the hreflang tags mightiness look for illustration this:
<link rel="alternate" hreflang="x-default" href="https://yourwebsite.com" />
<link rel="alternate" hreflang="en-us" href="https://yourwebsite.com" />
<link rel="alternate" hreflang="de-de" href="https://yourwebsite.com/de/" />
<link rel="alternate" hreflang="ja-jp" href="https://yourwebsite.com/jp/" />
The first tag indicates the default aliases fallback page that should beryllium shown to users erstwhile nary different version is appropriate.
Other tags specify the different connection aliases state versions disposable connected your site, helping Google service the correct 1 based connected a user's location and connection settings.
For much guidance connected what tags you should implement, publication our beginner-friendly guideline to hreflang attributes.
Add schema markup
Adding schema markup helps hunt systems understand precisely what your contented is about, making it easier for them to aboveground it accurately successful some hunt and AI-generated results.
It is simply a type of codification that besides helps hunt systems place entities, authorship, dates, page type, discrete facts, and more.
While it's not a nonstop ranking factor, schema markup enables rich results (special listings connected hunt results pages), which tin amended click-through rates.
There are galore types of schema markup, but you should attraction connected the astir applicable ones for your circumstantial contented types. These whitethorn include:
- Organization
- Product
- Article
- Event
- Recipe
- Review
An easy measurement to make schema is to usage a Schema Markup Generator.
Once the codification is generated, adhd it to the <head> conception of your page’s HTML. Then, usage Google's Rich Results Test instrumentality to verify that your schema is implemented correctly.
Schema whitethorn besides thief AI systems prime retired cardinal specifications from your page, for illustration prices, writer names, and publication dates. This whitethorn thief them amended understand erstwhile your marque aliases contented is applicable to personification prompts.
5. Audit your tract for AI grounding and supplier readiness
A batch of what determines your visibility successful AI hunt comes backmost to the aforesaid method SEO fundamentals we’ve covered above.
However, location are a fewer further checks circumstantial to really AI systems activity that could straight effect your visibility successful AI responses.
Check robots.txt for AI retrieval access
Check your robots.txt record to guarantee AI crawlers tin entree your content. By default, astir bots will travel your existing directives, truthful immoderate accidental blocks could beryllium limiting AI entree you really want.
Here's what blocking circumstantial AI crawlers looks for illustration successful a robots.txt file:
For astir sites, the extremity is to guarantee AI retrieval bots person entree to the contented you want surfaced successful AI responses. If you spot "disallow" directives for AI crawlers, cheque pinch your improvement squad that they were added intentionally, arsenic they whitethorn limit your AI visibility.
Use Semrush’s Site Audit to spot whether you’re blocking immoderate AI crawlers from accessing your content.
Audit semantic HTML and page accessibility
Checking your HTML and page accessibility ensures AI systems tin publication your contented properly.
When an supplier interacts pinch a webpage, it useful from:
- Raw HTML: The underlying codification building the supplier parses to place contented and elements
- Screenshots: A ocular rendering of the page utilized to construe layout and creation context
- Page accessibility: The underlying building that surface readers trust on, which agents whitethorn usage to place and interact pinch interactive elements connected the page
If your HTML is poorly structured, agents whitethorn struggle to construe your page correctly.
The image beneath shows the quality betwixt generic HTML and well-structured, semantic HTML.
The type connected the near uses wide tags for illustration <div> and <span> throughout. While the codification still functions fine, they deficiency immoderate meaning aliases nuance that machines tin usage to understand really a page is structured.
Compare that to the semantic HTML illustration connected the right, which replaces the wide tags pinch circumstantial ones that intelligibly bespeak what portion of the page they subordinate to. Semantic HTML tags include:
- Header: Marks the apical conception of the page, typically containing the logo and site-wide navigation
- H1: Identifies the main heading of the page
- Nav: Signals that this group of links is the site's navigation menu
- Main: Wraps the superior contented of the page, chopped from headers, footers, and sidebars
- H2: Marks a subheading wrong the main content, sitting 1 level beneath the H1
- Footer: Marks the bottommost conception of the page, typically containing copyright info, links, and interaction details
If you're unsure if your tract is utilizing semantic HTML, speak to your developer.
Agentic commerce readiness: Additional checks for ecommerce sites
The method SEO checks supra use to each site. For ecommerce, location are a fewer further things worthy verifying arsenic AI agents move from retrieving accusation to completing purchases connected behalf of users.
First, make judge your merchandise schema is meticulous and reflects real-time inventory, arsenic it tin power really your products look successful hunt and AI results.
The simplest measurement to trial whether an supplier tin navigate your checkout is to effort it yourself pinch ChatGPT's shopping assistant (or a akin tool) and complete a acquisition connected your site. If it stalls, fails to find cardinal fields, aliases can't advancement done a step, that’s an rumor that different agents mightiness look too.
Beyond those 2 checks, here's what other to verify:
- Keep cardinal argumentation pages for illustration returns, shipping, and FAQs successful plain HTML truthful agents tin publication them without hitting a method barrier
- Make judge shape fields, buttons, and checkout steps are built pinch modular HTML elements truthful agents tin interact pinch them reliably
- Check that your tract useful without JavaScript for captious pages (some agents can't execute scripts and will only spot a blank page)
- Ensure cooky consent banners and login modals tin beryllium dismissed pinch a intelligibly branded fastener built successful modular HTML
- Avoid checkout flows that trust heavy connected move contented updates. If the page authorities changes aft an action, make judge the updated accusation is reflected successful the underlying HTML, not conscionable visually.
Further reading: Agentic commerce is here: What it intends for the ecommerce industry
Put this method SEO audit checklist into action
Technical SEO is really you make judge thing stands betwixt your marque and each hunt level that tin aboveground it to your target audience, including AI platforms.
This method SEO audit checklist helps you verify that thing is surgery crossed the discovery, crawl, indexing, aliases visibility layers of modern hunt systems.
Semrush's Site Audit instrumentality helps you place and hole method issues quickly and efficiently to guarantee your marque stays visible. Try it today.
English (US) · 
Indonesian (ID) ·