Crawling and indexing
SEO guides, glossary terms and tool tutorials organized by topic to help you learn and apply.
Crawling and indexing
- Technical SEO: guide to crawlability and indexability
A practical checklist to improve site structure, titles, links, canonical, robots.txt, sitemap, and structured data.
- Crawling: meaning and its impact on SEO (Crawling)
Learn what crawling means and how search engines discover your pages and improve accessibility.
- Indexing: the practical guide to improving visibility (Indexing)
An explanation of indexing in SEO, its requirements, causes of non-indexing, and how to monitor its status.
- Canonical URL and duplicate pages (Canonical URL)
Understand canonical URLs and when to use them to consolidate signals from similar pages.
- Structured data and its role in SEO (Structured Data)
A simple guide to understanding structured data and Schema and how they help search engines read content.
- Robots.txt and crawl access
Understand how robots.txt guides crawlers and the limits of using it.
- XML sitemaps and page discovery
Learn how XML sitemaps help search engines discover pages and follow updates.