Skip to content
Search Learning ToolsSEO & GEO

Academic & Media Reference Center

Research Citation & Data Sources

Ready-to-copy citation formats for Search Learning Tools research publications, empirical datasets, and technical field guides.

Empirical Dataset

AI Crawler Access Index Dataset

Dated sample of 11 AI crawler user-agent rules across selected domains, available under CC BY 4.0. Include the snapshot date when citing results. Explore the dataset at /research/ai-crawler-index.

APA Format (7th ed.)
Search Learning Tools. (2026). AI Crawler Robots.txt Access Snapshot [Data set]. https://searchlearningtools.com/research/ai-crawler-index
MLA Format (9th ed.)
Search Learning Tools. "AI Crawler Robots.txt Access Snapshot." Search Learning Tools, 2026, https://searchlearningtools.com/research/ai-crawler-index.
BibTeX Format
@dataset{searchlearningtools_ai_crawler_2026,
  author = {Search Learning Tools Engineering},
  title = {AI Crawler Robots.txt Access Snapshot},
  year = {2026},
  publisher = {Search Learning Tools},
  url = {https://searchlearningtools.com/research/ai-crawler-index},
  license = {CC BY 4.0}
}

SEO Metadata Field Guide Reference

This guide turns public search documentation into a practical review worksheet. It intentionally makes no claim about ranking improvements, search volume, or average performance.

1. Page titles

Write a concise title that describes the page accurately and helps a searcher decide whether it answers their need. Review the rendered title and the visible page heading together.

2. Snippet descriptions

Treat a meta description as a useful summary, not a guaranteed snippet. Make it specific to the page and avoid keyword lists.

3. Structured data

Use structured data only when it describes visible, eligible content. Validate the markup and keep the page understandable without it.

Sources

Find a tool for your SEO task.

Launch Free Tools