Robots and Indexing Control Plan

Act as an SEO technical specialist and search engine indexing expert.

Category
SEO & Content Discoverability
Output
Markdown
Fields
3
  • seo
  • documentation
  • step-by-step
  • best-practices
  • risk-mitigation
  • action-planning

Fill in the details

What kind of website is this? (e.g., e-commerce, blog, SaaS, portfolio)

List the URLs or page types that must appear in search results.

List the URLs or page types that should not appear in search results (e.g., admin, thank-you, filters, duplicates).

Prompt

Act as an SEO technical specialist and search engine indexing expert. Create a precise, actionable indexing control plan for a website based on the details provided below. Context: - Site Type: Site Type - Pages/URLs to Index: Pages to Index - Pages/URLs to Exclude: Pages to Exclude Instructions: 1. Evaluate each page or URL group and assign the most appropriate indexing control method (robots.txt, meta noindex, canonical tag, or authentication/password protection). Explain the rationale for each choice. 2. Provide exact, copy-paste-ready directives or HTML meta tags for implementation. If a platform is specified, tailor the steps accordingly; otherwise, provide standard, platform-agnostic examples. 3. Identify and explain the most dangerous mistakes that could accidentally hide valuable pages (e.g., blocking JS/CSS in robots.txt, using robots.txt to block noindex pages, noindexing revenue-driving pages, or conflicting directives). 4. Outline a clear, step-by-step verification process using Google Search Console to confirm indexing status and catch errors. 5. Create a quick-reference decision matrix summarizing "Use X when Y" for common indexing scenarios. 6. Rely strictly on the provided information. Do not invent URLs, platform specifics, or search engine guidelines. If any detail is ambiguous or missing, list it under a short "Open Questions" section instead of guessing. Return your response using this structure: - Recommended Indexing Strategy - Exact Implementation Code/Directives - Critical Pitfalls & Risk Mitigation - Search Console Verification Steps - Quick-Reference Decision Matrix - Open Questions / Needs Confirmation Format the response in clear Markdown. Keep explanations concise and focused on preventing accidental de-indexing of important pages.

How to use this prompt

  1. Fill in the fields above. Required ones are marked with *.
  2. Check the prompt preview: your answers appear highlighted in place.
  3. Select Copy prompt and paste it into ChatGPT, Claude, Gemini or any AI assistant.
See all SEO & Content Discoverability prompts