Robots Txt Generator

Seo REST API MCP

Return a robots.txt file built from user-agent rules (allow, disallow, crawl-delay), sitemap URLs and an optional Host directive, or from a preset: allow-all, block-all, wordpress, ecommerce.

This page documents the MCP tool findutils:robots_txt_generator. See the REST reference →

Use in the browser View as Markdown

Call it over MCP

Tool name findutils:robots_txt_generator · no API keys · 120 requests/min per IP

Claude Code

claude mcp add findutils --transport http https://mcp.findutils.com/

Claude Desktop — claude_desktop_config.json

{
  "mcpServers": {
    "findutils": {
      "url": "https://mcp.findutils.com/"
    }
  }
}

Raw JSON-RPC (any MCP client) — verified example

curl -X POST https://mcp.findutils.com/ \
  -H "Content-Type: application/json" \
  -d '{
    "jsonrpc": "2.0",
    "id": 1,
    "method": "tools/call",
    "params": {
      "name": "robots_txt_generator",
      "arguments": {
        "preset": "allow-all",
        "sitemaps": [
          "https://example.com/sitemap.xml"
        ],
        "include_comments": false
      }
    }
  }'

Input schema

Argument Type Required Description
rules array no Rule groups: objects with user_agent (e.g. "*", "Googlebot", "GPTBot"), allow (array of paths), disallow (array of paths), crawl_delay (seconds). Overrides preset.
preset string (allow-all | block-all | wordpress | ecommerce) no Starting rule set when rules is omitted. Default: "allow-all".
sitemaps array no Absolute sitemap URLs.
host string no Optional Host directive value (Yandex), e.g. "https://example.com".
include_comments boolean no Prepend the generator comment header with the date. Default: true.

Example arguments (verified)

{
  "preset": "allow-all",
  "sitemaps": [
    "https://example.com/sitemap.xml"
  ],
  "include_comments": false
}

Also a REST endpoint

The same tool answers plain HTTP at POST /api/tools/robots-txt-generator/execute — no key, 60 requests/min.

Open the REST reference for Robots Txt Generator →

More Seo tools

Bot Crawl Checker

Return which of 24 well-known crawlers (Googlebot, BingBot, GPTBot, ClaudeBot, PerplexityBot, AhrefsBot, Twitterbot and more) are allowed or

Domain Rating Checker

Return the Ahrefs Domain Rating (0-100) for up to 25 domains in one call, with a per-domain status.

Faq Schema Generator

Generate FAQPage JSON-LD structured data from question-answer pairs, and return the JSON-LD string, a ready <script> tag, the schema object,

Form To Json Schema

Returns a form schema object ({ formId, method, action, fields, submitText }) extracted from HTML form markup.

Geo Analyzer

Return a Generative Engine Optimization (GEO) report for a public web page: an overall 0-100 score, per-category scores (technical, content,

Graphql Schema Validator

Validate a GraphQL SDL schema and return errors, naming-convention warnings, and counts of types, queries, mutations, and subscriptions.

Heading Structure Analyzer

Analyze the H1-H6 heading hierarchy of an HTML document and return every heading, SEO warnings (missing or multiple H1, skipped levels, empt

Hreflang Tag Generator

Generate hreflang annotations for multilingual pages and return them as HTML <link> tags, an HTTP Link header, and an XML sitemap block, plu