LLMsTxt Generator

About

# llms.txt Generator

Extension scans your `sitemap.xml`, convert pages & live sites to LLM-optimized Markdown, and export instantly. It generates a single llms.txt file and multiple llms-full.txt file for each page which includes all the links. It automatically downloads the whole generated markdowns as a single .zip file.

---

## Key Features

- **Recursive Sitemap Scanning**

  - Parses your `sitemap.xml` and any nested sitemaps, following only valid `http(s)` URLs.
  - Filters out non-HTTP links for focused scanning.
  - Generates a single llms.txt file along with sub pages for more details
  - Zips all generated files and auto downloads as a single file once scan is completed

- **Markdown Export (LLMsTxt Format)**

  - Converts HTML pages into clean **ATX-style headings** (`#`, `##`, …), fenced code blocks, and absolute URLs.
  - Removes `<script>`, `<style>`, and `<button>` tags; 
  - Resolves relative links and images to **full URLs** for seamless static `llms.txt` content generation.

- **Current Page Converter**

  - One-click “Convert Current Page” grabs the **rendered DOM** (supports SPA/React/Vue content).
  - Prepends `<title>` as `# Heading` and `<meta name="description">` as `> Blockquote`.
  - Ideal for ad-hoc page audits, AI training data extraction, and quick Markdown previews.

- **Embed & SEO Metadata Guidance**

  - Built-in **Embed** tab with snippets:

    ```html
    <link
      rel="alternate"
      type="text/llmtxt"
      href="https://example.com/llms-full.txt"
      title="LLMsTxt version"
    />
    <meta name="llmtxt" content="https://example.com/llms-full.txt" />
    ```

  - Publish `llms-full.txt` files alongside your pages for easy LLM ingestion and SEO signals.

- **Intuitive Modern UI**

  - Four tabs: **Generator**, **Current Page**, **Embed**, **About**.
  - Real-time **progress bar** & **auto-scrolling log**.
  - ⚠️ User warning prevents accidental closure during scanning.
  - **Copy to Clipboard** for instant Markdown transfer.

- **Privacy-First & Offline-Capable**

  - 100% local conversion—no external servers, no tracking.
  - Uses Chrome MV3 Offscreen API for accurate DOM parsing.

---

## How It Works

1. **Auto-Detect** your sitemap URL (`https://your-site.com/sitemap.xml`) on secure pages.
2. **Offscreen Rendering** fetches pages in a hidden DOM, executing scripts for dynamic content.
3. **Clean & Normalize** HTML: strip unwanted nodes, normalize whitespace per text node.
4. **Convert to Markdown** with Turndown:

   - Headings → `#`–`######`
   - Code → `lang …`
   - Links → `[text](absolute-url)`
   - Images → `![alt](absolute-url)`
   - JSON-LD → `application/ld+json …`

5. **Download or Copy** your domain’s ZIP or current-page Markdown.

Please review the downloaded content before publishing under your webpage. If you see something unwanted, please report it as issue on open-source repository https://github.com/plainsignal/llmstxt

---

## Why Choose LLMsTxt Generator?

- **SEO & Content Marketing**: Ideal for content audits, static migrations, UTM tracking, and structured data extraction.
- **AI, LLM Workflows & RAG**: Prep training data, generate knowledge bases, accelerate AI-driven insights. 
- **Developer Productivity**: Integrates with CI pipelines, GitHub Actions, and static site generators.
- **Flexibility & Extensibility**: Open-source under Apache 2.0 — https://github.com/plainsignal/llmstxt and contribute! It is community driven extension. Open an issue if something is not working as expected.