Robots.txt & Sitemap Generator

Stateless — no uploads, no server storage. Share via URL.

Back to tools

How to use

Select a preset (recommended) or configure manually.
Click Generate to update outputs.
Copy / Download in your browser only.
Share the URL to share the exact settings.

Load examples

Presets reload with parameters (stateless).

Domain

No protocol. Example: mofidtech.com

Site type

Framework

Sitemap path

Crawl-delay

Generate sitemap index template

Allow static/media/assets (recommended)

Disallow admin

Disallow private pages (login, account, checkout)

Disallow internal search

Extra disallow (one path per line)

Reset

✅ No server storage. Output is generated from query parameters.

robots.txt sitemap.xml django_sitemaps.py django_urls.py

# robots.txt generated by MofidTech (stateless)
# Domain: example.com

User-agent: *
Allow: /static/
Allow: /media/
Allow: /assets/
Disallow: /admin/
Disallow: /wp-admin/
Disallow: /accounts/
Disallow: /account/
Disallow: /login/
Disallow: /logout/
Disallow: /register/
Disallow: /checkout/
Disallow: /cart/
Disallow: /orders/
Disallow: /profile/
Disallow: /settings/
Disallow: /api/private/
Disallow: /search
Disallow: /search/
Disallow: /?s=
Disallow: /?q=

Sitemap: https://example.com/sitemap.xml

Active: robots.txt

Tip: share this URL to share settings.