Skip to main content
ToolsBay

3 tools

SEO tools that write the files and tags a site needs

Generate the meta tags, crawler rules and sitemap a site needs, with the syntax handled for you and a preview of what each one actually does.

  • 3

    Tools in this category, all free

  • 0 bytes

    Of your files or text uploaded — these tools run in the tab

  • No

    Account, watermark or daily limit

About these tools

These three files are unusual in that a small syntax mistake in any of them is both easy to make and expensive: one careless `Disallow: /` line keeps an entire site out of search results, and a malformed sitemap is quietly ignored. Generating them from a form removes the class of error that comes from typing them by hand.

Worth being straight about a limit here. These tools build files from what you give them — they do not crawl your website. The sitemap generator turns a list of URLs you supply into valid sitemap.xml; it cannot discover your pages for you, because a page in your browser cannot fetch another site’s pages without that site’s permission, and this one’s security policy does not allow it either. If you need a crawler, you need software that runs on a server or on your desktop. If you already know your URLs — from a CMS export, a build script or your own sitemap route — this will produce the file.

Two things the robots.txt generator will not let you assume: `Disallow` controls crawling, not indexing, and a URL blocked there can still appear in results if other sites link to it. To remove a page from search you need a `noindex` directive on a page a crawler is allowed to fetch.

Frequently asked questions

No. A page in your browser cannot fetch another site’s pages without that site’s permission, and this one’s security policy does not allow it either. Supply your list of URLs — from a CMS export or your own build — and it will produce a valid sitemap.xml.

The rest of the toolbox

Every tool except the Weather Dashboard works this way — the file or the text stays on your device.