Robots txt tester
Check whether robots.txt rules allow a crawler to visit your URL.
Find the right tool and get straight to your task.
No account needed.Check whether robots.txt rules allow a crawler to visit your URL.
Build structured data markup for a web page.
Create HTML metadata for your page without writing each tag.
Create hreflang tags for language and regional versions of a page.
Check a website's SSL certificate and when it expires.
Server unavailableFollow a URL through its redirects to the final destination.
Server unavailableSee which security headers a website returns.
Server unavailableSee a URL's HTTP response and the redirects along the way.
Server unavailableThese free website tools help site owners and SEO specialists prepare the technical details search engines read. The Robots txt tester checks whether a URL is allowed or blocked for a given crawler and shows the rule that decides it. The Schema generator builds structured data in JSON LD, the Meta tag generator writes title, description and social tags, and the Hreflang generator creates the tags that link language and regional versions of a page.
Test before you publish. Paste your robots.txt rules and try a few important URLs, then validate generated schema with a structured data test. Small mistakes in these files can hide pages from search or confuse which version appears.
Not always. Robots.txt controls crawling, not indexing, so a blocked page can still appear if other sites link to it. To keep a page out of search results, allow crawling and add a noindex meta tag instead.
No. Valid structured data makes a page eligible for rich results, but search engines decide whether to show them. Use the Schema generator to produce correct markup, then make sure it matches what visitors see on the page.
The Schema generator, Meta tag generator and Hreflang generator run in your browser. The details you enter are turned into markup on your device. Copy the output into your page head or content management system.