Robots.txt Checker
Test if robots.txt blocks a URL for Googlebot, Bingbot or AI crawlers like GPTBot and ClaudeBot. See the rule that matches and the sitemaps listed.
Preview how a link looks when shared on Facebook, WhatsApp, LinkedIn and X, and check every Open Graph and Twitter Card tag.
Shows the share card people see on Facebook, WhatsApp, LinkedIn and X.
This tool asks our server for public information only. Nothing you enter is stored.
When someone shares your link, social apps build a card from its Open Graph and Twitter Card tags. Enter a URL to see a preview of that card, every og: and twitter: tag on the page, and warnings for missing titles, descriptions or images that are too small.
1200 × 630 pixels (1.91:1) works on all major apps. Keep the file under 5 MB.
Facebook caches previews. After fixing the tags, ask it to scrape the page again in its Sharing Debugger.
Test if robots.txt blocks a URL for Googlebot, Bingbot or AI crawlers like GPTBot and ClaudeBot. See the rule that matches and the sitemaps listed.
Create a robots.txt file: block folders, add your sitemap, and allow or block AI crawlers such as GPTBot, ClaudeBot and PerplexityBot.
Create an llms.txt file for your website in a minute: name, summary, details and sections of links in the right Markdown format. Free, with an example.
Generate HTML meta tags for SEO and sharing: title, description, robots, canonical, Open Graph and Twitter cards, with a Google preview. Free.