Robots.txt Syntax Checker: This tool checks the contents of a site�s robots.txt against that contained in the latest specification, along with providing warnings on the use of new features that are not yet widely deployed.