Search Engine Optimization > Robots.txt Generator
Search Engine Optimization Home Top10 Optimizer Find IP Meta Tag Creator Class C Checker Check Server Headers Domain Age Calculator Domain Typo Generator Indexed Pages Count Keyword Density Keyword Typo Generator Keyword Optimizer Meta Analyzer Page Comparison Page Size Page Rank Robots.txt Generator Outbound Links Calculator Google Vs Yahoo SE Keyword Position Affiliate Finder Link Popularity	Robots.txt Generator This file allows you to hide files or directories that you don’t wish the search engine spiders to find. Generating a robot file with this tool is ideal if you wish to block certain directories or files from search engines. Select User Agent or Use All (Default) : All Agents Alexa AltaVista AOL Netfind Google Agent HotBot Agent InfoSeek Lycos MSN Search Northern Lights Agent Webcrawler Agent  Enter relative URLs you want to exclude : Ex:   /Images/            /cgi-bin/