Home | Development Tools | Web Related Tools | Robots.txt 2.0
 

Robots.txt 2.0

 
A tool to create and manage Robots.txt files
$99.90
 

Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable. By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with

Platforms: Win98 , WinME , WinNT 3.x , WinNT 4.x , Windows2000 , WinXP

System requirements: Windows 9x, NT,ME,2000/XP

 
Added: 05 March, 2008 File size: 2.8 MB
Status: new Download times: 56 kb/s: 06 m 50 s
Program type: shareware   128 kb/s: 03 m 00 s
      512 kb/s: 45 s
 

More Similar Software

 
Generate industry standard robots.txt

Robots.txt 2.0

With Robots.txt Editor you create robot exclusion files by selecting all robots or a specific user-agent and adding documents and/or directories by entering the path names manually or by selecting them using FTP.With Log Analyzer you can get the...

2.7 MB shareware 05 March, 2008
Save the world from evil minded robots

Age Of Robots 1.0

Age Of Robots is an action game in the year 2015 where you control a modular robot. Your purpose is to destroy the evil minded robots who have taken control of the world. As you pass through harder missions, your robot turns into a complex machine.

2.7 KB shareware 05 March, 2008
Shoot robots in a tactical top down shooter.

Nova 3000 1.0

Nova 3000 is a tactical, top down shooter. Your mission is to destory all robots on each of the 17 levels (plus 2 secret levels). You control a ship fitted with 3 different weapons, each robot will only be destroyed by the correct weapon, so you...

4.6 MB freeware 05 March, 2008
Robotron action. Destroy all robots!

Puppytron 1.0

The last human family is already dead! This just leaves you, and endless hordes of evil killer robots. You will certainly die. But how many of them can you take with you? Play for the glory. Only hiscores matter! * Online hiscore table * Frenzied...

3.8 MB commercial 05 March, 2008
Protect email addresses against spam robots

0-code Email Address Protector 2.1.0.0

0-Code Email Address Protector is a tool for webmasters that can help reduce spam by converting your posted email address to a Java script function or image that cannot be read by email extraction robots. If a visitor clicks on the email (mailto)...

1.1 MB shareware 05 March, 2008

Popular Downloads