| |
|
|
|
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions.
The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable.
By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with |
| « read more about Robots.txt 2.0 |
|
|
RECOMMENDED DOWNLOADS IN THIS CATEGORY
|
|
|
|
| » ASP.NET Auto Email (Server License) 1.0
|
| New! ASP.NET Auto Email ASP.NET Auto Email allows you to create email forms without any programming! Simply drag-and-drop the control, enter two or more properties and you are done. ASP.NET Auto email even attaches files automatic ... |
|
| 360impact.com | 0 | Win 2000/XP | $185 | Downloads: 1405 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » VML Banner 1.02
|
| VML Banner is a cool tool for web developers to create animate 3D text or shape. It`s especially fit the head title or banner for web page. If you want, it even can create a 3D text title without any pictures or 3rd party plug-ins. Of course, it can creat ... |
|
| Pc-fairy.com | 0 | Win 2000/XP/98/ME | $39.97 | Downloads: 1334 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » WebPassword Pro 5.0
|
| WebPassword is a program which protects your web pages with password. Once you have password-protected your page, no one unauthorized person will be able to view its content without having a correct password, either in browser or as an original HTML sourc ... |
|
| Passwordtools.com | 0 | | $39 | Downloads: 1326 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Active Local Pages (local/per seat) 1.1
|
| Active Local Pages is an ASP (Active Server Pages) and CGI engine and several additional tools (Viewer with extended DHTML, Installer, Huge pack of components). With ALP desktop applications can be written in ASP/CGI and deployed to any Windows PC beg ... |
|
| Newobjects.com | 0 | Win 95/NT/2000/XP/98/ME | $15 | Downloads: 1293 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » ZCS Community System 1.2
|
| ZCS is a Web-based community system that uses PHP. It is object oriented, so it is easily extendible. Its database abstraction layer allows it to be compatible with multiple databases. ZCS is easily configurable, and includes content management systems, a ... |
|
| Zackcoburn.com | 0 | Unix / Linux Platform independ | $100 | Downloads: 1280 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » HTML Calendar Maker Pro Registration Code
|
| To unlock the shareware version of HTML Calendar Maker Pro, order a registration code. By entering a registration code into the program, you are granted unlimited use as well as the ability to modify the footer of each calendar you create. ... |
|
| Htmlcalendar.com | 0 | Win 95/NT/2000/XP/98/ME | $26.5 | Downloads: 1367 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Web Page Calendar Maker Registration Code
|
| To unlock the shareware version of Web Page Calendar Maker, order a registration code. By entering a registration code into the program, you are granted unlimited use as well as the ability to modify the footer of each calendar you create. ... |
|
| Htmlcalendar.com | 0 | Macintosh | $26.5 | Downloads: 1304 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » VectorShop 1.0
|
| Powerful and Easy-to-use tool to create professional-looking flowcharts, presentations, schematics and networks. VectorShop uses the state-of-art rendering engine (GDI+), which supports many advanced image effects (alpha blending, gradient, hatch, shadow ... |
|
| Svizsystem.com | 0 | Win NT/2000/XP | $39 | Downloads: 3498 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| |
| Fontkiller.com | 0 | Win NT/2000/XP/98/ME | $22 | Downloads: 1366 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » mnoGoSearch Lite for Windows 3.1.15
|
| Search engine designed to provide search on Intranet or public Web sites so customers and visitors can quickly find and access virtually any information on a site or multiple sites. With mnoGoSearch it is possible to build and maintain various subject-ori ... |
|
| Mnogosearch.org | 0 | Win 95/NT/2000/XP/98/ME | $99 | Downloads: 1401 |
| Date added: Sep 23, 2005 |
» Details |
|
|
|
|
| » phpGreetCards 3.0
|
| phpGreetCards is a powerfull PHP based postcard Web Application Features include: Unlimited GreetCard Categories; Allows user upload his own image; Preview page before send; Allows user select font color; Allows user select background color; Allows ... |
|
| W2b.ru | 0 | | $49.95 | Downloads: 1269 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » ConversionTrack 1.1
|
| According to the web log, ConversionTrack can analyze every user`s access path, and give out an overall statistic result of visitor`s conversion rates including the referer, time, region, and information of user`s software environment. It can help you bet ... |
|
| Antssoft.com | 0 | Win 95/NT/2000/XP/98/ME | $59.95 | Downloads: 1409 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » HTMLCompact 2.0
|
| HTMLCompact is a powerful HTML compression tool created for webmasters. Its effective compression algorithm can reduce the size of your pages by as much as 80% while keeping the appearance of the page the same. When implemented, the documents will be unco ... |
|
| Antssoft.com | 0 | Win 95/NT/2000/XP/98/ME | $19.95 | Downloads: 1242 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » WisePopup 1.5
|
| Want boost your subscription levels by up to 535% or more? Yes, you can reach it by using popup windows. Let`s be honest. A significant percentage of Internet users have a negative attitude towards popup windows. In fact, a recent survey found that 32% ... |
|
| Antssoft.com | 0 | Win 95/NT/2000/XP/98/ME | $29.95 | Downloads: 1307 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » BrowserBob 2.0 (deutsch) 2.0.7.4
|
| BrowserBob 2.0 Now you can design and build a browser to suit your own desires, with this Web browser development kit. You can make your browser any shape you choose, use your own images for the buttons and the interface(s), position them anywhe ... |
|
| Browserbob.de | 0 | Win 95/NT/2000/XP/98/ME | $42.24 | Downloads: 1372 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » SMTP To 2.x
|
| SMTPTo windows command line mailer Tired of writing and writing simular emails? You don`t have to. Let SMTPTo do the stupid work for you. Your time is to valuable, go for the tasks where you`re brain is needed or just enjoy your more relaxed life. It ... |
|
| Ionly.com | 0 | Win 2000/XP/98/ME | $17.23 | Downloads: 1377 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| |
| Cscstrategies.com | 0 | | $199 | Downloads: 1468 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Sothink DHTMLMenu 4 4.2
|
| Create professional DHTML pop-up menu WITHOUT writing a single line of code. NO DHTML or JavaScript experience required! Just in a couple of minutes, you can create a dynamic menu fancy and professional. Sothink DHTMLMenu lets all things become si ... |
|
| Sothink.com | 0 | Win 95/NT/2000/XP/98/ME | $35 | Downloads: 1218 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Web Show FX+ V1
|
| Web Show FX+ will allow you to easily create professional web galleries ready to be published on the web. Just add your images, click a few buttons to create the web galleries, and use the powerful FTP function to upload your web galleries to the Web. ... |
|
| Emtec.no | 0 | Win 95/NT/2000/XP/98/ME | $21 | Downloads: 1288 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » PHP Processor 1.2
|
| PHP Processor is the powerful editor for the web-masters which use PHP,HTML,JavaScript language. This program will help you to make the analysis of the project and if it is necessary to protect it (to remove all comments in the program and automatically t ... |
|
| Gridinsoft.com | 0 | | $35 | Downloads: 1451 |
| Date added: Sep 23, 2005 |
» Details |
|
|
|
|
| |
