robots.txt help

Status
This thread has been Locked and is not open to further replies. Please start a New Thread if you're having a similar issue. View our Welcome Guide to learn how to use this site.

Techmonkeys

Thread Starter
Joined
Feb 10, 2005
Messages
625
I have just been working on a new robots.txt for my site after finding googlebot hacing used 9Gb of bandwidth last month :eek:

What I wanted to know is if in my robots.txt I put:

User-agent: Googlebot*
Disallow: /images/
Will that apply to googlebot and googlebot-image ?
 
Status
This thread has been Locked and is not open to further replies. Please start a New Thread if you're having a similar issue. View our Welcome Guide to learn how to use this site.

Users Who Are Viewing This Thread (Users: 0, Guests: 1)

As Seen On
As Seen On...

Welcome to Tech Support Guy!

Are you looking for the solution to your computer problem? Join our site today to ask your question. This site is completely free -- paid for by advertisers and donations.

If you're not already familiar with forums, watch our Welcome Guide to get started.

Join over 807,865 other people just like you!

Latest posts

Members online

Top