Click to See Complete Forum and Search --> : Search engine indexing of .pdf files?


alspyjamas
11-10-2006, 05:27 PM
If I have an HTML file that has links to .pdf files, will search engines follow these links and index the .pdf files? And if so is there an equivalent META ( robots : nofollow, noindex ) tag to stop them doing this?

Thanks for your input,
David

LeeU
11-13-2006, 10:38 AM
Yes, they will follow the link unless you put the nofollow, noindex tag in the robots file or a metatag.

3x-a-D3-u5
11-13-2006, 03:42 PM
Doesn't the nofollow, noindex tell the robot "hey dont even look past my index!" ?

LeeU
11-13-2006, 04:10 PM
Yes, that's exactly what I meant. It is meant to stop the bot on the page it is listed on or, if in the robots.txt file, at the index. However, be aware that not all bots follow the instructions in the robots.txt file or the metatags.