Click to See Complete Forum and Search --> : Search engine indexing of .pdf files?
alspyjamas
11-10-2006, 05:27 PM
If I have an HTML file that has links to .pdf files, will search engines follow these links and index the .pdf files? And if so is there an equivalent META ( robots : nofollow, noindex ) tag to stop them doing this?
Thanks for your input,
David
Yes, they will follow the link unless you put the nofollow, noindex tag in the robots file or a metatag.
3x-a-D3-u5
11-13-2006, 03:42 PM
Doesn't the nofollow, noindex tell the robot "hey dont even look past my index!" ?
Yes, that's exactly what I meant. It is meant to stop the bot on the page it is listed on or, if in the robots.txt file, at the index. However, be aware that not all bots follow the instructions in the robots.txt file or the metatags.