Search Engine Problem [Archive]

Jobquest

04-17-2006, 02:50 PM

Hi - I wonder if anyone can help resolve this problem?

I have several pages on my website, one of which is a catalogue page where all my products are listed. Each product has a hyperlink that opens up in a pop-up window so the viewer can see that particular product. The pop up is made up of one page with frames - the left hand frame is a page of images which the user clicks on and it opens on the right side frame as a larger image - this part all works fine.

I included a Frontpage search component but it pulls up every single page throughut the website where an individual product is referred to and not from just the catalogue page which is the only place I want the search to look at.

Is there any way of configuring the command to just look on this one page only?

I hope this makes sense and someone can come to my rescue - Many thanks

<Eddie>

04-18-2006, 05:04 AM

This is a search engine forum and your question is likely to be solved more rapidly in the Dreamweaver/FrontPage (http://www.webdeveloper.com/forum/forumdisplay.php?f=40) section.

Good luck.

Jobquest

04-18-2006, 10:09 AM

Hi there - thanks for your reply - I'll post it there and keep my fingers crossed!

TiGGi

04-18-2006, 10:13 AM

Yes, using robots.txt file which should be placed at the root of your website.
robots.txt would looks something like this:

User-agent: *
Disallow: /cgi-bin/
Disallow: /privatedir/
Disallow: /tutorials/blank.htm

This means that you allowing all crawlers to yours site (*) and the list of folders and files that you don't want them to crawl.
You can also use:
Allow: /folder/file.html
but this command is not recognized by some less inteligent crawlers. Google is not one of them so google bot will work

Jobquest

04-18-2006, 10:54 AM

Hi - thanks for your reply, I really appreciate this.

Now, I'm being a bit thick here - do I paste the Disallow commands into my HTML page of my catalogue page? If so, whereabouts do I place it? In the head? Body?

This is the actual page in question, if that is any help...

<table border="1" cellpadding="0" cellspacing="0" style="border-collapse: collapse; border-width: 0" bordercolor="#111111" width="97%">
<tr>
<td width="24%" style="border-style: none; border-width: medium"> </td>
<td width="76%" style="border-style: none; border-width: medium">
Search</td>
</tr>
</table>
<table border="0" cellpadding="0" cellspacing="0" style="border-collapse: collapse" bordercolor="#111111" width="97%">
<tr>
<td width="19%" bgcolor="#CCCCFF"> </td>
<td width="31%" bgcolor="#CCCCFF"> </td>
<td width="25%" bgcolor="#CCCCFF"> </td>
<td width="25%" bgcolor="#CCCCFF"> </td>
</tr>
</table>

<table border="3" cellpadding="0" cellspacing="0" style="border-width:0; border-collapse: collapse; " bordercolor="#111111" width="909" height="1">
<tr>
<td width="303" style="border-style: none; border-width: medium" rowspan="16" valign="top" height="1">


<img border="0" src="Logos%20and%20Backgrounds/star%20bullet.gif" width="18" height="20">
<a href="01.MainMenu.htm">Main
menu</a>

<img border="0" src="Logos%20and%20Backgrounds/star%20bullet.gif" width="18" height="20">
<a href="02.Catalogue.htm">Catalogue</a>

<img border="0" src="Logos%20and%20Backgrounds/star%20bullet.gif" width="19" height="20">
<a href="03.Categories.htm">Categories</a>

<img border="0" src="Logos%20and%20Backgrounds/star%20bullet.gif" width="19" height="20">
<a href="04.ComingSoon.htm">Coming soon</a>

<img border="0" src="Logos%20and%20Backgrounds/star%20bullet.gif" width="19" height="20">
<a href="05.OrderForm.htm">Order form</a>

<img border="0" src="Logos%20and%20Backgrounds/star%20bullet.gif" width="19" height="20">
<a href="06.InThe%20Making.htm">In
the making</a>

<img border="0" src="Logos%20and%20Backgrounds/star%20bullet.gif" width="19" height="20">
<a href="07.InTheBeginning.htm">In
the beginning</a>

<img border="0" src="Logos%20and%20Backgrounds/star%20bullet.gif" width="19" height="20">
<a href="08.InTheNews.htm">In
the news</a>

<img border="0" src="Logos%20and%20Backgrounds/star%20bullet.gif" width="19" height="20">
<a href="09.Queries.htm">Queries</a>

<img border="0" src="Logos%20and%20Backgrounds/star%20bullet.gif" width="19" height="20">


<a href="10.Contact.htm">Contact</a>



<img border="0" src="Logos%20and%20Backgrounds/star%20bullet.gif" width="19" height="20">
<a href="11.Feedback.htm">Feedback</a>

<img border="0" src="Logos%20and%20Backgrounds/star%20bullet.gif" width="19" height="20">
Suggestions

<img border="0" src="Logos%20and%20Backgrounds/star%20bullet.gif" width="19" height="20">
<a href="12.Search.htm">Search</a>
</td>
<td width="1247" style="border-style: none; border-width: medium" height="1" bgcolor="#FFFFFF">


Try looking for you favourite star using this search
facility.


You will need to put the actual name of the person
in and not the character name or where from.


 


 


 

<div align="center">

</div>

 

From your search you will find all the current models in the showpiece collection, if there
are any you would like to order to be made for you then please click on

<a href="05.OrderForm.htm" style="text-decoration: none; font-weight: 700">Order form</a>.



 



Remember, if you can't find the model you are looking for or as you
require, it will be made to your specific order.

 


Click on any name to see photographs and more information including sizes and
guide prices of the model.
</td>
</tr>
</table>

<form action="/cgi-sys/entropysearch.cgi" target=searchwindow>

Search Query <input type="text" name="query" value="" size="20">

<input type="hidden" name="user" value="model">

<input type="hidden" name="basehref" value="http://modelidols.com/Pop-up Zsa Zsa Gabor.htm">

<input type="hidden" name="template" value="default">

<input type="submit" value="Search">

</form>

</body>

</html>

TiGGi

04-18-2006, 11:59 AM

umm no, use your notepad and start new text file and save is as robots.txt at the rot of your website. Crawlers automatcily look for that file and if they dont find it they go about their own business. So again, the code I gave you DOES NOT go into any pages, it goes into the robots.txt file that in the root of your site (same place as your index page)!!!!

Jobquest

04-18-2006, 12:04 PM

Thanks for that - I shall have a play tonight and see how I get on!

Spiderline

04-20-2006, 05:20 PM

The robots.txt though not correct in HTML may not be your only hinder, first check with the Frontpage group for a better understanding of its NOINDEX NOFOLLOW rules it can use on itself. If you have the budget for a hosted search service, I will be happy to help you, I can have it searching EXACTLY how you want, no adds, and designed to appear from your site.

If you need the site searchable, think about a us for a hosted search option www.spiderline.com you get full reporting and the results pages can be edited to never show that they have left the site (no advertising) fees start at only $80 a year.

-Edward