PHP building a search engine

[Solaar]

Hi, not sure whether this post belongs in the PHP forum or not but anyway...

I have to build a specialised search engine and want to know the best way to process large volumes of random pages from the web. I have no prior SE building knowledge and therefore little idea as how to proceed. Basically I need to index pages in a particular way which seems to be the easy part, I just don’t know how to get the pages off the web in the first place. I have looked on the web and most of the info there refers to intranets or large sites where the location of pages is assumed to be known. A vague and naïve question but hopefully you get he nub of my gist.

[Compguy Pete]

Here is my suggestion...

I would outsource the project. Surely you would learn a ton by doing this... however how many setbacks and other issues are you going to run into by doing this on your own.

I've outsourced plenty of projects in the past that were just beyond what I have neither the time or the knowledge for.

Play it safe look for someone to help out.

[gooyahpost.com]

Here is my search engine: http://www.gooyah.net

What type of information are you looking to pull?

Are you looking to pull just from the web or from your own web site?

[svetta]

Don’t rack your brains over this. Try this...
http://www.orbitscripts.com/smartppc_power_overview.html