www.webdeveloper.com
Results 1 to 6 of 6

Thread: How do I search through one web site?

  1. #1
    Join Date
    Oct 2003
    Posts
    11

    How do I search through one web site?

    I have a file containing web site names. I wish to create a program that will search each web site that I have listed in my file for a keyword. Does anyone have any idea how to do this?

  2. #2
    Join Date
    Nov 2002
    Location
    Auburn, AL
    Posts
    9,224
    You do not create a 'program'. You will be using a server side language and search through an array / dataset / data base. There are a few different search algorythms (binary search is the first that comes to mind), then you can also sort the data by the number of times a keyword appears in a block of text using regex etc. But you are going to need a server side language ot do all of this. You can search the content of each website as I descibed above, you just have to get the source of the site through the server, which is not super hard. You can also just use a google site search thingy.

  3. #3
    Join Date
    Jan 2004
    Location
    Melbourne, Australia
    Posts
    5,298
    You do not create a 'program'.
    That is a program.. Anything which tells a computer to perform certain operations is a program.

    Regards,
    Andrew Buntine.

  4. #4
    Join Date
    Oct 2003
    Posts
    11
    Originally posted by PeOfEo
    You can search the content of each website as I descibed above, you just have to get the source of the site through the server, which is not super hard. You can also just use a google site search thingy.
    How do I read the source of a website and the source of all the web pages associated with that website? I have no idea.

  5. #5
    Join Date
    Jan 2004
    Location
    Melbourne, Australia
    Posts
    5,298
    Each language has differing methods. Have you got any programming experience to work from?

    Your best bet would be to use XML or XPATH. But it can also be done in most server-side languages.

    Regards,
    Andrew Buntine.

  6. #6
    Join Date
    Nov 2002
    Location
    Auburn, AL
    Posts
    9,224
    well with my server side language of choice, asp.net, I would either just read the file (assumeing it is a local file) like a text file, or I would use system.net.sockets to get the remote source.
    http://articles.************.com/p/a..._2/ai_95540470 is actually on parsing remote documents. You could also play with some xml with the scripting


    with asp I might do something like this... I have no idea what this article is saying, but I dug it up
    http://www.aspfree.com/c/a/ASP/Getti...ages-with-ASP/
    That is a program.. Anything which tells a computer to perform certain operations is a program.

    Regards,
    Andrew Buntine.
    For our purposes we should make a distinction. Program should be kept to executable application. Because the term application can be used for a website or for an executable, and now program too? Please, lets make a distinction... you are going to confuse me if we dont

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
HTML5 Development Center



Recent Articles