dcsimg
www.webdeveloper.com
Results 1 to 2 of 2

Thread: Virtual Directories and robot.txt file

  1. #1
    Join Date
    Nov 2002
    Location
    London UK
    Posts
    154

    Virtual Directories and robot.txt file

    Hi all,

    I was about to set up a robot.txt file (which I know doesn't guarantee anything by the way) when I was unsure how to exclude files located within a Virtual Directory. I mean do I use the path with the alias or do I use the real physical path? I'm assuming the alias would be fine, but I'm not 100% sure, can anyone help?

    Cheers

  2. #2
    Join Date
    Nov 2002
    Location
    London UK
    Posts
    154
    Ok maybe I haven't explained myself properly, so here goes again. I have a robot.txt file. Now this file is used to tell search engine bots indexing my site not to index anything on the paths listed within the file. A typical file may look like this:

    user-agent: *
    disallow: /cgi-bin/
    disallow: /games/images/
    disallow: /members/info.html
    disallow: /staff/login.aspx

    Now the paths I want to disallow include a virtual directory. So the path isn't the normal physical path. So for instance I have a physical path like this:

    main/staff/details/

    Which I have set up as a virtual directory with the alias msd. Now normally to get to a page here you would enter the physical path for example:

    main/staff/details/apage.html

    but as I have set up a virtual directory I can use this path instead:

    msd/apage.html

    So what I want to do is disallow indexing on files located in a virtual directory. My question is I suppose, do search engine bots understand paths that include virtual directories? Do you get me now???

    Cheers

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
HTML5 Development Center



Recent Articles