Click to See Complete Forum and Search --> : Review needed because.....


pcs800
09-12-2005, 07:38 PM
Google refuses to index my site, and I thought maybe someone here would have a clue why.
Site is www.mp3j.us
Thanks

CyCo
09-12-2005, 08:39 PM
It may be due to you having an invalid webpage (http://validator.w3.org/check?uri=http%3A%2F%2Fwww.mp3j.us%2F).

pcs800
09-12-2005, 08:48 PM
I don't think so because I have done research enough to see a load of invalid sites that ARE indexed.

bathurst_guy
09-12-2005, 09:16 PM
Well
1. Your site took ages! for me to see, and I'm on broadband, maybe the bot timesout...
2. You dont have a robots.txt, this does help with them
3. Have you been visited by the googlebot in the first place?*
4. "Google refuses to index my site" did you get an email from them stating this? Otherwise the bot isn't up to your site yet
5. How many other sites are linking to yours?*
*this information can be seen via your stats

pcs800
09-12-2005, 09:28 PM
googlebot is there every day, many times.
We have plenty of links coming in, but do not use link exchange software anymore because it seems to do more bad than good.
We have decent ranks in yahoo and msn, just don't understand why google won't index it.
No they did not tell me that, I just assume after 6 months of trying that they don't like it, especially since their robot is there every day.

pcs800
09-12-2005, 09:30 PM
the reason it took ages to load was probably because I am uploading and downloading huge files right now to it. Sorry to send you there at an inconvenient time.

bathurst_guy
09-12-2005, 09:43 PM
well i dont know how the googlebot was coded so we cant really help, but using a tableless design and validating does help the bots.

pcs800
09-12-2005, 10:48 PM
yeah, i know. I have other sites that are built like that. But I also see plenty of sites with tables and bad code that are doing just fine.

KDLA
09-13-2005, 09:22 AM
You need this:
<meta name="Robots" content="Index, Follow" />

Tables layout also hinders search engine indexing. Your content coding is buried in the table tags, not being listed until about halfway down the page. This is probably only a miniscule part of the problem, but it still contributes.

Visit http://www.google.com/intl/en/webmasters/ for more information about Google indexing.

Good Luck -
KDLA

pcs800
09-13-2005, 09:40 AM
Didn't realize there was no robots.txt, thanks for pointing that out.
I put the tag in the index.dat which defines the head of each page.
Thanks.

mdoigny
09-14-2005, 02:08 PM
Took some 25 seconds to download (after "connect" and before the page displays) for some 20k
Because you are using tables, the page doesn't display until the complete table is available.

The server used is not sending a content-length header!!! (can cause Google not to index your site and a user agent to display the page very slowly).

Your headers: http://web.verfaillie.com/cgi-bin/gap?www.mp3j.us
Speed and page analysis (still beta): http://web.verfaillie.com/cgi-bin/site?www.mp3j.us

pcs800
09-14-2005, 06:33 PM
what is a content header length? How can I fix that?

mdoigny
09-15-2005, 03:11 AM
Normally it's provided automatically by the webserver.
Check your configuration, it's mandatory "... should ..." if there is no transfer-encoding: chunked

http://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html (halfway document)

hansons
09-15-2005, 08:00 AM
i have seen ur website........it looks nice......

pcs800
09-15-2005, 08:34 AM
I was looking at the source of the page and found that it had two head sections and two body section. The fault of a php include i had in there.
That is fixed now and the page DL time has dropped dramatically.
I'm sure the engines did not like that.

pcs800
09-15-2005, 08:36 AM
BTW the guy running the server is looking into what you have told us, thanks.

pcs800
09-15-2005, 08:40 AM
ok, thanks hansons

pcs800
09-15-2005, 09:35 AM
Took some 25 seconds to download (after "connect" and before the page displays) for some 20k
Because you are using tables, the page doesn't display until the complete table is available.

The server used is not sending a content-length header!!! (can cause Google not to index your site and a user agent to display the page very slowly).

Your headers: http://web.verfaillie.com/cgi-bin/gap?www.mp3j.us
Speed and page analysis (still beta): http://web.verfaillie.com/cgi-bin/site?www.mp3j.us


We fixed the slow download time (we think) And the part about the content length headers..... if you go here http://web.verfaillie.com/cgi-bin/site?www.woodlotinnovations.com it is fine, but replace the woodlotinnovations with mp3j.us and you get the error. The difference is that any site on our server that is dynamic or uses php errors out, but the static html sites do not.
What's up with that and how do we fix it?