My questions are....
1. Is php affecting the crawl? If so, what can I do to get the robots to crawl php.
2. I have a robots.txt file, is there anything else i should have
3. Even though they have crawled my first page, I still am not showing up on any search results. Why?
4. Is there any other method I should consider to move up the ranks? (besides paid advertising)
Most people do not need the meta robots tag on their web pages. Having it on a web page does not help the page get indexed in any way. In fact, the tag is mainly used as a way to keep your web pages out of the search engines. Nor does it even work well for this, since most major search engines do not support it.
It tells search engines to index the page and follow links to inside pages, so that they can be index. But search engines will do this even without the code, to the same degree that they index any web site. So don't waste your time with it.
Oddly googlebot likes link outs If you have a page on your site
with listings that link out to other sites It actually boosts your ratings.
googlebot likes links in and out of a site only if the sites linking to are relevant
to the content of your site.
i.e. if its a web design site linking to web design related pages helps ranking
andy
Last edited by andyshep; 04-01-2005 at 04:21 PM.
I can remember when the air was clean and sex was dirty.
Google has a nasty habit of only scanning the first page of a new domain it finds. Make sure you get some inbounds links and just to make sure Google finds them, run the address of the page your links reside into Googles AddURL page. Unfortunately, you have to give Google a reason to deep crawl you site. A check also found Yahoo has done the same, home page only. MSN has even found you yet. I'd work on the links.
A remote possibility is that your pages are banned??? Try looking that up by going to google and typing this in "yoursite.com" no http, etc..
Google does NOT only scan the first page of a domain it finds.
If that were true, google would have 0 catalogue entries.. google does not discriminate pages by domain.
"websites" are determined by linking structure, not by ip/url domain etc.
--
Are you making sure that your links make sense?
for example this is a worthy link <a href="/about/index.html" title="about me">About Me</a> Obviously index.html should have appropriate meta and titles etc.. otherwise google has nothing to record.
a crappy link is <a href="/about/inde.html">Read more</a> and then there's nothing in that page for title, etc.
Google does NOT only scan the first page of a domain it finds.
So the fact that only the first page of his site has been indexed doesn't point to that fact? Being banned does not mean your home page appears in Google. Anchor text and title attributes do not contribute to the decision Google makes when indexing a new site. They only assist in the ranking process but what good is that if the majority of your pages aren't listed?
Work on backlinks instead of tweaking internal links on the page as you'll get more immediate benefit. Statistical analysis will force you to amend page copy to suit your market anyway.
Keyword optimisation is a market driven task and will always evolve. You need stats to inform you which keywords people are typing into which search engines so you can amend the primary keyphrases accordingly.
Reply With Quote
Originally Posted by leocharre
Bookmarks