Click to See Complete Forum and Search --> : Solutions for having dynamic pages crawled by search engines?
mmendo
09-26-2006, 03:48 PM
Hi there,
I need advice on having my website's 3000+ dynamic .asp pages crawled and cataloged by search engines. Is there a way to create links that don't have the characters that turn crawlers away such as ? % etc etc? Or should I be taking a different approach? Any advice is appreciate!
Thanks,
Nicole
Searching Google with "search engines", "dynamic pages" turns up quite a bit of entires.
knowj
09-26-2006, 07:15 PM
iv had alot of my dynamic pages picked up by search engines (generally if they have links they get crawled)
one thing i would suggest is looking into mod-rewrite/url rewrite if you goggle it you will get alot of information
ericindc
09-28-2006, 03:02 PM
I'd actually like to address this too. My blog currently queries a database to pull entries. I've noticed Google will hit on some, but not older archive entries. Would it be beneficial to create static pages of each that could be indexed?
http://www.xyz.com/allposts/post1.html
http://www.xyz.com/allposts/post2.html
And then have Apache's mod_rewrite catch on "allposts" to dynamically load the requested content? Would that suffice as a means to keep my content indexed even when removed from my blog?
Thanks.
jasondmce
09-29-2006, 01:29 PM
Google crawls dynamic pages. Here's a link that might be usefull.
http://www.google.com/support/webmasters/bin/answer.py?answer=34431&query=dynamic%20pages&topic=&type=
If your pages aren't being indexed, try Google Site Maps
Boston Website Design (http://www.pinbottle.com)