Results 1 to 10 of 10

Thread: Deep Pages Getting Indexed

  1. #1
    Join Date
    Aug 2012

    Deep Pages Getting Indexed

    I need help in understanding how to get deep pages on my site to index.
    My site has over 5.6 million pages, and I've hit a wall trying to get them indexing.

    Can someone help explain methods that can be used to get those pages to index?

  2. #2
    Join Date
    Mar 2011
    First, make sure that the pages are high quality, with much more original content than ads, decorative graphics, and so on. Second, make sure that the site's navigation links are properly formed and that there is a plain HTML <a>nchor tag link somewhere on your site pointing to each page. It's always best to have a hierarchical structure to a website's navigation: the home page links to the major category pages, which link to the sub-category pages, etc. This would be especially true for a site with 5 million pages. Keep in mind that the depth and frequency with which Google crawls a site is largely dependent on PageRank. So you need to insure that sufficient PageRank ("link juice") is flowing throughout your site to get those millions of pages indexed. It would be a good idea to build links to some of the internal pages of such a large site, instead of simply focusing on the site's main page.

    You may never get every single page of your site indexed. For many reasons, you'll need to make sure that the content is original and generally good quality. Good luck!
    Rick Trethewey
    Rainbo Design

  3. #3
    Join Date
    Mar 2011
    here are some steps that will help to get deep internal pages indexed:

    1) Make sure it has significant unique content.
    Search engines may visit but tend not to index low quality pages.

    2) Increase Google toolbar usage
    Google likes to discover pages based on user activity. If your page is great then simply publicize it and get people with Google toolbar to spend time on that page.

    3) Boost unique internal linking
    Add links from your other pages to the internal page. I am not talking about adding to the footer, I am talking about adding unqiue links embedded in relevant content.

    4) Submit sitemap
    It does not hurt to submit a sitemap with all of your pages. It also does not guarantee all of your pages will be indexed. Its easy to do, so why not.

    5) Boost external links
    Develop links from relevant external websites to your deep content. It is ideal to gain links from external websites that are likely to generate traffic.

    ps please remember that almost every website will have some webpages that just never get indexed. this is because almost every website has some very low quality pages that dont need to be indexed. search engines are not looking to index pages that do not add value to their serps.
    *** spam link deleted by moderator - please do not spam this site ***

  4. #4
    Join Date
    Oct 2011

    Thumbs up

    Quote Originally Posted by youtalk View Post
    I need help in understanding how to get deep pages on my site to index.
    My site has over 5.6 million pages, and I've hit a wall trying to get them indexing.

    Can someone help explain methods that can be used to get those pages to index?
    If you owe million pages in website, then you must have to proper formation of sitemap that will be understandable by search engines to know how do you make a hierarchy for internal deep pages. A Single sitemap contain max. 50,000 web links. I think you know!

    This is the best way to tell you search engines to crawl and index your deep pages. [using sitemap]

  5. #5
    Join Date
    Aug 2012
    Nj, US
    do quality content for your pages.
    do internal linking strong.
    do proper optimization.
    Use PPC it will very helpful for indexing. once all pages are indexed then stop ppc and do organic seo only

  6. #6
    Join Date
    Aug 2012
    When everyone says to setup internal linking, doesn't all my pages already link internally?
    As you punch into each page, another link will take you to the next page.
    Isn't that internal linking?

    Please explain this a little more "I am not talking about adding to the footer, I am talking about adding unqiue links embedded in relevant content."

    Link Juice, can everyone explain this a little further?

  7. #7
    Join Date
    Sep 2012
    Kampala, Uganda
    use compressed sitemaps

  8. #8
    Join Date
    Sep 2012
    When Google schedules the Deep Crawlers to index New URLs and 301 and 302 redirected URLs, just the URLs (not the descriptions) start appearing in search engines result pages when you run the a search.

  9. #9
    Join Date
    Oct 2012
    United States
    The best methods for getting your deep pages indexed is by doing the following preferably in this order

    1. Create / Update your sitemap
    2. Create quality content for your visitors
    3. Encourage them to share, comment and recommend your content on those pages
    4. Google with determine the usefulness of your pages by the number of shares, comments and recommendations it has from other users which will entice them to visit and crawl them regularly

    You can also include do_follow meta tags within your pages to encourage robots to visit your pages ever so often

    By the way, are you using wordpress for your website or is it a custom php job? If its custom then I would consider taking an indepth look at how wordpress handles SEO practices and implement that into your php code. It will help alot!

  10. #10
    Join Date
    Jul 2012
    By creating sitemap,quality content you can index your pages

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
HTML5 Development Center



X vBulletin 4.2.2 Debug Information

  • Page Generation 0.14025 seconds
  • Memory Usage 2,938KB
  • Queries Executed 15 (?)
More Information
Template Usage (33):
  • (1)ad_footer_end
  • (1)ad_footer_start
  • (1)ad_global_above_footer
  • (1)ad_global_below_navbar
  • (1)ad_global_header1
  • (1)ad_global_header2
  • (1)ad_navbar_below
  • (1)ad_showthread_firstpost_sig
  • (1)ad_showthread_firstpost_start
  • (1)ad_thread_first_post_content
  • (1)ad_thread_last_post_content
  • (1)bbcode_quote
  • (1)footer
  • (1)forumjump
  • (1)forumrules
  • (1)gobutton
  • (1)header
  • (1)headinclude
  • (1)headinclude_bottom
  • (10)memberaction_dropdown
  • (1)navbar
  • (4)navbar_link
  • (1)navbar_moderation
  • (1)navbar_noticebit
  • (1)navbar_tabs
  • (2)option
  • (10)postbit
  • (10)postbit_onlinestatus
  • (10)postbit_wrapper
  • (1)spacer_close
  • (1)spacer_open
  • (1)tagbit_wrapper 

Phrase Groups Available (6):
  • global
  • inlinemod
  • postbit
  • posting
  • reputationlevel
  • showthread
Included Files (26):
  • ./showthread.php
  • ./global.php
  • ./includes/class_bootstrap.php
  • ./includes/init.php
  • ./includes/class_core.php
  • ./includes/config.php
  • ./includes/functions.php
  • ./includes/functions_navigation.php
  • ./includes/class_friendly_url.php
  • ./includes/class_hook.php
  • ./includes/class_bootstrap_framework.php
  • ./vb/vb.php
  • ./vb/phrase.php
  • ./includes/functions_facebook.php
  • ./includes/functions_calendar.php
  • ./includes/functions_bigthree.php
  • ./includes/class_postbit.php
  • ./includes/class_bbcode.php
  • ./includes/functions_reputation.php
  • ./includes/functions_notice.php
  • ./packages/vbattach/attach.php
  • ./vb/types.php
  • ./vb/cache.php
  • ./vb/cache/db.php
  • ./vb/cache/observer/db.php
  • ./vb/cache/observer.php 

Hooks Called (73):
  • init_startup
  • friendlyurl_resolve_class
  • init_startup_session_setup_start
  • database_pre_fetch_array
  • database_post_fetch_array
  • init_startup_session_setup_complete
  • global_bootstrap_init_start
  • global_bootstrap_init_complete
  • cache_permissions
  • fetch_postinfo_query
  • fetch_postinfo
  • fetch_threadinfo_query
  • fetch_threadinfo
  • fetch_foruminfo
  • load_show_variables
  • load_forum_show_variables
  • global_state_check
  • global_bootstrap_complete
  • global_start
  • style_fetch
  • global_setup_complete
  • showthread_start
  • showthread_getinfo
  • strip_bbcode
  • friendlyurl_clean_fragment
  • friendlyurl_geturl
  • forumjump
  • cache_templates
  • cache_templates_process
  • template_register_var
  • template_render_output
  • fetch_template_start
  • fetch_template_complete
  • parse_templates
  • fetch_musername
  • notices_check_start
  • notices_noticebit
  • process_templates_complete
  • friendlyurl_redirect_canonical
  • showthread_post_start
  • showthread_query_postids
  • showthread_query
  • bbcode_fetch_tags
  • bbcode_create
  • showthread_postbit_create
  • postbit_factory
  • postbit_display_start
  • postbit_imicons
  • bbcode_parse_start
  • bbcode_parse_complete_precache
  • bbcode_parse_complete
  • postbit_display_complete
  • memberaction_dropdown
  • tag_fetchbit
  • tag_fetchbit_complete
  • forumrules
  • navbits
  • navbits_complete
  • build_navigation_data
  • build_navigation_array
  • check_navigation_permission
  • process_navigation_links_start
  • process_navigation_links_complete
  • set_navigation_menu_element
  • build_navigation_menudata
  • build_navigation_listdata
  • build_navigation_list
  • set_navigation_tab_main
  • set_navigation_tab_fallback
  • navigation_tab_complete
  • fb_like_button
  • showthread_complete
  • page_templates