www.webdeveloper.com
Results 1 to 11 of 11

Thread: what is difference between spider, crawler and robots?

  1. #1
    Join Date
    May 2013
    Posts
    119

    what is difference between spider, crawler and robots?

    Hi friend,
    Please tell me what is difference between spider, crawler and robots? share your feedback.
    thanks for any reply.

  2. #2
    Join Date
    May 2013
    Location
    chennai
    Posts
    43
    Hi guys,

    Spider - The browsers are like a program and to download the web page.

    Crawler The program is automatically to follow the links are web page..

    Robots - It had automated computer program can visit websites. It will guided by search engine algorithms It can combine the tasks of crawler & spider helpful of the indexing the web pages and through the search engines.

  3. #3
    Join Date
    Feb 2012
    Posts
    83
    All these are same only( its a program developed by search engine). People used to call in a different names that's it.

  4. #4
    Join Date
    Jun 2012
    Location
    vincewicks
    Posts
    43
    A spider is a program run by a search engine to build a summary of a website’s content (content index). Spiders create a text-based summary of content and an address (URL) for each webpage.

  5. #5
    Join Date
    Sep 2012
    Posts
    720
    Spider Scan and judge you website content ,Crawler crawl you content and index it in there searches according to Inbound links both techniques helps google to judge importance of website in terms of ranking ,robot.txt file is that file which is included into web coding so that google not consider it in crawling or to hide page from google crawling .

  6. #6
    Join Date
    May 2013
    Location
    Shanghai,China
    Posts
    5
    i see.Spider Scan and judge you website content ,Crawler crawl you content and index it in there searches according to Inbound links both techniques helps google to judge importance of website in terms of ranking ,robot.txt file is that file which is included into web coding so that google not consider it in crawling or to hide page from google crawling .

  7. #7
    Join Date
    Apr 2013
    Location
    Indore
    Posts
    46
    All three are Google software that visit the website and put detail in their database it frequently visit website and update their database if you make some change on your websites.
    iNeedname.com :- Find Domain Name via Gtalk

  8. #8
    Join Date
    May 2013
    Posts
    41
    Spiders is a name for the robots or crawlers that scan web and save the information in websites to a database. Hence, "Google spiders" is another name for "Google indexing bots".

  9. #9
    Join Date
    May 2013
    Location
    Surendranagar Gujarat India
    Posts
    55
    Hi

    I have found these definition

    Spider - a browser like program that downloads web pages.

    Crawler – a program that automatically follows all of the links on each web page.

    Robots - An automated computer program that visit websites & perform predefined task.


    Kishor Makwana
    Software Engineer
    Insight Softech
    www.insightsoftech.com

  10. #10
    Join Date
    Apr 2013
    Location
    Bangalore
    Posts
    412
    Spiders create a text-based summary of content and an address (URL) for each webpage.
    Crawler is a program that automatically follows all of the links on each web page.
    Robots is An automated computer program that visit websites & perform predefined task.

  11. #11
    Join Date
    Feb 2013
    Location
    Mississauga, Canada
    Posts
    152
    Spider - a browser like program that downloads web pages.

    Crawler – a program that automatically follows all of the links on each web page.

    Robots - An automated computer program that visit websites & perform predefined task. They are guided by search engine algorithms & are able to perform different tasks instead of just one crawling task. They can combine the tasks of crawler & spider together and help in indexing and ranking of websites on any particular search engine.
    *** spam signature deleted by moderator - please do not put it back ***

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
HTML5 Development Center



Recent Articles