What are Spiders, Robots and Crawlers and what are their functions?

Discussion in 'SEO & Traffic Discussion' started by oorjaclinic, Mar 20, 2017.

  1. oorjaclinic

    oorjaclinic New Member

    Joined:
    Feb 4, 2017
    Messages:
    26
    Likes Received:
    1
    Trophy Points:
    3
    Gender:
    Male
    What are Spiders, Robots and Crawlers and what are their functions?
     
    #1
  2. KingBong

    KingBong New Member

    Joined:
    Sep 22, 2016
    Messages:
    15
    Likes Received:
    2
    Trophy Points:
    3
    Gender:
    Male
    There are a million different bots but from what I know spiders and crawlers are designed to scan websites and extract date from them
     
    #2
  3. Creepy

    Creepy Member

    Joined:
    Oct 19, 2016
    Messages:
    45
    Likes Received:
    1
    Trophy Points:
    8
    Gender:
    Male
    Spiders, Robots and Crawlers all are same these are automated software programme search engine use to stay up to date with web activities and finding new links and information to index in their database. Search engines need to keep their database updated so they created some automated programmes which goes from site to site and find the new data for search engine also collects the information about the web page what is the page all about.
     
    #3
  4. LordLima

    LordLima Member

    Joined:
    Nov 2, 2015
    Messages:
    34
    Likes Received:
    1
    Trophy Points:
    8
    Spiders and Crawlers are specific type of Robots (Bots). Bot is a general name for all automated activities.
     
    #4
  5. nickchernets

    nickchernets Member

    Joined:
    Mar 14, 2017
    Messages:
    53
    Likes Received:
    1
    Trophy Points:
    6
    Gender:
    Male
    It will be great if you specify for what reason are you asking, it will help us to find out the best answer for you
     
    #5

Share This Page