Web Intelligent Solutions
EnglishRomana
font size Increase font size Default font size Decrease font size
screen size Narrow screen resolution Wide screen resolution Auto adjust screen size


Lost Password?
No account yet? Register
Your cart is empty.

Home arrow IT Glossary
IT Glossary - web crawler
You can always search for entries (regexp permitted).
Begins with Contains Exactly matches
All | A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | R | S | T | U | V | W | X | Y

web crawler

Computer robot programs, referred to sometimes as "crawlers" or "knowledge-bots" or "knowbots" that are used by search engines to roam the World Wide Web via the Internet, visit sites and databases, and keep the search engine database of web pages up to date. They obtain new pages, update known pages, and delete obsolete ones. Their findings are then integrated into the "home" database. Most large search engines operate several robots all the time. Even so, the Web is so enormous that it can take six months for spiders to cover it, resulting in a certain degree of "out-of-datedness" (link rot) in all the search engines.

Source: www.lib.berkeley.edu
All | A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | R | S | T | U | V | W | X | Y
  • Cristi worked on a Mambo web project for our company web site and we were ecstatic with his dedication and professionalism with the project. We…
  • "Prompt, serious, well organized, strongly recommended"
    (Sorin Fianu, Scientific Secretary)
  • "Excellent products, at very competitive prices, backed up with great support when needed. A top choice!"
    (Alec Ionescu, Manager)
  • Va trimitem prezenta scrisoare pentru a va multumi pentru promptitudinea si rapiditatea cu care ne-ati raspuns cerintelor noastre. Apreciem calitatea serviciilor dumeavoastra, calitatea modului in…
  • The WISro Yahoo Quotes component is a very powerful add-on and exactly the addon we were looking for.It was very easy to install and easy…
Follow us on Twitter here Connect on Facebook