When I was a child I especially love to read science fiction. Then those books that I believe, in the 21 st century, all the daily chores will by the exterior of the robots like humans into. However, we enter the new one thousand years after, but still see these humble slave machines. Or, robot has quietly into our life. They have no science fiction description of the robot that beautiful appearance. They avoided the understanding of where we OuJiLiDe geometry description of the three dimensional space. 21 th century the robot is invisible, not physical. They live in the virtual world, can to easily from one continent to another across continents, it made us human envy. People staring at the computer screen actually see these robots. But if you take out some time, carefully check the computer log book, and see who has visited the your web pages, you will find they trace. You see that this some robot tirelessly do a human design do not please painfully, most the most boring work: reading 1 million hundreds of thousands of millions of web pages, and to make the index.

These robot design, is the intent of the high speed and high efficient a they are on the world wide web one fast after a sports car they link, sniffer along the road. And these machine device, ZhengHaoXiong design than that used to draw a map of the world wide web robot is like an ordinary little beetle, but I still like it very much. It’s like a personal life buy the first car, will be affected by the favour of special master. Although this web robot almost every other day will crash, but also often inadvertently put refused to network access web robot take home.

We soon found the little engine design with we draw the world wide web map is an Lenovo L510 battery impossible dream. Although it is often wrong, often strike, but eventually display to 300000 pages, with it’s enough to make we found the world wide web is a scale-free network. In this stage, we had closed its maybe a little early a. If we allow it to collect more the world wide web, might be the sample found the complex network of some other characteristics. For the world wide web, search engine view more than we found that the scope of the. Study of these huge sample study I have made a some exciting discovery. They found that the world wide web has cracked into different mainland and community, this limited us in the network world behavior. But they again from phase spear said the world wide web and many shield were found in the area, was never any visitor and network robot visited that land. The most important is, we know, ten thousand d nets structure from the net surfing to seven for democratic system, such as in effect.

Only a few years ago, we think we have to understand all of the world wide web. When there are some very popular way, such as “if use six Fletcher search words, may not online doesn’t exist this information”; Or “901801 is the first to to the whole network? Indexing network robots”. We were so trust search engine, think that they can tell us everything of the world wide web. But # 1998 to April, all this suddenly changed. When a major search engines spokesman said: “we pay more attention to the quality of the index, not quantity.” Another? Some web sites, said: “there are some further page is just not worth the index”. Exactly what the problem is? This kind of attitude u-turn, is born on 3 April 1998 science magazine published a research paper. The three pages of paper, the change of the Fletcher we stored in on the world wide web information ability shaw confidence.

The author Steve “Lawrence false blinked and lee (false) giles write this essay also is not to doubt the credibility of the search engine. They post in Japan electrical company based in Princeton, New Jersey, both the institute of machine learning ability, this is interested in computer science FangXing–not a new topic. They designed a yuan search engine, also is a network called “I call the robot, 11 ^”, the robot can 13 according to a search query each major search engines conditions website. Work done half later, they realized that the robot can still finish design not think of work: help them an estimated ten thousand d nets of scale.

I call for several search engines contains a particular enumerate the words which have the documents, such as 0, assist (crystal, if each search engine in the network can access all the documents and index, then they return is inevitably the same document list. And in fact, different search engines to return to list but few have the same. However, the total have overlap between list. For example, in eight find the word contains 1000 documents, 343 also observed in 901801 to return to search list. With overlapping document obtained by PA3285U-1BRS battery dividing the number of people return back to the total number of document, it has received 901801 contains the ratio of the document. According to report way, in December of 1997index number of documents for 1. 100 million, the Japanese electrical male department (the team estimated at that time) of the world wide web page number is always 1 million 110/0.343, or 320 million documents. Now the number is not very big. But in 1997, the plan Bi than the most accurate estimation results also big 1 times.

1998 years ago, about the size of the world wide web, we believe that the search engine tell us everything. They are, after all, should know about these. Lawrence and giles do similar research shows that need milestone on the world wide web for scientific research in a world wide web that can and should be through the system, can reproduce the way of the inquiry. However they on search engine in the draw maps of the world wide web ability, but let us send now cover and not get up.