• News The latest G2 crawler news.
• Network size Rolling size of network.
• Countries Hubs classified by country.
• Versions Hubs classified by version.
• Vendors Hubs classified by G2 technology provider.
• Density Histogram of leaves distribution.
• Uptimes Tables of observed uptimes.
• Uptime Graphs Histograms of observed uptimes.
• Names List of nicknames.
• Status Statistics about the crawler.
• Experimental Experimental features that are in the works.

Recent News

• The Architecture of a Crawler

  I’m going to explain how crawlers work. There are three main tasks that a crawler has to take care of. Find new hosts to crawl. Request data from a host that is being crawled. Display to the user the data gathered. This design lends itself well to being distributed. Several host crawlers (those that perform task 2) can all [...]

  Posted on 1 November 2008 | 11:25 am

• Recent Updates

  My focus lately has been on hub uptimes. There is a new page showing hub uptime distribution graphs. It gives a visual representation of some of the categories on the uptimes page. The overall hub uptime distribution graph also features two vertical lines. The red line shows where the average hub uptime is and the [...]

  Posted on 19 October 2008 | 11:03 am

• Quick g2paranha update

  The crawler has been running pretty well with only minor tweaks from day to day which sometimes show up as blips in the graph. It was also down for a few days due to a failing hard drive. Yesterday the crawler got into the Foxy network again which uses the same protocol as G2 but is [...]

  Posted on 10 July 2008 | 7:55 pm

• g2paranha - The New G2 Crawler

  Anyone who has read through this blog knows that the crawler has tended to crash fairly often. In recent times it was crashing to much to even continue running it. But rather than give up entirely I decided to write my own crawler. Five weeks later and g2paranha has emerged. To go along with the [...]

  Posted on 23 June 2008 | 12:04 am

The crawler stats are updated every 5 minutes.

All times are UTC-05:00