<?xml version="1.0" encoding="UTF-8"?><rss version="0.92">
<channel>
	<title>G2 Crawler News</title>
	<link>http://crawler.trillinux.org/news</link>
	<description>G2 Crawler News</description>
	<lastBuildDate>Fri, 13 Jan 2012 05:00:17 +0000</lastBuildDate>
	<docs>http://backend.userland.com/rss092</docs>
	<language>en</language>
	<!-- generator="WordPress/3.1.2" -->

	<item>
		<title>Updated G2 Network Map</title>
		<description><![CDATA[I updated the G2 Network Map. It now contains data from February 2009 to January 2012. In total the crawler has collected 2.9 million unique hub IP addresses and 105 million unique leaf IP addresses. The code I wrote for creating the map is published on github at IPv4 Heatmap source code. If you have [...]]]></description>
		<link>http://crawler.trillinux.org/news/2012/01/13/updated-g2-network-map/</link>
			</item>
	<item>
		<title>G2 Network Map</title>
		<description><![CDATA[So it&#8217;s been nearly a year since the last post. For the most part the crawler website has stayed the same with only the occasional bug fix as necessary. However I have continued to experiment with new ideas and I am taking advantage of the more powerful computer to open up new possibilities. One such [...]]]></description>
		<link>http://crawler.trillinux.org/news/2011/06/07/g2-network-map/</link>
			</item>
	<item>
		<title>A Quick Update</title>
		<description><![CDATA[I purchased a new computer recently to replace several of my old ones. Two computers in particular were responsible for retrieving graph data and plotting graph data respectively. The new system has a slightly different Munin configuration because I switched from Debian to Ubuntu. So the graph colors will be different. Also some of the [...]]]></description>
		<link>http://crawler.trillinux.org/news/2010/07/10/a-quick-update-2/</link>
			</item>
	<item>
		<title>A different way to look at the network</title>
		<description><![CDATA[Since the middle of August the crawler has been recording the time when hubs join and leave the network. This allows for certain time based trends to be realized. The hub is identified by its IP address. One way to visualize a set of IP addresses is with the Hilbert curve which was made popular [...]]]></description>
		<link>http://crawler.trillinux.org/news/2009/10/09/a-different-way-to-look-at-the-network/</link>
			</item>
	<item>
		<title>Two new experimental features</title>
		<description><![CDATA[A few weeks ago two new features were released. The first is a world map view of the country page and the second shows how the network size changes over time. World Map The world map shows two different data sets. Red circles represent where hubs say they are located. The size of the circle [...]]]></description>
		<link>http://crawler.trillinux.org/news/2009/10/03/two-new-experimental-features/</link>
			</item>
	<item>
		<title>Network size</title>
		<description><![CDATA[The network size is now featured on the front page once again. When the new crawler was implemented that statistic had to be dropped because it was too resource intensive to calculate with how the new crawler worked. But now that issue has been resolved. Some background The number of leaves on the network isn&#8217;t [...]]]></description>
		<link>http://crawler.trillinux.org/news/2009/05/25/network-size/</link>
			</item>
	<item>
		<title>A Quick Update</title>
		<description><![CDATA[I haven&#8217;t made a post in awhile so I thought I should. Not much is going on with the crawler right now. I&#8217;ve been pretty busy lately and haven&#8217;t had any time to spend on improving the crawler. However there were a few subtle updates to many of the webpages. More detailed descriptions were added [...]]]></description>
		<link>http://crawler.trillinux.org/news/2009/02/12/a-quick-update/</link>
			</item>
	<item>
		<title>The Architecture of a Crawler</title>
		<description><![CDATA[I&#8217;m going to explain how crawlers work. There are three main tasks that a crawler has to take care of. Find new hosts to crawl. Request data from a host that is being crawled. Display to the user the data gathered. This design lends itself well to being distributed. Several host crawlers (those that perform [...]]]></description>
		<link>http://crawler.trillinux.org/news/2008/11/01/the-architecture-of-a-crawler/</link>
			</item>
	<item>
		<title>Recent Updates</title>
		<description><![CDATA[My focus lately has been on hub uptimes. There is a new page showing hub uptime distribution graphs. It gives a visual representation of some of the categories on the uptimes page. The overall hub uptime distribution graph also features two vertical lines. The red line shows where the average hub uptime is and the [...]]]></description>
		<link>http://crawler.trillinux.org/news/2008/10/19/recent-updates/</link>
			</item>
	<item>
		<title>Quick g2paranha update</title>
		<description><![CDATA[The crawler has been running pretty well with only minor tweaks from day to day which sometimes show up as blips in the graph. It was also down for a few days due to a failing hard drive. Yesterday the crawler got into the Foxy network again which uses the same protocol as G2 but [...]]]></description>
		<link>http://crawler.trillinux.org/news/2008/07/10/quick-g2paranha-update/</link>
			</item>
</channel>
</rss>

<!-- Dynamic Page Served (once) in 0.322 seconds -->

