Saturday, April 7, 2012

Putting 1 Trillion in Context

In reading a recent article about Amazon's S3 Cloud service I recalled a conversation with Mickey McManus up at Maya.  We were discussing Big Data last year and the ideas we had about working with ever increases volumes of data.

The Read Write Web article's title I just read was Amazon S3 Showing Signs of Slowing as It Approaches 1 Trillion Objects.  This got me thinking about the conversation with Mickey.  With the US deficit always being discussed in the Trillions these days it is easy not to understand the magnitude of something measured in the trillions.  Here is just something to consider with discussing Trillions of anything:

If you take something that we all deal with, the unit measure of Time, and put that into context I think you will get the picture.  So starting with the basics, 60 seconds = 1 minute; we all know that and it isn't that much time.  So let's scale that up.  What is the amount of time in:

  • 1 Million Seconds = 11.57 days
  • 1 Billion Seconds = 31.7 years
  • 1 Trillion Seconds = 41709 years


41K years, that is a long time ago and allows us have a better understanding what a trillion really means when we start thinking about what the Amazon S3 service is approaching.

The challenge here is the rate at which we are approaching the Trillion object mark.  It is happening very rapidly and almost occurring over the last 2 decades of data, information, and services that are exploding through the Internet.  The question we should start asking ourselves now is how do we handle way beyond the Trillions of anything on the Internet. When a trillion objects are common place.

Today we are all using technologies such as Hadoop, or variants of Hadoop and building massive data centers that deal with complex challenges in cooling and power management and efficiencies.  These are examples of our basic building blocks today.  Evolution in this area will only take us so far.    We as an information society must starting thinking about transformational ideas and completely different technologies if we hope to harness the not so different horizon of 2030.

No comments:

Post a Comment