The article by Kevin Kelly in today’s New York Times Magazine is a masterful explanation of the impact on knowledge that will evolve from the inevitable digitizing of all of the books ever written. And that is just he first half of the article. The second half of this outstanding essay, called Scan This Book!, explains the hurdles and confusions of the copyright chaos now engulfing creative publication. An irony of the article is that it will itself only be a part of the open content it explains for the few days during which it is available without payment to the New York Times Archives.
Scanning technology has been around for decades, but digitized books didn’t make much sense until recently, when search engines like Google, Yahoo, Ask and MSN came along. When millions of books have been scanned and their texts are made available in a single database, search technology will enable us to grab and read any book ever written. Ideally, in such a complete library we should also be able to read any article ever written in any newspaper, magazine or journal. And why stop there? The universal library should include a copy of every painting, photograph, film and piece of music produced by all artists, present and past. Still more, it should include all radio and television broadcasts. Commercials too. And how can we forget the Web? The grand library naturally needs a copy of the billions of dead Web pages no longer online and the tens of millions of blog posts now gone — the ephemeral literature of our time. In short, the entire works of humankind, from the beginning of recorded history, in all languages, available to all people, all the time.
This is a very big library. But because of digital technology, you’ll be able to reach inside it from almost any device that sports a screen. From the days of Sumerian clay tablets till now, humans have “published” at least 32 million books, 750 million articles and essays, 25 million songs, 500 million images, 500,000 movies, 3 million videos, TV shows and short films and 100 billion public Web pages. All this material is currently contained in all the libraries and archives of the world. When fully digitized, the whole lot could be compressed (at current technological rates) onto 50 petabyte hard disks. Today you need a building about the size of a small-town library to house 50 petabytes. With tomorrow’s technology, it will all fit onto your iPod. When that happens, the library of all libraries will ride in your purse or wallet — if it doesn’t plug directly into your brain with thin white cords. Some people alive today are surely hoping that they die before such things happen, and others, mostly the young, want to know what’s taking so long. (Could we get it up and running by next week? They have a history project due.)