Is the open source community capable of innovation?

The Linux community has done a good job of copying Windows. Open Office does a pretty good job of copying Microsoft Office. Now there are open source versions of YouTube and MySpace. But where is the innovation? Firefox and its multitude of plugins seems to be the one exception. Meanwhile, companies like Apple – a company that is incredible closed, and secretive has created one innovative product after another. Why is this?

  • Do too many cooks spoil the open source stew and lead to a natural conservatism?
  • Do people save their really good ideas for patents, copyrights, and ultimately some plan for profit?
  • Is the open source community not as dedicated (since I’m guessing it is not their full time job to write free software)?
  • Is the open source community not as talented? Has Microsoft, Apple, and Google hired away all the talent?
  • Is it a resource issue?
  • Or is there some other flaw with how open source works that stifle innovation?

I have been looking at how communities like digg, slashdot, wikipedia, and other smaller forums operate. There does seem to be a conservative nature to large crowds. Mainly because the urge to contribute is high. So high, that people want to comment or tweak something even if they have no real expertise. Another issue is that as soon as some one mentions a novel or creative idea, there are 50 people eager to chime in with why its a bad idea. The burden then falls on the innovator to defend their idea. Without sources or previous examples they can cite (we are talking about innovation after all), the idea simply drowns beneath an ocean of criticism. Anyone surveying the discussion will conclude the idea was shot down.

This is all just speculation on my part. It will take more than just a few case studies to uncover any true underlying pattern.

Download a backup of wikipedia to your laptop or local lan

Yesterday I downloaded Wikipedia – All of 2,120,684 English articles of it are now on my hard drive.
A few stats for the curious (for the English version only):

  • Date of last edit: April 2007 (A September backup is still in progress)
  • Compressed size: 7.19 GB
  • Number of files compressed: 9
  • Number of files decompressed: millions
  • Decompressed size: ~100 GB
  • Time to download: 8 hours
  • Time to decompress: 10 hours

Why on earth would you do this?

  • The more versions of Wikipedia exist in the world, the less the chance it will get lost if something really depressing happens
  • Having a local version means you can look things up offline
  • Local versions can be used in corporate firewalls to give users access without granting full access to the web
  • Local files can be parced by scripts to create reports and study the structure, trends, and patterns
  • umm..its cool…do I really need a reason to want all the world’s collective knowledge on my laptop

Most people interested in this won’t have any problem downloading the compressed files. But few people have 100 GB free on their laptop. If you decompress the files to an external usb hard drive, it can take 30 hours per file (multiply times 9 files). Still, that is not too bad. You can buy 2.5″ laptop drives now that have 300gb and 3.5″ drives that are 1000 GB. The only problem is that decompressing the time it takes (10+ hours!)

Wikipedia is growing…fast.
Last year (Dec 2006) total compressed size of the English version was version only 5.8 GB. By April 2007 (just 4 months later) it was 7.2 GB (this is the version I downloaded). I am waiting to see what the September version will be. How fast is Wikipedia growing? It is hard to say. The last stats I found are for July 2006 but it was definitely on an exponential curve.


http://download.wikimedia.org/

http://static.wikipedia.org/downloads/December_2006/en/

New Javascript Library for dates

Datejs is a simple, fast and very powerful way to add a date picker to your site that accepts all sorts of relative date strings and turns them into standardized date objects. The user can type any think like “tomorrow” or “last November” and Datejs will translate that string into a date format you can pass through for server side processing.

http://www.datejs.com/

Design, Paint, and Pimp out you credit card


About a year ago I switched over to Bank of America. Since then, when I go out to lunch or dinner with friends I’m always regretting that I have such a boring credit card. In a large group there is always multiple people with the same card. Where is the individuality? As a creative person this really bothered me. So I decided to take matters into my own hands.
Continue reading

Google Trends API coming soon

Google is planning to release an application programming interface for its Google Trends program, according to Marissa Mayer, vice president of search products and user experience at Google. She also said the company would make it possible to download data from Google Trends into spreadsheets. Mayer said she couldn’t provide a time frame for either action.

Google trends has become an valuable tool for me in comparing the popularity of everything from HDTV sets, websites, software, and presidential candidates to vacation spots. I can’t wait to see what kind of mash-ups the web community creates.