Monday, October 14, 2013

Why don't big data people do holistic politics?

There is a whole industry out there that is involved in dealing with large data sets, and by large I mean millions of units. You would think that they would, at least some of them, get involved in politics and fill in the basics, the foundational data sets that we need to actually monitor our governments.

If they are, I'm seeing little evidence of it. Sure, there are data applications in the government sector that deal with big data. How could there not be in a country with over 300 million people. But nobody seems to be doing the foundations, the basics, that are necessary to manage the whole system without fudging or guesswork.

Pentaho, Hadoop, Jasper reports, experts in these technologies should be seeing that we're missing very simple, basic data sets that are foundational and then moving in to supply them. But nope, no evidence that it's happening.

Weird.