Managing your Big Data for effective use in future.

The availability of data in huge volumes and its analysis for decision-making is one of the challenging tasks. A similar issue was addressed by a well-known software product and technology services company, Persistent Systems. During Season 1 of much famous show Satyamev Jayate, the count of responses reached million while there were more than 1 billion impressions on web.

With such voluminous data, conducting a successful data analytics process was difficult. Hence, to give meaning to such data by making it usable, Persistent Systems kept on tweaking the system to manage the diverse data that was received. It created dashboards and meaningful visualizations for producers so that the reliable facts and figures can be deduced about the show. The data storage at the back-end was kept to justify the claims made during the show about the government.

The gist of this article is to understand the importance of effectively managing the data right from the collection process to storage, processing, managing and finally making it available for decision making. The above pattern will be more useful in case of policy decisions undertaken by the government as the nature of data is diverse and just a representation of the entire populace.

Some of the ways in Data Management include:

  • Data storage at the Chip or Data Centre Level
  • Virtualization and the Cloud
  • Data Builder
  • Database Table Audit
  • Label Builder
  • Facility Filtering

Article adapted from: http://www.informationweek.in/Storage/12-08-27/How_Indian_TV_show_Satyamev_Jayate_used_Big_Data_to_inspire_the_world.aspx?page=2

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s