Big Data is Hard Work

Although a Google Ngram like that in Chapter 14 (Exhibit 14.11) provides a quick way to discover the potential for Big Data, getting all that data ready for analysis involves a lot of hard work behind the scenes.  Research conducted for a recent New York Times article estimates that this “janitor work” takes between 50% and 80% of the time of the data scientists who work with Big Data.

http://www.nytimes.com/2014/08/18/technology/for-big-data-scientists-hurdle-to-insights-is-janitor-work.html?module=Search&mabReward=relbias%3Ar%2C%7B%222%22%3A%22RI%3A16%22%7D&_r=0

As with every form of social science data, good quality datasets don’t just “happen”!

Advertisement
This entry was posted in Chapter 14 and tagged . Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s