Guide to Building Data-Driven Organizations in the Public Sector

The Promise of Big Data

Team 2: Annie Ackroyd, Victoria Adair, Bret Petersen

Topic Overview

Big Data - defined by Lohr (2012) as “advancing trends in technology that open the door to a new approach to understanding the world and making decisions” - has the potential to revolutionize the way we understand ourselves and the behavior of humans across the world.

Some key findings from this chapter’s readings regard:

Meier (2015) provides an example of big data “done right” with his lived experience of digital humanitarianism during the 2010 Haitian earthquake and its aftermath. Ultimately, the efforts of Meier and volunteers saved lives and improved the actions taken on-the-ground in the immediate after-effect of this natural disaster. As Meier stated, digital humanitarianism is an outlet for “global goodwill” requiring few advanced skills or connections. The role of big data, then, is to “connect the dots and channel this [global goodwill] toward positive social goals” (p. 18).

Chapter Summaries

Social Physics CH1 From Ideas to Action

The key concept of social physics is to better understand how ideas are shared between individuals & throughout groups, and what outcomes can be reasonably expected as a result (Pentland, 2015, p. 3-4). Social physics recognizes that a significant amount of data (known here as “big data”) is available given today’s technological advancements (computers, smart phones, electronic payment options, GPS tracking) and can be analyzed to inform comprehensive decisions, strategies and accurately predict plausible outcomes. It has the potential to differentiate between what people portray about their lives on Facebook (i.e. a selective depiction of one’s life) and the unbiased analytical data defining where we spend our time and our money (Pentland, 2015, p. 8). Pentland argues that the two most important concepts of social physics are:

Additionally, Pentland includes definitions for 15 key terms as they relate to social physics in an effort to meet his goal of providing a more robust vocabulary for understanding human interactions, organizations and societies (2015, p. 8, 19-21).

Digital Humanitarians CH1 Rise of Digital Humanitarianism

This chapter used Meier’s personal experience with what is now known as “digital humanitarianism” during the aftermath 2010 Haitian earthquake to illustrate the potential power of lay-person access to data to save lives. In summary:

Meier argues that this experience highlights the promise of big data (i.e. it can literally save lives) and some of the complications (i.e. balancing personal privacy with collected data, what to use it for [i.e. should they stop their work once triage for the event was completed or continue on to show accountability for relief efforts?], etc.). He ended with a preview of remaining chapters in the book, which would explore other topics such as Big (False) data, policies and technology, AI, and more.

NYT The Age of Big Data

This article is about the explosion of available data in recent years, its applications across fields, and how to harness it. The impact of Big Data will extend far beyond the tech companies of Silicon Valley; there are implications for business, government, and academia. According to the article, “There is no area that is going to be untouched” (qtd. in Lohr 2012). The surge in available data has also created a rapidly growing need for workers with data expertise.

The author defines Big Data as “…advancing trends in technology that open the door to a new approach to understanding the world and making decisions” (Lohr 2012). Large quantities of data are rapidly becoming more available and understandable. Most of Big Data exists as “unstructured data.” However, we are developing new tools, like AI, to gain insight from unstructured data.

The article compares the impact of Big Data to that of the microscope in the 16th century. We are able to measure behavior and sentiment in fine detail in real time using data from platforms like Google and social media sites.

In business, decision making is becoming more analytical, and it’s paying off. Research shows that data-driven decision making increases productivity. Using Big Data to make predictions also has implications for preventing (or minimizing) public health disasters and economic downturns.

There are risks associated with Big Data. Privacy is at the top of the list, of course. Other potential pitfalls include an increased risk of false discoveries, biased fact-finding, and unfair or discriminatory statistical inferences. However, the author concludes that, “Despite the caveats, there seems to be no turning back. Data is in the driver’s seat. It’s there, it’s useful and it’s valuable, even hip” (Lohr 2012).

Key Take-Aways

Discussion Questions

References