Bad data Why we measure the wrong things and often miss the metrics that matter

Peter Schryvers, 1983-

Book - 2020

"Big data is often touted as the key to understanding almost every aspect of contemporary life. This critique of "information hubris" shows that even more important than data is finding the right metrics to evaluate it. The author, an expert in environmental design and city planning, examines the many ways in which we measure ourselves and our world. He dissects the metrics we apply to health, worker productivity, our children's education, the quality of our environment, the effectiveness of leaders, the dynamics of the economy, and the overall well-being of the planet. Among the areas where the wrong metrics have led to poor outcomes, he cites the fee-for-service model of health care, corporate cultures that emphasize t...ime spent on the job while overlooking key productivity measures, overreliance on standardized testing in education to the detriment of authentic learning, and a blinkered focus on carbon emissions, which underestimates the impact of industrial damage to our natural world. He also examines various communities and systems that have achieved better outcomes by adjusting the ways in which they measure data. The best results are attained by those that have learned not only what to measure and how to measure it, but what it all means. By highlighting the pitfalls inherent in data analysis, this illuminating book reminds us that not everything that can be counted really counts."--

Saved in:
1 person waiting

2nd Floor Show me where

001.42/Schryvers
0 / 1 copies available
Location Call Number   Status
2nd Floor 001.42/Schryvers Due Aug 19, 2023
Subjects
Published
Guilford, Connecticut : Prometheus Books [2020]
Language
English
Main Author
Peter Schryvers, 1983- (author)
Physical Description
xxiii, 323 pages ; 24 cm
Bibliography
Includes bibliographical references and index.
ISBN
9781633885905
  • Introduction
  • Chapter 1. Teaching to the Test: Goodhart's Law and the Paradox of Metrics
  • Chapter 2. The Ins and Outs: The Logic Model and Program Evaluation
  • Chapter 3. The Long and Short of It: Intertemporal Problems and Undervaluing Time
  • Chapter 4. The Problem of Per: Denominator Errors
  • Chapter 5. The Forest and the Trees: Simplifying Complex Systems
  • Chapter 6. Apples and Oranges: Ignoring Differing Qualities
  • Chapter 7. Not Everything That Can Be Counted Counts: The Lamppost Problem
  • Chapter 8. Not Everything That Counts Can Be Counted: Measuring What Matters
  • Chapter 9. The Measure of Metrics
  • Chapter 10. Gateways Not Yardsticks
  • Acknowledgments
  • Notes
  • Index
Review by Publisher's Weekly Review

Schryvers, a senior planner for the city of Calgary, offers a debut that challenges the accepted wisdom about a host of data-driven programs and convincingly argues that people and institutions often rely on the wrong info. Under his scrutiny, various measures--fee-for-service billing in medical settings; the corporate emphasis on short-term earnings; bibliometrics, the evaluation of academics based on how many publications they are cited in--all fail to provide reliable data for credibly enumerated reasons. Schryvers points to Goodhart's law, which holds that "when a measure becomes a target, the measure ceases to be a good measure." Examining other pitfalls of data collection and analysis, Schryvers notes that some things simply defy measurement; here he points to the Vietnam War, where the American military's reliance on the infamous body counts, for example, failed to account for the insurmountable North Vietnamese commitment to victory. Schryvers's insights will provide valuable tools to readers, enabling them to think critically about the myriad uses of data today. Agent: Jeff Shreve, the Science Factory. (Oct.)

(c) Copyright PWxyz, LLC. All rights reserved