Dark data why what you don't know matters

"Data describe and represent the world. However, no matter how big they may be, data sets don't - indeed cannot - capture everything. Data are measurements - and, as such, they represent only what has been measured. They don't necessarily capture all the information that is relevant t...

Full description

Bibliographic Details
Main Author: Hand, D. J. (David J.), 1950-
Format: eBook
Language:English
Published: Princeton Princeton University Press, [2020]
Subjects:
Online Access:EBSCOhost
Перейти в каталог НБ ТГУ
LEADER 05931cam a22006018i 4500
001 koha001014186
003 OCoLC
005 20250222070026.0
006 m d | |
007 cr |||||||||||
008 190822s2020 nju ob 001 0 eng
010 |a  2019022972 
035 |a koha001014186 
040 |a DLC  |b eng  |e rda  |c DLC  |d OCLCO  |d OCLCF  |d EBLCP  |d TEFOD  |d JSTOR  |d UMI  |d YDX  |d N$T 
019 |a 1139751049  |a 1142202684 
020 |a 0691198853 
020 |a 9780691198859  |q (electronic bk.) 
020 |z 9780691182377  |q (hardback) 
020 |z 069118237X 
037 |a A71EDE2B-1433-4466-8FB7-B4F72961F41F  |b OverDrive, Inc.  |n http://www.overdrive.com 
037 |a 22573/ctvmms98p  |b JSTOR 
042 |a pcc 
050 0 0 |a QA276 
072 7 |a COM  |x 021030  |2 bisacsh 
072 7 |a COM  |x 021000  |2 bisacsh 
072 7 |a COM  |x 021040  |2 bisacsh 
072 7 |a SCI  |x 000000  |2 bisacsh 
082 0 0 |a 519.5  |2 23 
049 |a MAIN 
100 1 |a Hand, D. J.  |q (David J.),  |d 1950-  |9 913261 
245 1 0 |a Dark data  |b why what you don't know matters  |c David J. Hand. 
263 |a 2001 
264 1 |a Princeton  |b Princeton University Press,  |c [2020] 
300 |a 1 online resource 
504 |a Includes bibliographical references and index. 
520 |a "Data describe and represent the world. However, no matter how big they may be, data sets don't - indeed cannot - capture everything. Data are measurements - and, as such, they represent only what has been measured. They don't necessarily capture all the information that is relevant to the questions we may want to ask. If we do not take into account what may be missing/unknown in the data we have, we may find ourselves unwittingly asking questions that our data cannot actually address, come to mistaken conclusions, and make disastrous decisions. In this book, David Hand looks at the ubiquitous phenomenon of "missing data." He calls this "dark data" (making a comparison to "dark matter" - i.e., matter in the universe that we know is there, but which is invisible to direct measurement). He reveals how we can detect when data is missing, the types of settings in which missing data are likely to be found, and what to do about it. It can arise for many reasons, which themselves may not be obvious - for example, asymmetric information in wars; time delays in financial trading; dropouts in clinical trials; deliberate selection to enhance apparent performance in hospitals, policing, and schools; etc. What becomes clear is that measuring and collecting more and more data (big data) will not necessarily lead us to better understanding or to better decisions. We need to be vigilant to what is missing or unknown in our data, so that we can try to control for it. How do we do that? We can be alert to the causes of dark data, design better data-collection strategies that sidestep some of these causes - and, we can ask better questions of our data, which will lead us to deeper insights and better decisions"--  |c Provided by publisher. 
588 |a Description based on print version record and CIP data provided by publisher; resource not viewed. 
505 0 |a Cover; Contents; Preface; Part 1: Dark Data: Their Origins and Consequences; Chapter 1: Dark Data: What We Don't See Shapes Our World; The Ghost of Data; So You Think You Have All the Data?; Nothing Happened, So We Ignored It; The Power of Dark Data; All around Us; Chapter 2: Discovering Dark Data: What We Collect and What We Don't; Dark Data on All Sides; Data Exhaust, Selection, and Self-Selection; From the Few to the Many; Experimental Data; Beware Human Frailties; Chapter 3: Definitions and Dark Data: What Do You Want to Know?; Different Definitions and Measuring the Wrong Thing 
505 8 |a You Can't Measure EverythingScreening; Selection on the Basis of Past Performance; Chapter 4: Unintentional Dark Data: Saying One Thing, Doing Another; The Big Picture; Summarizing; Human Error; Instrument Limitations; Linking Data Sets; Chapter 5: Strategic Dark Data: Gaming, Feedback, and Information Asymmetry; Gaming; Feedback; Information Asymmetry; Adverse Selection and Algorithms; Chapter 6: Intentional Dark Data: Fraud and Deception; Fraud; Identity Theft and Internet Fraud; Personal Financial Fraud; Financial Market Fraud and Insider Trading; Insurance Fraud; And More 
505 8 |a Chapter 7: Science and Dark Data: The Nature of DiscoveryThe Nature of Science; If Only I'd Known That; Tripping over Dark Data; Dark Data and the Big Picture; Hiding the Facts; Retraction; Provenance and Trustworthiness: Who Told You That?; Part II: Illuminating and Using Dark Data; Chapter 8: Dealing with Dark Data: Shining a Light; Hope!; Linking Observed and Missing Data; Identifying the Missing Data Mechanism; Working with the Data We Have; Going Beyond the Data: What If You Die First?; Going Beyond the Data: Imputation; Iteration; Wrong Number! 
505 8 |a Chapter 9: Benefiting from Dark Data: Reframing the QuestionHiding Data; Hiding Data from Ourselves: Randomized Controlled Trials; What Might Have Been; Replicated Data; Imaginary Data: The Bayesian Prior; Privacy and Confidentiality Preservation; Collecting Data in the Dark; Chapter 10: Classifying Dark Data: A Route through the Maze; A Taxonomy of Dark Data; Illumination; Notes; Index 
653 0 |a Missing observations (Statistics) 
653 0 |a Big data. 
653 7 |a Big data.  |2 fast  |0 (OCoLC)fst01892965 
653 7 |a Missing observations (Statistics)  |2 fast  |0 (OCoLC)fst01023700 
653 7 |a COMPUTERS / Database Management / Data Mining  |2 bisacsh 
655 0 |a EBSCO eBooks  |9 905790 
655 4 |a Electronic books.  |9 899821 
856 4 0 |3 EBSCOhost  |u https://www.lib.tsu.ru/limit/2023/EBSCO/2218633.pdf 
856 |y Перейти в каталог НБ ТГУ  |u https://koha.lib.tsu.ru/cgi-bin/koha/opac-detail.pl?biblionumber=1014186 
910 |a EBSCO eBooks 
999 |c 1014186  |d 1014186 
039