How Big Data Creates False Confidence

If I claimed that Americans have gotten more self-centered lately, you might just chalk me up as a curmudgeon, prone to good-ol’-days whining. But what if I said I could back that claim up by analyzing 150 billion words of text? A few decades ago, evidence on such a scale was a pipe dream. Today, though, 150 billion data points is practically passé. A feverish push for “big data” analysis has swept through biology, linguistics, finance, and every field in between.

Although no one can quite agree how to define it, the general idea is to find datasets so enormous that they can reveal patterns invisible to conventional inquiry. The data are often generated by millions of real-world user actions, such as tweets or credit-card purchases, and they can take thousands of computers to collect, store, and analyze. To many companies and researchers, though, the investment is worth it because the patterns can

Stai leggendo un'anteprima, registrati per continuare a leggere.

Altro da Nautilus

Nautilus5 min letti
A Warning from History About Simultaneous Disasters
Parts of the world might have shut down, but nature never does. Even while people stay at home and learn about physical distancing, weather, tectonic shifts, meteorites, and solar storms do not pause. With many international borders closed and an inc
Nautilus4 min letti
Let’s Aim for Physical Rather Than Social Distancing
Amid all the calls in nearly every country for social distancing, the most powerful tool we have to slow the spread of the novel coronavirus, one important fact gets lost: We are fundamentally social beings, and social distancing can carry a heavy ps
Nautilus5 min letti
A Professor Of Disasters And Health On COVID-19
A new virus sweeps the world, closing borders, shutting down arts and sports, and killing thousands of people. Is this coronavirus pandemic, with the disease named Covid-19, simply a natural disaster, a culling of overpopulation as suggested by callo