Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5

More Data Can Lead to Worse Decisions, Study Shows

#1
C C Offline
Students’ conclusions from measurement data: The more decimal places, the better?
https://journals.aps.org/prper/abstract/....15.010103

ABSTRACT: In this study with 153 middle school students, we investigate the influence of the number of decimal places from the reading of a measurement device on students’ decisions to change or keep an initial hypothesis about falling objects. Participants were divided into three groups, introduced to two experiments—the time it takes a free falling object with a zero, and a nonzero initial horizontal velocity to fall a certain distance—and asked to state a hypothesis that compares the falling times of the two experiments. We asked the participants whether they wanted to change or keep their initial hypothesis after they were provided with data sets. Members of each group were given the same number of measurements but with a different number of decimal places. Results show that for an increase in the number of decimal places, the number of participants switching from a false to a correct hypothesis decreases, and at the same time the number of students switching from a correct to a false hypothesis increases. These results indicate that showing more exact data to students—given through different resolutions of the measurement device—may hinder students’ ability to compare data sets and may lead them to incorrect conclusions. We argue that this is due to students’ lack of knowledge about measurement uncertainties and the concept of variance.

More Data Can Lead to Worse Decisions, Study Shows
http://physicsbuzz.physicscentral.com/20...sions.html

EXCERPT: . . . In recognition of the data-driven world we live in, many countries emphasize the importance of teaching students to evaluate the quality of data. [...] “Labs are an important aspect of science education,” says Karel Kok, a graduate student in physics education research at the Humboldt University of Berlin and a former physics teacher. “Often, students gather data and this data is then used as evidence for scientific claims,” he says.

The hope is that if students learn to interpret and analyze the quality of the data they collect from simple experiments, they will be able to apply those skills to the data they encounter later in life—the quarterly performance of stock, the temperature of the Earth over time, or the failure rate of an electronic component—and judge how well the evidence supports related claims. This a noble goal, but we don’t seem to have figured out how to get there yet. Even with solid data, many people rely on their intuition for decision-making. When faced with data that contradicts their beliefs, many people ignore the data and stick to their prior beliefs. Even when people make decisions based on data, many do so based on data that doesn’t stand up to scrutiny.

[...] The study outcome suggests that when comparing measurements with only two decimal places, it’s easier for students to judge whether a difference is significant. This is probably because the variance is hidden. However, when comparing numbers with more decimal places, the decision is harder. This is probably because the numbers look more variable. When students are unsure if the difference is significant, the research suggests, they often revert to intuition. And intuition often leads them astray.

Students would probably exercise better judgement, say the researchers, if they knew more about measurement uncertainties and had a framework for determining when a difference is significant—things that are often left out of the curriculum. Given what’s at stake, the researchers recommend that teachers make time to include these concepts in science classrooms and beyond. “Since data, and judging the quality of this data, is becoming so prominent in our everyday lives, teachers in all subjects should try to incorporate this into their classes,” they write....

MORE (details): http://physicsbuzz.physicscentral.com/20...sions.html
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Energy info matters more than ever - it’s time to reform the IEA (data integrity) C C 0 63 Jan 17, 2024 06:30 PM
Last Post: C C
  Research Study shows children with private insurance more likely to outgrow food allergies C C 0 72 Nov 10, 2023 12:35 AM
Last Post: C C
  Article Flawed body of studies shows true ‘long COVID’ risk likely exaggerated (data bias) C C 0 349 Sep 26, 2023 02:23 AM
Last Post: C C
  Article Physically demanding jobs may lead to cognitive impairment risk (ergonomics) C C 0 71 Sep 14, 2023 05:55 PM
Last Post: C C
  Article Label date, not phrasing, drives consumer decisions to toss good food C C 1 99 Jul 1, 2023 01:09 AM
Last Post: confused2
  More than half of us may end up without descendants (population data) C C 0 279 Aug 16, 2022 03:53 PM
Last Post: C C
  More in US believe harassing health officials is justified (survey data) C C 1 294 Jul 30, 2022 01:45 AM
Last Post: Syne
  Parties lead & voters follow, rather than vice versa (political data analysis) C C 1 99 Jan 20, 2022 05:33 PM
Last Post: Syne
  Why is the placebo effect getting worse, but only in America? C C 0 87 Jan 3, 2022 08:16 PM
Last Post: C C
  Cough or fever first? Study analyzes order of COVID-19 symptoms (data analysis) C C 0 76 Dec 17, 2021 10:19 PM
Last Post: C C



Users browsing this thread: 1 Guest(s)