Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5

Students: another [underlying] facet of why the social sciences can be unreliable?

#1
C C Offline
Behavioural research: Study reveals that students aren’t ideal test subjects
https://pressemitteilungen.pr.uni-halle....pm_id=5450

INTRO: Students are popular test subjects for many studies in behavioural sciences. However, using only students does not reveal the full picture about people in general. In fact, many of the students' decisions in those experiments differ from those of other population groups. These are the findings of a new, extensive study consisting of 36 experiments which was conducted by a team of behavioural scientists from Martin Luther University Halle-Wittenberg (MLU). The study was published in the Australian Journal of Agricultural and Resource Economics.

Students are popular test subjects, especially in behavioural economics. "This makes sense because students are open to and interested in scientific studies, they are already in a university setting, and also they are receptive to financial incentives offered in those studies," says Dr Sven Grüner from the Institute of Agricultural and Food Sciences at MLU. "However, it is unclear whether students are representative of other population groups -- after all, they differ in important ways, such as age and income."

To answer this question, the behavioural economist conducted an elaborate study using 300 test subjects. The result: Only limited conclusions can be drawn from students about the behaviour of other people.

In a total of 36 sub-experiments, Grüner compared the decisions of agricultural science students to those of farmers. The team examined individual characteristics such as risk-taking, impatience, altruism, trust, punishing unfair and rewarding generous behaviour.

"We used established economic experiments from decision and game theory," Grüner explains. For example, when determining willingness to take risks, the test subjects were given the choice between a higher probability of winning a small amount of money and a lower probability of winning a higher amount of money. "We gradually increased the monetary incentives in all of the experiments to see how the expected sum influenced decisions," says Grüner.

Contrary to previous studies, the incentive was actually given to the subjects afterwards, because theoretical earnings could falsify the results: If participants knew they would not get any money, they might have shown a greater degree of socially desirable behaviour.

The results of the comprehensive study revealed a very mixed picture: for example, there are no clear differences between the groups in terms of risk-taking. "This contradicts earlier studies in which students were more risk averse than farmers," says Grüner.  The differences were also slight when it came to trust and rewarding generous behaviour.

However, when testing for the groups' patience there were bigger differences: farmers were much more likely to choose the option with the higher probability of a lower pay out, while students were consistently found to be more patient and wait longer for more money.

At the same time, farmers turned down unfair offers more often, even when this meant they would not get any money themselves. These findings are not in line with earlier studies that showed similar behaviour among students and other population groups, says Grüner.

"Our study shows that it is really problematic to generalize the behaviour of students to other real actors. This could call into question a lot of the results of previous studies -- not only in agricultural sciences, but across all disciplines," adds Grüner.

This is also a sensitive topic because surveys on individual decision-making examine important questions about the future: risk behaviour and patience, for example, are decisive criteria for investing in sustainable production structures that usually only pay off after many years. The new study helps to identify factors that can be used to weight the results.
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  California students are struggling in math. Will reforms make the problem worse? C C 1 208 Sep 10, 2022 12:31 AM
Last Post: Syne
  Another STEM field, particle physics, gets woke (not just a social sciences disease) C C 0 192 Sep 6, 2022 03:28 PM
Last Post: C C
  Many US students won’t find accurate climate science in their textbooks C C 1 84 Nov 17, 2021 05:42 PM
Last Post: Syne
  Biomedical (& social) sciences are riddled with fraud: Real scandal behind ivermectin C C 1 76 Oct 26, 2021 05:16 PM
Last Post: Syne
  Some human sciences still affected by anti-Western, "noble savage" myth propaganda C C 0 118 Feb 9, 2021 06:52 PM
Last Post: C C
  Yes, much COVID-19 research will turn out to be wrong or unreliable C C 0 294 Mar 30, 2020 06:48 PM
Last Post: C C
  Peer reviewers getting sophomoric, unreliable & subjective + Is social priming bogus? C C 1 243 Dec 14, 2019 07:04 PM
Last Post: Syne
  The Devolution of Social Science (unreliable, ideological pseudoscience, etc) C C 1 639 Oct 10, 2018 05:12 PM
Last Post: Syne
  In psychology & other social sciences, many studies [still] fail reproducibility test C C 0 388 Aug 29, 2018 07:22 AM
Last Post: C C
  Biomedical studies are shockingly hard to reproduce + Unreliable dietary guidelines C C 1 682 Jan 9, 2016 10:44 AM
Last Post: elte



Users browsing this thread: 1 Guest(s)