RMIT University
Browse

Researchers should make thoughtful assessments instead of null-hypothesis significance tests

journal contribution
posted on 2024-11-01, 22:46 authored by Andreas Schwab, Eric Abrahamson, William Starbuck, Fiona Fidler
Null-hypothesis significance tests (NHSTs) have received much criticism, especially during the last two decades. Yet many behavioral and social scientists are unaware that NHSTs have drawn increasing criticism, so this essay summarizes key criticisms. The essay also recommends alternative ways of assessing research findings. Although these recommendations are not complex, they do involve ways of thinking that many behavioral and social scientists find novel. Instead of making NHSTs, researchers should adapt their research assessments to specific contexts and specific research goals, and then explain their rationales for selecting assessment indicators. Researchers should show the substantive importance of findings by reporting effect sizes and should acknowledge uncertainty by stating confidence intervals. By comparing data with naïve hypotheses rather than with null hypotheses, researchers can challenge themselves to develop better theories. Parsimonious models are easier to understand, and they generalize more reliably. Robust statistical methods tolerate deviations from assumptions about samples.

History

Related Materials

  1. 1.
    DOI - Is published in 10.1287/orsc.1100.0557
  2. 2.
    ISSN - Is published in 10477039

Journal

Organization Science

Volume

22

Issue

4

Start page

1105

End page

1120

Total pages

16

Publisher

Institute for Operations Research and the Management Sciences (I N F O R M S)

Place published

United States

Language

English

Copyright

© 2011 INFORMS.

Former Identifier

2006056182

Esploro creation date

2020-06-22

Fedora creation date

2016-07-07

Usage metrics

    Scholarly Works

    Categories

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC