| Published Version Download ( PDF | 1MB) | License: Creative Commons Attribution 4.0 |
The Minimum Detectable Difference (MDD) Concept for Establishing Trust in Nonsignificant Results: A Critical Review
Mair, Magdalena M.
, Kattwinkel, Mira, Jakoby, Oliver and Hartig, Florian
(2020)
The Minimum Detectable Difference (MDD) Concept for Establishing Trust in Nonsignificant Results: A Critical Review.
Environmental Toxicology and Chemistry 39, pp. 2109-2123.
Date of publication of this fulltext: 28 Jan 2021 11:16
Article
DOI to cite this document: 10.5283/epub.44649
Abstract
Current regulatory guidelines for pesticide risk assessment recommend that nonsignificant results should be complemented by the minimum detectable difference (MDD), a statistical indicator that is used to decide whether the experiment could have detected biologically relevant effects. We review the statistical theory of the MDD and perform simulations to understand its properties and error rates. ...
Current regulatory guidelines for pesticide risk assessment recommend that nonsignificant results should be complemented by the minimum detectable difference (MDD), a statistical indicator that is used to decide whether the experiment could have detected biologically relevant effects. We review the statistical theory of the MDD and perform simulations to understand its properties and error rates. Most importantly, we compare the skill of the MDD in distinguishing between true and false negatives (i.e., type II errors) with 2 alternatives: the minimum detectable effect (MDE), an indicator based on a post hoc power analysis common in medical studies; and confidence intervals (CIs). Our results demonstrate that MDD and MDE only differ in that the power of the MDD depends on the sample size. Moreover, although both MDD and MDE have some skill in distinguishing between false negatives and true absence of an effect, they do not perform as well as using CI upper bounds to establish trust in a nonsignificant result. The reason is that, unlike the CI, neither MDD nor MDE consider the estimated effect size in their calculation. We also show that MDD and MDE are no better than CIs in identifying larger effects among the false negatives. We conclude that, although MDDs are useful, CIs are preferable for deciding whether to treat a nonsignificant test result as a true negative, or for determining an upper bound for an unknown true effect.Environ Toxicol Chem2020;00:1-15. (c) 2020 The Authors.Environmental Toxicology and Chemistrypublished by Wiley Periodicals LLC on behalf of SETAC.
Alternative links to fulltext
Involved Institutions
Details
| Item type | Article | ||||
| Journal or Publication Title | Environmental Toxicology and Chemistry | ||||
| Publisher: | Wiley | ||||
|---|---|---|---|---|---|
| Open Access Type: | DEAL (Wiley) | ||||
| Place of Publication: | HOBOKEN | ||||
| Volume: | 39 | ||||
| Page Range: | pp. 2109-2123 | ||||
| Date | 12 August 2020 | ||||
| Institutions | Biology, Preclinical Medicine > Institut für Pflanzenwissenschaften > Group Theoretical Ecology (Prof. Dr. Florian Hartig) | ||||
| Identification Number |
| ||||
| Keywords | STATISTICAL POWER ANALYSIS; OILSEED RAPE SEEDS; CONFIDENCE-INTERVALS; POLLINATING INSECTS; TESTS; BEES; REPLICABILITY; PESTICIDES; REGRESSION; MICROCOSMS; Minimum significant difference; Least significant difference; Minimum detectable change; Post hoc power; Statistical ecotoxicology; Risk assessment | ||||
| Dewey Decimal Classification | 500 Science > 570 Life sciences | ||||
| Status | Published | ||||
| Refereed | Yes, this version has been refereed | ||||
| Created at the University of Regensburg | Yes | ||||
| URN of the UB Regensburg | urn:nbn:de:bvb:355-epub-446492 | ||||
| Item ID | 44649 |
Download Statistics
Download Statistics