Early View | Published Version Download ( PDF | 1MB) | License: Creative Commons Attribution 4.0 |
A new joint species distribution model for faster and more accurate inference of species associations from big community data
Pichler, Maximilian
and Hartig, Florian
(2021)
A new joint species distribution model for faster and more accurate inference of species associations from big community data.
Methods in Ecology and Evolution 12, pp. 2159-2173.
Date of publication of this fulltext: 13 Aug 2021 10:18
Article
DOI to cite this document: 10.5283/epub.47837
Abstract
Joint species distribution models (JSDMs) explain spatial variation in community composition by contributions of the environment, biotic associations and possibly spatially structured residual covariance. They show great promise as a general analytical framework for community ecology and macroecology, but current JSDMs, even when approximated by latent variables, scale poorly on large datasets, ...
Joint species distribution models (JSDMs) explain spatial variation in community composition by contributions of the environment, biotic associations and possibly spatially structured residual covariance. They show great promise as a general analytical framework for community ecology and macroecology, but current JSDMs, even when approximated by latent variables, scale poorly on large datasets, limiting their usefulness for currently emerging big (e.g. metabarcoding and metagenomics) community datasets. Here, we present a novel, more scalable JSDM (sjSDM) that circumvents the need to use latent variables by using a Monte Carlo integration of the joint JSDM likelihood together with flexible elastic net regularization on all model components. We implemented sjSDM in PyTorch, a modern machine learning framework, which allows making use of both CPU and GPU calculations. Using simulated communities with known species-species associations and different number of species and sites, we compare sjSDM with state-of-the-art JSDM implementations to determine computational runtimes and accuracy of the inferred species-species and species-environment associations. We find that sjSDM is orders of magnitude faster than existing JSDM algorithms (even when run on the CPU) and can be scaled to very large datasets. Despite the dramatically improved speed, sjSDM produces more accurate estimates of species association structures than alternative JSDM implementations. We demonstrate the applicability of sjSDM to big community data using eDNA case study with thousands of fungi operational taxonomic units (OTU). Our sjSDM approach makes the analysis of JSDMs to large community datasets with hundreds or thousands of species possible, substantially extending the applicability of JSDMs in ecology. We provide our method in an R package to facilitate its applicability for practical data analysis.
Alternative links to fulltext
Involved Institutions
Details
| Item type | Article | ||||
| Journal or Publication Title | Methods in Ecology and Evolution | ||||
| Publisher: | Wiley | ||||
|---|---|---|---|---|---|
| Open Access Type: | DEAL (Wiley) | ||||
| Place of Publication: | HOBOKEN | ||||
| Volume: | 12 | ||||
| Page Range: | pp. 2159-2173 | ||||
| Date | 28 July 2021 | ||||
| Institutions | Biology, Preclinical Medicine > Institut für Pflanzenwissenschaften > Group Theoretical Ecology (Prof. Dr. Florian Hartig) | ||||
| Identification Number |
| ||||
| Keywords | BIOTIC INTERACTIONS; ENVIRONMENTAL DNA; CLIMATE-CHANGE; MULTIVARIATE; BIODIVERSITY; ABUNDANCE; COOCCURRENCE; ARTHROPODS; MECHANISMS; FRAMEWORK; big data; co-occurrence; machine learning; metacommunity; regularization; statistics | ||||
| Dewey Decimal Classification | 500 Science > 570 Life sciences 500 Science > 580 Botanical sciences | ||||
| Status | Published | ||||
| Refereed | Yes, this version has been refereed | ||||
| Created at the University of Regensburg | Yes | ||||
| URN of the UB Regensburg | urn:nbn:de:bvb:355-epub-478374 | ||||
| Item ID | 47837 |
Download Statistics
Download Statistics