Bias-variance decomposition of errors in data-driven land cover change modeling

• Published in: Landscape ecology Vol. 31; no. 10; pp. 2397 - 2413
• Main Authors: Gao, Jing, Burnicki, Amy C., Burt, James E.
• Format: Journal Article
• Language: English
• Published: Dordrecht Springer Netherlands 01-12-2016; Springer Nature B.V
• Subjects: Biomedical and Life Sciences; Ecology; Environmental Management; Landscape Ecology; Landscape/Regional and Urban Planning; Life Sciences; Mathematical models; Nature Conservation; Research Article; Sustainable Development; USA, Southeast; Bias; Land cover change; Model evaluation; Error decomposition; Data-driven models; Accuracy assessment; New development; Variance
• ISSN: 0921-2973; 1572-9761
• DOI: 10.1007/s10980-016-0410-x

Context
Careful model evaluation is essential for using the results of data-driven land cover change (LCC) models. A useful evaluation should help the analyst understand model behavior and improve model performance. Conventional error analysis methods provide limited insights on these two issues.
Objectives
We propose the use of bias-variance error decomposition (BVD) for LCC model evaluation and investigate its value through a pilot study.
Methods
We examined the mathematical underpinnings of BVD and applied the approach to a model describing the expansion of development for a county in southeastern Michigan, USA.
Results
The spatial structure of the BVD error component maps effectively informed the design of model improvement efforts. We found that bias maps can help detect and eliminate the negative influence of spatial non-stationarity in LCC models, and variance maps can shed light on optimal training sample allocation and ways to mitigate model instability. In our case study, model improvements suggested by BVD showed potential to substantially reduce estimation error. Our analysis also revealed that fast and slow developments can result from different mechanisms even when they are geographically near to each other, and different development types may be best analyzed with separate models.
Conclusions
BVD has advantages over conventional error analysis and can deepen our understanding of the underlying LCC process and the sources of modeling error. The BVD insights can help effectively design and apply model improvement strategies. These results and the BVD approach have great generality and are applicable to many other geospatial models.