Skip to Main content Skip to Navigation
Journal articles

Nested leave-two-out cross-validation for the optimal crop yield model selection

Abstract : The use of statistical models to study the impact of weather on crop yield has not ceased to increase. Unfortunately, this type of application is characterized by datasets with a very limited number of samples (typically one sample per year). In general, statistical inference uses three datasets: the training dataset to optimize the model parameters, the validation dataset to select the best model, and the testing dataset to evaluate the model generalization ability. Splitting the overall database into three datasets is often impossible in crop yield modelling due to the limited number of samples. The leave-one-out cross-validation method, or simply leave one out (LOO), is often used to assess model performance or to select among competing models when the sample size is small. However, the model choice is typically made using only the testing dataset, which can be misleading by favouring unnecessarily complex models. The nested cross-validation approach was introduced in machine learning to avoid this problem by truly utilizing three datasets even with limited databases. In this study, we propose one particular implementation of the nested cross-validation, called the nested leave-two-out cross-validation method or simply the leave two out (LTO), to choose the best model with an optimal model selection (using the validation dataset) and estimate the true model quality (using the testing dataset). Two applications are considered: robusta coffee in Cu M'gar (Dak Lak, Vietnam) and grain maize over 96 French departments. In both cases, LOO is misleading by choosing models that are too complex; LTO indicates that simpler models actually perform better when a reliable generalization test is considered. The simple models obtained using the LTO approach have improved yield anomaly forecasting skills in both study crops. This LTO approach can also be used in seasonal forecasting applications. We suggest that the LTO method should become a standard procedure for statistical crop modelling.
Document type :
Journal articles
Complete list of metadata

https://hal-insu.archives-ouvertes.fr/insu-03717117
Contributor : Nathalie POTHIER Connect in order to contact the contributor
Submitted on : Saturday, July 9, 2022 - 8:20:47 AM
Last modification on : Tuesday, August 2, 2022 - 4:31:40 AM

File

gmd-15-3519-2022.pdf
Publisher files allowed on an open archive

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Thi Lan Anh Dinh, Filipe Aires. Nested leave-two-out cross-validation for the optimal crop yield model selection. Geoscientific Model Development, European Geosciences Union, 2022, 15, pp.3519-3535. ⟨10.5194/gmd-15-3519-2022⟩. ⟨insu-03717117⟩

Share

Metrics

Record views

0

Files downloads

0