scoringutils: Utilities for Scoring and Assessing Predictions

Combines a collection of metrics and proper scoring rules (Tilmann Gneiting & Adrian E Raftery (2007) <doi:10.1198/016214506000001437>) with an easy to use wrapper that can be used to automatically evaluate predictions. Apart from proper scoring rules functions are provided to assess bias, sharpness and calibration (Sebastian Funk, Anton Camacho, Adam J. Kucharski, Rachel Lowe, Rosalind M. Eggo, W. John Edmunds (2019) <doi:10.1371/journal.pcbi.1006785>) of forecasts. Several types of predictions can be evaluated: probabilistic forecasts (generally predictive samples generated by Markov Chain Monte Carlo procedures), quantile forecasts or point forecasts. Observed values and predictions can be either continuous, integer, or binary. Users can either choose to apply these rules separately in a vector / matrix format that can be flexibly used within other packages, or they can choose to do an automatic evaluation of their forecasts. This is implemented with 'data.table' and provides a consistent and very efficient framework for evaluating various types of predictions.

Depends: R (≥ 2.10)
Imports: data.table, forcats, ggplot2, goftest, scoringRules, stats, methods
Suggests: testthat, knitr, rmarkdown
Published: 2021-07-21
Author: Nikos Bosse ORCID iD [aut, cre], Sam Abbott ORCID iD [aut], Johannes Bracher ORCID iD [ctb], Joel Hellewell ORCID iD [ctb], Sophie Meakins [ctb], James Munday [ctb], Katharine Sherratt [ctb], Sebastian Funk [aut]
Maintainer: Nikos Bosse <nikosbosse at>
License: MIT + file LICENSE
NeedsCompilation: no
Language: en-GB
Citation: scoringutils citation info
In views: TimeSeries
CRAN checks: scoringutils results


Reference manual: scoringutils.pdf
Vignettes: scoringutils


Package source: scoringutils_0.1.7.2.tar.gz
Windows binaries: r-devel:, r-release:, r-oldrel:
macOS binaries: r-release (arm64): scoringutils_0.1.7.2.tgz, r-release (x86_64): scoringutils_0.1.7.2.tgz, r-oldrel: scoringutils_0.1.7.2.tgz
Old sources: scoringutils archive


Please use the canonical form to link to this page.