Skip to Main Content
U.S. Forest Service
Caring for the land and serving people

United States Department of Agriculture

Home > Search > Publication Information

  1. Share via EmailShare on FacebookShare on LinkedInShare on Twitter
    Dislike this pubLike this pub
    Author(s): Bruce G. Marcot
    Date: 2012
    Source: Ecological Modeling. 230: 50-62
    Publication Series: Scientific Journal (JRNL)
    Station: Pacific Northwest Research Station
    PDF: View PDF  (1.09 MB)

    Description

    This paper presents a selected set of existing and new metrics for gauging Bayesian network model performance and uncertainty. Selected existing and new metrics are discussed for conducting model sensitivity analysis (variance reduction, entropy reduction, case file simulation); evaluating scenarios (influence analysis); depicting model complexity (numbers of model variables, links, node states, conditional probabilities, and node cliques); assessing prediction performance (confusion tables, covariate and conditional probability-weighted confusion error rates, area under receiver operating characteristic curves, k-fold cross-validation, spherical payoff. Schwarz' Bayesian information criterion, true skill statistic, Cohen's kappa); and evaluating uncertainty of model posterior probability distributions (Bayesian credible interval, posterior probability certainty index, certainty envelope, Gini coefficient). Examples are presented of applying the metrics to 3 real-world models of wildlife population analysis and management. Using such metrics can vitally bolster model credibility, acceptance, and appropriate application, particularly when informing management decisions.

    Publication Notes

    • You may send email to pnw_pnwpubs@fs.fed.us to request a hard copy of this publication.
    • (Please specify exactly which publication you are requesting and your mailing address.)
    • We recommend that you also print this page and attach it to the printout of the article, to retain the full citation information.
    • This article was written and prepared by U.S. Government employees on official time, and is therefore in the public domain.

    Citation

    Marcot, Bruce G. 2012. Metrics for evaluating performance and uncertainty of Bayesian network models. Ecological Modeling. 230: 50-62.

    Keywords

    Bayesian network model, uncertainty, model performance, model validation, sensitivity analysis, error rates, probability analysis

    Related Search


    XML: View XML
Show More
Show Fewer
Jump to Top of Page