Markov decision process (MDP): A mathematical framework used to model decision making in situations where outcomes are partly random and partly under the control of a decision-maker.

Markov Models for disease progression are common in medical decision making (see references below). The parameters in a Markov model can be estimated by observing the time it takes patients in any ...

Modern scientific studies often require the identification of a subset of explanatory variables. Several statistical methods have been developed to automate this task, and the framework of knockoffs ...

Spatial Poisson models for areal count data use nonstationary "intrinsic autoregressions," also often referred to as "conditionally autoregressive" (CAR) models. Bayesian inference for these models ...