
PRISM
 Referenced in 442 articles
[sw01186]
 probabilistic models: discretetime Markov chains, Markov decision processes and continuoustime Markov chains. Analysis...

pomp
 Referenced in 46 articles
[sw10664]
 pomp: Statistical Inference for Partially Observed Markov Processes. Tools for working with partially observed Markov...

MRMC
 Referenced in 71 articles
[sw04129]
 bounded reachability analysis for continuoustime Markov decision processes (CTMDPs) and CSL model checking...

msm
 Referenced in 53 articles
[sw08096]
 fitting general continuoustime Markov and hidden Markov multistate models to longitudinal data ... variety of observation schemes are supported, including processes observed at arbitrary times (panel data), continuously ... Markov transition rates and the hidden Markov output process can be modelled in terms...

MesoRD
 Referenced in 31 articles
[sw18202]
 exact method to simulate the Markov process corresponding to the reactiondiffusion master equation. Availability...

Möbius
 Referenced in 25 articles
[sw04098]
 solution, based on compact MDDbased Markov processes, are both supported...

POMDP
 Referenced in 24 articles
[sw03204]
 Partially Observable Markov Decision Process (POMDP). The ’pomdpsolve’ program solves problems that are formulated ... partially observable Markov decision processes, a.k.a. POMDPs. It uses the basic dynamic programming approach...

POMDPS
 Referenced in 39 articles
[sw03055]
 planning algorithms for POMDPS. Partially Observable Markov Decision Processes (POMDPs) provide a rich framework...

SMART_
 Referenced in 33 articles
[sw04097]
 available when the underlying process is a Markov chain. In addition, discreteevent simulation ... stochastic nature of the process, but certain classes of nonMarkov models can still...

VAMPnets
 Referenced in 19 articles
[sw32927]
 equilibria and longtimescale kinetics of biomolecular processes, such as proteindrug binding, from high ... dimensionreduced data, and estimation of a Markov state model or related model ... employ the variational approach for Markov processes (VAMP) to develop a deep learning framework ... molecular coordinates to Markov states, thus combining the whole data processing pipeline in a single...

FAUST2
 Referenced in 14 articles
[sw23682]
 possibly nondeterministic) discretetime Markov processes (dtMP) defined over uncountable (continuous) state spaces ... finitestate Markov chain or Markov decision processes. The abstraction procedure runs in MATLAB...

spBayes
 Referenced in 365 articles
[sw10160]
 Unfortunately, fitting such models involves computationally intensive Markov chain Monte Carlo (MCMC) methods whose efficiency ... encompassing a wide variety of Gaussian spatial process models for univariate as well as multivariate...

LiQuor
 Referenced in 18 articles
[sw04136]
 operational semantics based on (finite) Markov decision processes. LiQuor provides the facility to perform...

BGPhazard
 Referenced in 28 articles
[sw11014]
 BGPhazard: Markov beta and gamma processes for modeling hazard rates. Computes the hazard rate estimate...

moveHMM
 Referenced in 15 articles
[sw16166]
 animal movement modelling using hidden Markov models. These include processing of tracking data, fitting hidden ... Markov models to movement data, visualization of data and fitted model, decoding of the state ... process...

Expokit
 Referenced in 198 articles
[sw00258]
 Krylov subspace projection methods (Arnoldi and Lanczos processes), and that is why the toolkit ... critical importance in the area of Markov chains and furthermore, the computed solution is subject...

Rapture
 Referenced in 7 articles
[sw13409]
 Rapture: a tool for verifying Markov decision processes. We present a tool that performs verification ... quantified reachability properties over Markov decision processes (or probabilistic transition system). The originality...

PEPA
 Referenced in 117 articles
[sw10692]
 Evaluation Process Algebra. PEPA tools: The PEPA process algebra is supported by the PEPA Eclipse ... PEPA editor and performance analysers which use Markov chain or ODE methods or simulation. Performance...

BayesEstDiffusion.jl
 Referenced in 7 articles
[sw40280]
 estimation of discretely observed multidimensional diffusion processes using guided proposals. Estimation of parameters ... then be dealt with using a Markovchain MonteCarlo method known as dataaugmentation ... sampling diffusion bridges. These are Markov processes obtained by adding a guiding term...

FluCaP
 Referenced in 11 articles
[sw07748]
 search algorithm for solving FirstOrder Markov Decision Processes (FOMDPs). Our approach combines firstorder...