
PRISM
 Referenced in 395 articles
[sw01186]
 probabilistic models: discretetime Markov chains, Markov decision processes and continuoustime Markov chains. Analysis...

pomp
 Referenced in 35 articles
[sw10664]
 pomp: Statistical Inference for Partially Observed Markov Processes. Tools for working with partially observed Markov...

MRMC
 Referenced in 66 articles
[sw04129]
 bounded reachability analysis for continuoustime Markov decision processes (CTMDPs) and CSL model checking...

msm
 Referenced in 40 articles
[sw08096]
 fitting general continuoustime Markov and hidden Markov multistate models to longitudinal data ... variety of observation schemes are supported, including processes observed at arbitrary times (panel data), continuously ... Markov transition rates and the hidden Markov output process can be modelled in terms...

MesoRD
 Referenced in 30 articles
[sw18202]
 exact method to simulate the Markov process corresponding to the reactiondiffusion master equation. Availability...

Möbius
 Referenced in 24 articles
[sw04098]
 solution, based on compact MDDbased Markov processes, are both supported...

SMART_
 Referenced in 33 articles
[sw04097]
 available when the underlying process is a Markov chain. In addition, discreteevent simulation ... stochastic nature of the process, but certain classes of nonMarkov models can still...

POMDPS
 Referenced in 34 articles
[sw03055]
 planning algorithms for POMDPS. Partially Observable Markov Decision Processes (POMDPs) provide a rich framework...

POMDP
 Referenced in 20 articles
[sw03204]
 Partially Observable Markov Decision Process (POMDP). The ’pomdpsolve’ program solves problems that are formulated ... partially observable Markov decision processes, a.k.a. POMDPs. It uses the basic dynamic programming approach...

LiQuor
 Referenced in 18 articles
[sw04136]
 operational semantics based on (finite) Markov decision processes. LiQuor provides the facility to perform...

FAUST2
 Referenced in 8 articles
[sw23682]
 possibly nondeterministic) discretetime Markov processes (dtMP) defined over uncountable (continuous) state spaces ... finitestate Markov chain or Markov decision processes. The abstraction procedure runs in MATLAB...

spBayes
 Referenced in 297 articles
[sw10160]
 Unfortunately, fitting such models involves computationally intensive Markov chain Monte Carlo (MCMC) methods whose efficiency ... encompassing a wide variety of Gaussian spatial process models for univariate as well as multivariate...

BGPhazard
 Referenced in 25 articles
[sw11014]
 BGPhazard: Markov beta and gamma processes for modeling hazard rates. Computes the hazard rate estimate...

moveHMM
 Referenced in 12 articles
[sw16166]
 animal movement modelling using hidden Markov models. These include processing of tracking data, fitting hidden ... Markov models to movement data, visualization of data and fitted model, decoding of the state ... process...

Expokit
 Referenced in 171 articles
[sw00258]
 Krylov subspace projection methods (Arnoldi and Lanczos processes), and that is why the toolkit ... critical importance in the area of Markov chains and furthermore, the computed solution is subject...

PEPA
 Referenced in 113 articles
[sw10692]
 Evaluation Process Algebra. PEPA tools: The PEPA process algebra is supported by the PEPA Eclipse ... PEPA editor and performance analysers which use Markov chain or ODE methods or simulation. Performance...

FluCaP
 Referenced in 10 articles
[sw07748]
 search algorithm for solving FirstOrder Markov Decision Processes (FOMDPs). Our approach combines firstorder...

IPC4
 Referenced in 10 articles
[sw03495]
 approaches. One community consists of Markov decision process (MDP) researchers interested in developing algorithms that...

VAMPnets
 Referenced in 5 articles
[sw32927]
 equilibria and longtimescale kinetics of biomolecular processes, such as proteindrug binding, from high ... dimensionreduced data, and estimation of a Markov state model or related model ... employ the variational approach for Markov processes (VAMP) to develop a deep learning framework ... molecular coordinates to Markov states, thus combining the whole data processing pipeline in a single...

Rapture
 Referenced in 5 articles
[sw13409]
 Rapture: a tool for verifying Markov decision processes. We present a tool that performs verification ... quantified reachability properties over Markov decision processes (or probabilistic transition system). The originality...