• PRISM

  • Referenced in 395 articles [sw01186]
  • probabilistic models: discrete-time Markov chains, Markov decision processes and continuous-time Markov chains. Analysis...
  • pomp

  • Referenced in 35 articles [sw10664]
  • pomp: Statistical Inference for Partially Observed Markov Processes. Tools for working with partially observed Markov...
  • MRMC

  • Referenced in 66 articles [sw04129]
  • bounded reachability analysis for continuous-time Markov decision processes (CTMDPs) and CSL model checking...
  • msm

  • Referenced in 40 articles [sw08096]
  • fitting general continuous-time Markov and hidden Markov multi-state models to longitudinal data ... variety of observation schemes are supported, including processes observed at arbitrary times (panel data), continuously ... Markov transition rates and the hidden Markov output process can be modelled in terms...
  • MesoRD

  • Referenced in 30 articles [sw18202]
  • exact method to simulate the Markov process corresponding to the reaction-diffusion master equation. Availability...
  • Möbius

  • Referenced in 24 articles [sw04098]
  • solution, based on compact MDD-based Markov processes, are both supported...
  • SMART_

  • Referenced in 33 articles [sw04097]
  • available when the underlying process is a Markov chain. In addition, discrete-event simulation ... stochastic nature of the process, but certain classes of non-Markov models can still...
  • POMDPS

  • Referenced in 34 articles [sw03055]
  • planning algorithms for POMDPS. Partially Observable Markov Decision Processes (POMDPs) provide a rich framework...
  • POMDP

  • Referenced in 20 articles [sw03204]
  • Partially Observable Markov Decision Process (POMDP). The ’pomdp-solve’ program solves problems that are formulated ... partially observable Markov decision processes, a.k.a. POMDPs. It uses the basic dynamic programming approach...
  • LiQuor

  • Referenced in 18 articles [sw04136]
  • operational semantics based on (finite) Markov decision processes. LiQuor provides the facility to perform...
  • FAUST2

  • Referenced in 8 articles [sw23682]
  • possibly non-deterministic) discrete-time Markov processes (dtMP) defined over uncountable (continuous) state spaces ... finite-state Markov chain or Markov decision processes. The abstraction procedure runs in MATLAB...
  • spBayes

  • Referenced in 297 articles [sw10160]
  • Unfortunately, fitting such models involves computationally intensive Markov chain Monte Carlo (MCMC) methods whose efficiency ... encompassing a wide variety of Gaussian spatial process models for univariate as well as multivariate...
  • BGPhazard

  • Referenced in 25 articles [sw11014]
  • BGPhazard: Markov beta and gamma processes for modeling hazard rates. Computes the hazard rate estimate...
  • moveHMM

  • Referenced in 12 articles [sw16166]
  • animal movement modelling using hidden Markov models. These include processing of tracking data, fitting hidden ... Markov models to movement data, visualization of data and fitted model, decoding of the state ... process...
  • Expokit

  • Referenced in 171 articles [sw00258]
  • Krylov subspace projection methods (Arnoldi and Lanczos processes), and that is why the toolkit ... critical importance in the area of Markov chains and furthermore, the computed solution is subject...
  • PEPA

  • Referenced in 113 articles [sw10692]
  • Evaluation Process Algebra. PEPA tools: The PEPA process algebra is supported by the PEPA Eclipse ... PEPA editor and performance analysers which use Markov chain or ODE methods or simulation. Performance...
  • FluCaP

  • Referenced in 10 articles [sw07748]
  • search algorithm for solving First-Order Markov Decision Processes (FOMDPs). Our approach combines first-order...
  • IPC-4

  • Referenced in 10 articles [sw03495]
  • approaches. One community consists of Markov decision process (MDP) researchers interested in developing algorithms that...
  • VAMPnets

  • Referenced in 5 articles [sw32927]
  • equilibria and long-timescale kinetics of biomolecular processes, such as protein-drug binding, from high ... dimension-reduced data, and estimation of a Markov state model or related model ... employ the variational approach for Markov processes (VAMP) to develop a deep learning framework ... molecular coordinates to Markov states, thus combining the whole data processing pipeline in a single...
  • Rapture

  • Referenced in 5 articles [sw13409]
  • Rapture: a tool for verifying Markov decision processes. We present a tool that performs verification ... quantified reachability properties over Markov decision processes (or probabilistic transition system). The originality...