Loading…
POMDPs.jl is a Julia package that provides an interface for defining, solving, and simulating partially observable MDPs (POMDPs) and MDPs, supporting discrete and continuous state, action, and observation spaces. It offers an ecosystem including the POMDPTools standard library with distributions, belief updaters, policies, and simulators, plus multiple solvers and integration with CommonRLInterface. Users define problems, write solvers, run simulations, analyze results, and visualize policies, with examples like GridWorld and Tiger/POMDP problems.
AI named POMDPs.jl in October 2025.