Skip to content

Commit 8e7460b

Browse files
committed
New release with R-Journal pub.
1 parent 6a39e42 commit 8e7460b

11 files changed

Lines changed: 81 additions & 27 deletions

File tree

DESCRIPTION

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
Package: pomdp
22
Title: Infrastructure for Partially Observable Markov Decision Processes (POMDP)
3-
Version: 1.2.4
4-
Date: 2024-12-05
3+
Version: 1.2.5
4+
Date: 2025-05-29
55
Authors@R: c(
66
person(given = "Michael",
77
family = "Hahsler",
@@ -11,7 +11,7 @@ Authors@R: c(
1111
person(given = "Hossein",
1212
family = "Kamalzadeh",
1313
role = c("ctb")))
14-
Description: Provides the infrastructure to define and analyze the solutions of Partially Observable Markov Decision Process (POMDP) models. Interfaces for various exact and approximate solution algorithms are available including value iteration, point-based value iteration and SARSOP. Smallwood and Sondik (1973) <doi:10.1287/opre.21.5.1071>.
14+
Description: Provides the infrastructure to define and analyze the solutions of Partially Observable Markov Decision Process (POMDP) models. Interfaces for various exact and approximate solution algorithms are available including value iteration, point-based value iteration and SARSOP. Hahsler and Cassandra <doi:10.32614/RJ-2024-021>.
1515
Classification/ACM: G.4, G.1.6, I.2.6
1616
URL: https://github.com/mhahsler/pomdp
1717
BugReports: https://github.com/mhahsler/pomdp/issues

NEWS.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,9 @@
1+
# pomdp 1.2.5 (05/29/2025)
2+
3+
## Changes
4+
* Added source data to GitHub
5+
* Added reference to the R-Journal article.
6+
17
# pomdp 1.2.4 (12/04/2024)
28

39
## New Features

README.Rmd

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -15,9 +15,9 @@ A partially observable Markov decision process (POMDP) models an agent decision
1515
where the agent cannot directly observe the environment's state, but has to rely on
1616
observations. The goal is to find an optimal policy to guide the agent's actions.
1717

18-
The `pomdp` package provides the infrastructure to define and analyze the solutions
18+
The `pomdp` package [@Hahsler2025] provides the infrastructure to define and analyze the solutions
1919
of optimal control problems formulated as Partially Observable Markov Decision Processes (POMDP).
20-
The package uses the solvers from [pomdp-solve](http://www.pomdp.org/code/) (Cassandra, 2015)
20+
The package uses the solvers from [pomdp-solve](http://www.pomdp.org/code/) [@Cassandra2015]
2121
available in the companion R package [**pomdpSolve**](https://github.com/mhahsler/pomdpSolve) to solve
2222
POMDPs using a variety of exact and approximate algorithms.
2323

@@ -42,7 +42,7 @@ to the following algorithms:
4242
If you are new to POMDPs then start with the [POMDP Tutorial](https://pomdp.org/tutorial/).
4343

4444
```{r echo=FALSE, results = 'asis'}
45-
pkg_citation(pkg, 1)
45+
pkg_citation(pkg, 2)
4646
pkg_install(pkg)
4747
```
4848

README.md

Lines changed: 30 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -15,11 +15,12 @@ decision process where the agent cannot directly observe the
1515
environment’s state, but has to rely on observations. The goal is to
1616
find an optimal policy to guide the agent’s actions.
1717

18-
The `pomdp` package provides the infrastructure to define and analyze
19-
the solutions of optimal control problems formulated as Partially
20-
Observable Markov Decision Processes (POMDP). The package uses the
21-
solvers from [pomdp-solve](http://www.pomdp.org/code/) (Cassandra, 2015)
22-
available in the companion R package
18+
The `pomdp` package (Hahsler and Cassandra 2025) provides the
19+
infrastructure to define and analyze the solutions of optimal control
20+
problems formulated as Partially Observable Markov Decision Processes
21+
(POMDP). The package uses the solvers from
22+
[pomdp-solve](http://www.pomdp.org/code/) (Cassandra 2015) available in
23+
the companion R package
2324
[**pomdpSolve**](https://github.com/mhahsler/pomdpSolve) to solve POMDPs
2425
using a variety of exact and approximate algorithms.
2526

@@ -50,16 +51,21 @@ Tutorial](https://pomdp.org/tutorial/).
5051

5152
To cite package ‘pomdp’ in publications use:
5253

53-
> Hahsler M (2024). *pomdp: Infrastructure for Partially Observable
54-
> Markov Decision Processes (POMDP)*. R package version 1.2.4,
55-
> <https://github.com/mhahsler/pomdp>.
56-
57-
@Manual{,
58-
title = {pomdp: Infrastructure for Partially Observable Markov Decision Processes (POMDP)},
59-
author = {Michael Hahsler},
60-
year = {2024},
61-
note = {R package version 1.2.4},
62-
url = {https://github.com/mhahsler/pomdp},
54+
> Hahsler M, Cassandra AR (2025). “Pomdp: A computational infrastructure
55+
> for partially observable Markov decision processes.” *The R Journal*,
56+
> *16*(2), 1-18. ISSN 2073-4859, <doi:10.32614/RJ-2024-021>
57+
> <https://doi.org/10.32614/RJ-2024-021>.
58+
59+
@Article{,
60+
title = {Pomdp: A computational infrastructure for partially observable Markov decision processes},
61+
author = {Michael Hahsler and Anthony R. Cassandra},
62+
year = {2025},
63+
journal = {The R Journal},
64+
volume = {16},
65+
number = {2},
66+
pages = {1--18},
67+
doi = {10.32614/RJ-2024-021},
68+
issn = {2073-4859},
6369
}
6470

6571
## Installation
@@ -163,6 +169,15 @@ Thirteenth Conference on Uncertainty in Artificial Intelligence*,
163169

164170
</div>
165171

172+
<div id="ref-Hahsler2025" class="csl-entry">
173+
174+
Hahsler, Michael, and Anthony R. Cassandra. 2025. “Pomdp: A
175+
Computational Infrastructure for Partially Observable Markov Decision
176+
Processes.” *The R Journal* 16 (2): 116–33.
177+
<https://doi.org/10.32614/RJ-2024-021>.
178+
179+
</div>
180+
166181
<div id="ref-Kurniawati2008" class="csl-entry">
167182

168183
Kurniawati, Hanna, David Hsu, and Wee Sun Lee. 2008. “SARSOP: Efficient

inst/CITATION

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1 +1,22 @@
11
citation(auto = meta)
2+
3+
bibentry(bibtype = "article",
4+
title = paste("Pomdp: A computational infrastructure for partially",
5+
"observable Markov decision processes"),
6+
author = {
7+
c(person("Michael", "Hahsler",
8+
email = "mhahsler@lyle.smu.edu",
9+
comment = c(ORCID = "0000-0003-2716-1405")
10+
),
11+
person(c("Anthony", "R."), "Cassandra",
12+
email = "cassandra@gmail.com")
13+
)
14+
},
15+
year = 2025,
16+
journal = "The R Journal",
17+
volume = 16,
18+
number = 2,
19+
pages = "116--133",
20+
doi = "10.32614/RJ-2024-021",
21+
issn = "2073-4859"
22+
)
-62 Bytes
Loading

man/pomdp-package.Rd

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

man/solve_SARSOP.Rd

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

vignettes/gridworlds.Rmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -27,7 +27,7 @@ library(pomdp)
2727

2828
Gridworlds represent an easy to explore how Markov Decision Problems (MDPs),
2929
Partially Observable Decision Problems (POMDPs), and various approaches to solve these problems
30-
work. The R package **pomdp** [@Hahsler2024] provides a set of helper functions starting with the
30+
work. The R package **pomdp** [@Hahsler2025],[@Hahsler2024] provides a set of helper functions starting with the
3131
prefix `gridworld_`
3232
to make defining and experimenting with gridworlds easy.
3333

vignettes/pomdp.Rmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ library("pomdp")
2424

2525
# Introduction
2626

27-
The R package **pomdp** [@Hahsler2024] provides the infrastructure to define and
27+
The R package **pomdp** [@Hahsler2025],[@Hahsler2024] provides the infrastructure to define and
2828
analyze the solutions of Partially Observable Markov Decision Processes
2929
(POMDP) models. The package is a companion to package **pomdpSolve**
3030
which provides the executable for

0 commit comments

Comments
 (0)