Journal article · 2025 · Open access

Markov Chain–Based Policies for Multistage Stochastic Integer Linear Programming with an Application to Disaster Relief Logistics

Margarita P. Castro, Merve Bodur, Yongjia Song

Manufacturing & Service Operations Management, 28(3), 956–974 · Published 29 December 2025 · DOI 10.1287/msom.2023.0658

Open PDFView at the publisherCite this paper

In brief

“Markov Chain–Based Policies for Multistage Stochastic Integer Linear Programming with an Application to Disaster Relief Logistics” is a 2025 journal article by Margarita P. Castro and 2 co-authors, published in Manufacturing & Service Operations Management. OpenAlex counts 9 citations as of 17 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).

Citations
9
Most cited in
2025 (4)
Field-weighted impact
2.79
References
48
Authors
3

Abstract

Problem definition: Multistage stochastic programs involving mixed-integer state variables and continuous local variables (MSILPs) present a challenging class of optimization problems with limited techniques available to obtain high-quality solutions efficiently. These problems arise in many practical applications, including disaster relief logistics planning for natural disasters such as hurricanes, which is increasingly important due to its significant societal impacts. Methodology/results: We introduce an aggregation framework to address MSILPs that impose additional structure on the integer state variables by leveraging information from the underlying stochastic process, which is modeled as a Markov chain (MC). We demonstrate that the aggregated MSILP can be solved exactly via a branch-and-cut algorithm integrated with a variant of the stochastic dual dynamic programming method. To improve tractability, we use this approach to obtain dual bounds. To obtain high-quality decision policies with significantly reduced computational effort, we apply two-stage linear decision rule (2SLDR) approximations, including a new MC-based variant that we propose. Managerial implications: We test the proposed methodologies on an MSILP arising from hurricane disaster relief logistics planning. Our empirical evaluation compares the effectiveness of the various proposed approaches and analyzes the tradeoffs between policy flexibility, solution quality, and computational effort. Specifically, the 2SLDR approximation yields provable high-quality solutions for our test instances, supported by the proposed bounding procedure. We also extract valuable managerial insights from the solution behaviors exhibited by the underlying decision policies: (i) adaptive planning is most valuable in constrained systems; (ii) effective policies incorporate trend indicators to anticipate future needs; and (iii) adaptability can capture the majority of performance gains over static approaches. Funding: M. Castro was partially supported by the National Center for Artificial Intelligence [Grant CENIA FB210017 (Basal ANID)] and the Agencia Nacional de Investigación y Desarrollo of Chile [Grant ANID-FONDECYT-11230797]. Y. Song was partially supported by the National Science Foundation [Grant Agreement CMMI 2045744]. Any opinions, findings, and conclusions or recommendations expressed in this paper are those of the authors and do not necessarily reflect the views of the National Science Foundation. Supplemental Material: The online appendices are available at https://doi.org/10.1287/msom.2023.0658 .

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Castro, M. P., Bodur, M., & Song, Y. (2025). Markov Chain–Based Policies for Multistage Stochastic Integer Linear Programming with an Application to Disaster Relief Logistics. Manufacturing & Service Operations Management, 28(3), 956–974. https://doi.org/10.1287/msom.2023.0658

MLA 9

Castro, Margarita P., et al. “Markov Chain–Based Policies for Multistage Stochastic Integer Linear Programming with an Application to Disaster Relief Logistics.” Manufacturing & Service Operations Management, vol. 28, no. 3, 2025, pp. 956–974. https://doi.org/10.1287/msom.2023.0658.

Chicago

Castro, Margarita P., Merve Bodur, and Yongjia Song. 2025. “Markov Chain–Based Policies for Multistage Stochastic Integer Linear Programming with an Application to Disaster Relief Logistics.” Manufacturing & Service Operations Management 28 (3): 956–974. https://doi.org/10.1287/msom.2023.0658.

Harvard

Castro, M. P., Bodur, M. and Song, Y. (2025) ‘Markov Chain–Based Policies for Multistage Stochastic Integer Linear Programming with an Application to Disaster Relief Logistics’, Manufacturing & Service Operations Management, 28(3), pp. 956–974. doi:10.1287/msom.2023.0658.

IEEE

M. P. Castro, M. Bodur, and Y. Song, “Markov Chain–Based Policies for Multistage Stochastic Integer Linear Programming with an Application to Disaster Relief Logistics,” Manufacturing & Service Operations Management, vol. 28, no. 3, pp. 956–974, 2025, doi: 10.1287/msom.2023.0658.

BibTeX

@article{castro2025markov,
  title     = {{Markov Chain–Based Policies for Multistage Stochastic Integer Linear Programming with an Application to Disaster Relief Logistics}},
  author    = {Castro, Margarita P. and Bodur, Merve and Song, Yongjia},
  journal   = {Manufacturing \& Service Operations Management},
  year      = {2025},
  volume    = {28},
  number    = {3},
  pages     = {956--974},
  doi       = {10.1287/msom.2023.0658},
  url       = {https://doi.org/10.1287/msom.2023.0658}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202311
202411
202544
202633

Its field-weighted citation impact is 2.79: it has been cited 2.79 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Risk and Portfolio Optimization

  • Markov chain aggregation
  • emergency logistics
  • stochastic dual dynamic programming
  • branch-and-cut
  • linear decision rules
  • adaptive planning
  • dual bounds
  • natural disasters

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Castro, M. P., Bodur, M., & Song, Y. (2025). Markov Chain–Based Policies for Multistage Stochastic Integer Linear Programming with an Application to Disaster Relief Logistics. Manufacturing & Service Operations Management, 28(3), 956–974. https://doi.org/10.1287/msom.2023.0658

How many times has this paper been cited?

9 times, according to OpenAlex on 17 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Margarita P. Castro, Merve Bodur, Yongjia Song.

What is the DOI of this paper?

10.1287/msom.2023.0658, permanently at https://doi.org/10.1287/msom.2023.0658. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 17 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.