Our work on developing an index for sequential resource allocation in non-markovian environments is accepted at IJCAI 2023!