Skip to yearly menu bar Skip to main content

In-Person Poster presentation / top 5% paper

Fast and Precise: Adjusting Planning Horizon with Adaptive Subgoal Search

Michał Zawalski · Michał Tyrolski · Konrad Czechowski · Tomasz Odrzygóźdź · Damian Stachura · Piotr Piękos · Yuhuai Wu · Łukasz Kuciński · Piotr Miłoś

MH1-2-3-4 #102

Keywords: [ search ] [ deep learning ] [ hierarchical planning ] [ adaptive horizon ] [ verification ] [ Reinforcement Learning ]


Complex reasoning problems contain states that vary in the computational cost required to determine the right action plan. To take advantage of this property, we propose Adaptive Subgoal Search (AdaSubS), a search method that adaptively adjusts the planning horizon. To this end, AdaSubS generates diverse sets of subgoals at different distances. A verification mechanism is employed to filter out unreachable subgoals swiftly, making it possible to focus on feasible further subgoals. In this way, AdaSubS benefits from the efficiency of planning with longer-term subgoals and the fine control with shorter-term ones, and thus scales well to difficult planning problems. We show that AdaSubS significantly surpasses hierarchical planning algorithms on three complex reasoning tasks: Sokoban, the Rubik’s Cube, and the inequality-proving benchmark INT.

Chat is not available.