Universität Karlsruhe
Search Space Reduction for Strategy Learning in Sequential Decision Processes

Konferenzartikel

[1]Ralf Schoknecht, Martin Spott, Florian Liekweg, Martin Riedmiller, Search Space Reduction for Strategy Learning in Sequential Decision Processes, Proc. of Iconip 99, Nov 1999.

Zusammenfassung

Sequential decision making in large domains requires high computational expense. With the classical dynamic programming approach a rising problem size soon leads to intractability because of time and memory constraints. This situation can be significantly remedied by using more advanced reinforcement learning techniques in combination with generalizing function approximators. However, this may lead to unstable learning behaviour as the strict convergence results are no longer valid. This paper presents an approach to stabilize learning by gradually reducing the search space for the optimal decision policy. This is done by iteratively adapting the action set according to the progress of learning. Experiments are described within the Fynesse control architecture that is a framework for autonomously learning adaptive control strategies.

[Erzeuge bibTeX Eintrag]

Autoren

Alumni
Dr. Florian Liekweg
Dr. Martin Spott
Partner
Dr. Martin Riedmiller
Ralf Schoknecht
Login
Links