Quality Diversity Through Surprise

• Published in: IEEE transactions on evolutionary computation Vol. 23; no. 4; pp. 603 - 616
• Main Authors: Gravina, Daniele, Liapis, Antonios, Yannakakis, Georgios N.
• Format: Journal Article
• Language: English
• Published: New York IEEE 01-08-2019; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Birds; Competition; Divergence; Diversity reception; Evolutionary algorithms; Local competition; maze navigation; Navigation; neuroevolution of augmenting topology (NEAT); novelty search; quality diversity (QD); Robustness; Search algorithms; Search problems; surprise search (SS); Task analysis
• ISSN: 1089-778X; 1941-0026
• DOI: 10.1109/TEVC.2018.2877215

Quality diversity (QD) is a recent family of evolutionary search algorithms which focus on finding several well-performing ( quality ) yet different ( diversity ) solutions with the aim to maintain an appropriate balance between divergence and convergence during search. While QD has already delivered promising results in complex problems, the capacity of divergent search variants for QD remains largely unexplored. Inspired by the notion of surprise as an effective driver of divergent search and its orthogonal nature to novelty this paper investigates the impact of the former to QD performance. For that purpose we introduce three new QD algorithms which employ surprise as a diversity measure, either on its own or combined with novelty, and compare their performance against novelty search with local competition, the state of the art QD algorithm. The algorithms are tested in a robot navigation task across 60 highly deceptive mazes. Our findings suggest that allowing surprise and novelty to operate synergistically for divergence and in combination with local competition leads to QD algorithms of significantly higher efficiency, speed, and robustness.