Novetly in 3D CartPole Domain
摘要
This chapter expands on the underlying theory and applies it to a 3D CartPole domain. We introduce a Weibull Open World control-agent (WOW-agent) that uses Extreme Value Theory (EVT) to convert dissimilarity to probability of novelty. While novelty is something sufficiently dissimilar to the past experience, that does not mean the WOW-agent cannot reason about the novelty. While there have been many books addressing out-of-distribution detection, novel class discovery, and open-world learning, not all novelty is out-of-distribution data or a novel class.