The purpose of this paper is to review the state-of-the-art in intrinsic motivation, specifically in the absence of explicit goals. This paper focuses on how intrinsic motivation is used in constructivist machine learning to foster exploration, learning, and adaptability in complex environments. In particular, this paper provides a survey of several kinds of intrinsic motivation and discusses how they can be used.