Artificial intelligence (AI) is a highly capable, cross-cutting technology. It offers many benefits to the public sector, especially with regard to efficiency and effectiveness gains. However, the use of AI in the public sector is also associated with a variety of risks that must be taken into account. Since the tasks of the public sector should be carried out in the interests of citizens and AI is a powerful and rapidly evolving technology, appropriate and agile AI governance is essential. In the public sector, governance is particularly important because it should ensure that tasks are carried out in the interests of citizens, that abuses of power are prevented, and that the activities of the state remain transparent. Furthermore, a technology that imitates human intelligence, i.e., becomes a public servant itself, should also behave like one and serve the people. Hence, this chapter introduces a public value-based agile approach to AI governance and explains different AI governance strategies for the public sector.