The global adoption of artificial intelligence (AI) by government agencies is rapidly increasing, even though it is still in the early stages of implementation to realise the effective and efficient delivery of services to citizens. It is crucial that this integration aligns with essential governance values and enhances public accountability mechanisms and processes. However, there is a need for caution when incorporating AI technologies into public services due to the complex and value-driven nature of public administration and its vital role in delivering democracy. This chapter aims to contribute to this growing body of research by examining how AI can enable accountability mechanisms in accordance with ethical decision-making and principles of transparency in the public sector in Kenya and South Africa. In the end, the chapter provides policy recommendations for governance practitioners and decision-makers on how to leverage AI systems that would enhance public accountability standards within public sector institutions. While the impact of AI on automated decision-making in public services remains a topic of debate, it offers practical solutions for addressing common accountability challenges faced in many African public administration contexts. The analysis specifically focuses on AI's role in reinforcing democratic administration principles, such as public ethics, regulation, and transparent, inclusive decision-making processes.