Artificial Intelligence is progressively employed in the decision-making processes of the public sector; nevertheless, the absence of transparency and reliability in these systems may result in societal distrust. The domain of Explainable AI (XAI) has emerged as a critical instrument for augmenting transparency and accountability in this particular area. To effectively implement XAI in the public sector, it is crucial to employ systems that guarantee reliability and verifiability. Integrating blockchain technology—particularly through the use of oracles—provides external, trustworthy data to AI systems, enhancing explainability and enabling automation. Oracles act as secure bridges between external data sources and the blockchain, ensuring that AI models are based on authentic and tamper-proof information. Moreover, the decentralization, cryptography, and traceability offered by blockchain provides a guarantee to citizens: they ensure the integrity and confidentiality but also facilitate transparency and traceability in the decision-making process. The use of smart contracts automates compliance with regulations and policies, increasing the efficiency and security of AI systems. This approach assists in reducing the risk of bias and discrimination, facilitating auditing and oversight. By offering verifiable explanations of decisions, it fosters citizen's trust in institutions and promotes participation in the decision-making procedure. This integrated framework, grounded in ethical principles and respect for privacy, optimizes resource use while promoting equity and social cohesion. It facilitates the establishment of more robust and sustainable institutions by aligning with the Sustainable Development Objectives (SDOs). By supporting environmental and social sustainability, XAI enhanced with blockchain technology ensures a positive impact on both the community and the environment.