Ethical considerations are paramount in healthcare, where the use of conversational AI directly impacts patient safety, trust, and the quality of care. Ensuring that AI systems adhere to principles of accuracy, privacy, transparency, and harm prevention is essential to prevent misuse and maintain the integrity of medical practices. This research compares the ethical implications of utilizing Generative AI models, specifically ChatGPT and Bard, in healthcare applications. By evaluating these models through five core ethical dimensions—accuracy, privacy, security, transparency, and harm prevention—the study identifies their respective strengths and weaknesses in addressing healthcare-related queries. The proposed framework provides a structured approach to assess AI responses, ensuring alignment with essential healthcare standards and maintaining patient safety and trust. The findings reveal that Bard demonstrates a robust ethical stance by delivering trustworthy and transparent information, supporting human judgment, and mitigating risks in healthcare settings. In contrast, ChatGPT excels in providing emotional support and fostering trust through human-like interactions, making it valuable in patient-centered scenarios. This research underscores the importance of adhering to ethical and legal standards to integrate AI responsibly in healthcare, balancing the delivery of accurate information with emotional engagement. Ultimately, ethical design and deployment of AI are critical to enhancing accessibility, trust, and the future reliability of medical services.