Bias Busters: Fair Text Generation with GPT-2
摘要
This study presents a methodology to mitigate biases in text generation across multiple demographic attributes, including gender, profession, religion, and race. By fine-tuning the GPT-2 model, we integrate dual-embedding space contrastive learning, optimal transport for embedding alignment, differential privacy for secure updates, and fairness-constrained optimization. Experiments using the StereoSet dataset achieve a balanced Stereotype Score (SS) of 51.24, outperforming most existing models.