Traditional methods for detecting malware often overlook the nuanced behaviors associated with fraudulent activities. In this work, we present FairPlay, a novel approach that uses machine learning algorithms to identify instances of malware and search rank fraud on Google Play. FairPlay detects suspicious activity linked to both forms of fraud by using linguistic and behavioral signals that are taken from app data. Through extensive experimentation, we demonstrate that FairPlay achieves an accuracy rate exceeding 95% in detecting fraudulent behavior, with a notable success rate in identifying malware instances engaged in search rank manipulation. Additionally, FairPlay uncovers new forms of fraudulent activities, including forcible review campaigns. Our findings highlight the effectiveness of FairPlay in combating fraudulent behaviors in Google Play, offering valuable insights for enhancing platform security and protecting users from malicious activities.