When a dataset does not have a normal distribution, it is not appropriate to use parametric statistics. The solution is to use non-parametric statistics in which statistical probability is in general  inferred from the ranking of values in numerical order. Tests in non-parametric statistics have their corresponding tests in parametric statistics, for example in correlation analysis where Spearman rank correlation in non-parametric statistics is the equivalent of Pearson’s correlation in parametric statistics.