Artificial Intelligence is an essential tool for early disease recognition and supporting patient condition monitoring in the future. Timely and exact conclusions about the type of disease are significant for treatment and life extension. A combination of classification and feature selection algorithms can effectively handle complex datasets in the medical field and improve the accuracy of disease diagnosis and treatment. In this paper, we propose a new hybrid feature selection algorithm that uses inconsistency metrics as a filter method for the first step, and then feeds the resulting dataset into a wrapper method, which ultimately results in a reduced dataset. The proposed HFSIM algorithm is tested on five datasets in the medical domain from Kaggle. The obtained feature subsets are verified on three classification algorithms, KNN, LR and RF of machine learning to validate the effectiveness of the proposed algorithm. The experimental results show that the proposed algorithm obtains feature subsets with low dimensionality on most of the datasets and also has high classification accuracy after testing on the classifiers.