Feature selection in text classification refers to the critical process of identifying and selecting the most relevant and informative features such as words, phrases, or other linguistic elements from a text dataset. This process, which has been a research topic for decades and finds applications across various fields such as bioinformatics, image recognition, image retrieval, text mining, etc., is essential for optimizing classification accuracy and efficiency. Addressing the challenge of high dimensionality in text data, stemming from the abundance of features like words or n-grams, is crucial to mitigate computational inefficiency and overfitting. Furthermore, the presence of irrelevant or redundant features in text datasets poses another significant challenge, as these features can introduce noise or irrelevant information, thereby undermining the performance of classifier. In this paper, we proposed a new approach GL-SMCHI using improved features selection method to reduce the CHI value of high-frequency words, and globalization technique to incorporate both feature and class information when evaluating the importance of each feature. We compared the results obtained from our proposal against those of existing robust alternatives, The simulation results show that the proposed method outperforms the standard CHI squared, the improved feature selection methods, and the globalization method in term of F-Score and accuracy.