Responsive Mechanism for Cloud Offloading Data Intrusion Detection Using Spark—Machine Learning Model

Cloud Offloading is an essential method for the data decentralized distribution and management hence multiple approaches can result in intrusion. Spark MLlib intrusion detection typically uses multiple algorithms and works on Resilient Data Distribution on the cloud to detect the intrusion information, and is not equipped with the flexibility and low detection rate inability to deal with high-dimensional data, and can’t solve these issues efficiently. To enhance the effectiveness of the intrusion detection over cloud offloading, an innovative general intrusion detection framework that is being developed with the spark that has a resilient distribution of data across the cloud has been proposed in this paper. It comprises four components a preprocessing module, a label encoder module, a feedback module, and a classification module. Preprocessing module information is compressed using the module to label encoder. This creates a less-dimensional reconstruction and classification feature. The database module can store the compressed features of all traffic. This allows for retraining as it tests the classifier and then restores these features back into the original traffic. To test the framework's effectiveness, simulations were performed using CLOUD OFFLOADING DATA INTRUSION DETECTION SYSTEM CODIDS 2017 data set to match the actual network traffic. According to the test results showed, the precision of multiclass and binary classification is superior to previous research. A good level of accuracy has been achieved for assorted traffic data. In the end, the possibility of using the proposed framework for edge/fog networks is given.