错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Parallelized Distributed Computing for Large-Scale Support Vector Machine Training

  • Elma Sibonghanoy Groenewald,
  • Sarath Babu Dodda,
  • Coenrad Adolph Groenewald,
  • Amol Dhumane,
  • Aditi Sharma,
  • Ketan Kotecha

摘要

Support vector machines (SVMs) are powerful machine learning models that can be used for many things, from identifying images to managing money. Unfortunately, training SVMs on large datasets is very hard because the time required goes up in a linear way as the dataset size rises. To solve this problem, we suggest a model for parallelized distributed computing that can be used for large-scale SVM training that works well. Distributed computing and parallel processing are used in our method to speed up SVM training. We divide the information into pieces that are easier to handle and send them to different computers. Each node learns a local SVM model on the assigned group on its own. This simultaneous processing cuts down on the time needed to train models by a large amount. Because the system is spread, we can also handle files that are too big to fit in memory on a single machine. To ensure that the model is correct, we combine local SVM models in a way that communicates efficiently. We created a big model that looks at important parts of all the information we have. It needs different parts to work together again and again. This makes a really good model that guesses right a lot. We tried this way on real situations and saw it’s much faster to get ready while still being as good as other ways. This method can change to fit different needs and work with different SVM types and actions. People who work on tough SVM problems will find this tool helpful because it’s easy to include in the machine learning work they’re already doing.