Manufacturing environments involve a lot of testing processes that assess different product features that are critical for evaluating the quality of the product. As the requirements of quality checks and balances increase, so does the time a product spends on the testing bench for approval or rejection. To overcome the dilemma of excluding features in analysis while not compromising on pre-defined standards, it is essential to identify which tests or features are redundant or irrelevant in prediction problems, especially when the tests are anonymized for privacy or confidentiality purposes. To achieve this objective, this paper presents a comparison analysis of three types of transformations for anonymized non-numerical data while handling higher dimensions through data filtering based on thresholds. This includes a novel transformation of non-numerical data to segmented and decimal-encoded samples. A public dataset is used for this purpose, containing only categorical and binary data and observed quality check time in seconds. The implementation and results show that model efficiency without domain knowledge of the tests is not impossible, with over 50% R2 Score on a completely unseen test set of equal size as the training set.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Handling Anonymized Non-numerical Features in Data Using Transformations for Regression Models

  • Selvine G. Mathias,
  • Muhammad Uzair Akmal,
  • Saara Asif,
  • Simon Knollmeyer,
  • Leonid Koval,
  • Daniel Grossmann

摘要

Manufacturing environments involve a lot of testing processes that assess different product features that are critical for evaluating the quality of the product. As the requirements of quality checks and balances increase, so does the time a product spends on the testing bench for approval or rejection. To overcome the dilemma of excluding features in analysis while not compromising on pre-defined standards, it is essential to identify which tests or features are redundant or irrelevant in prediction problems, especially when the tests are anonymized for privacy or confidentiality purposes. To achieve this objective, this paper presents a comparison analysis of three types of transformations for anonymized non-numerical data while handling higher dimensions through data filtering based on thresholds. This includes a novel transformation of non-numerical data to segmented and decimal-encoded samples. A public dataset is used for this purpose, containing only categorical and binary data and observed quality check time in seconds. The implementation and results show that model efficiency without domain knowledge of the tests is not impossible, with over 50% R2 Score on a completely unseen test set of equal size as the training set.