Some Basic Concepts of Machine Learning

Machine Learning is tasked with extracting relationships from data that are relevant to the user. In this chapter, we formulate a simple linear model, the logistic regression model, which predicts the corresponding output for given inputs. The goal is to automatically find the relations between the existing input values and the output category in the data. For this purpose, a large number of numerical parameter values are modified step by step using a simple optimization procedure in such a way that the predicted outputs successively approach the correct outputs. The chapter describes the necessary procedure in all details, but with a minimum of mathematical formulas. The more complex models of the following chapters are built according to exactly the same scheme and use the investigated linear model as a universal building block.