Optimization is the task of finding the best solution among many candidates by maximizing or minimizing an objective function. This function measures the quality or performance of each solution. Optimization is central in machine learning, engineering, and science whenever a system must make an optimal decision or choose an optimal configuration