Gap between the best possible solution in our search space and the optimal solution, caused by approximation error.

Sensibility of the optimal solution found (in our search space) to the training set.

Small errors in the data which causes inexact search space exploration.