↑ arvau

Wikipedia / Barrier function

In constrained optimization, a field of mathematics, a barrier function is a continuous function whose value increases to infinity as its argument approaches the boundary of the feasible region of an optimization problem. Such functions are used to replace inequality constraintss by a penalizing term in the objective function that is easier to handle. A barrier function is also called an interior penalty function, as it is a penalty function that forces the solution to remain within the interior of the feasible region.

The two most common types of barrier functions are inverse barrier functions and logarithmic barrier functions. Resumption of interest in logarithmic barrier functions was motivated by their connection with primal-dual interior point methods.

Motivation

Consider the following constrained optimization problem:

  1. minimize

  2. subject to

where is some constant. If one wishes to remove the inequality constraint, the problem can be reformulated as

  1. minimize ,

  2. where if , and zero otherwise.

This problem is equivalent to the first. It gets rid of the inequality, but introduces the issue that the penalty function , and therefore the objective function , is discontinuous, preventing the use of calculus to solve it.

A barrier function, now, is a continuous approximation to that tends to infinity as approaches from below. Using such a function, a new optimization problem is formulated, viz.

  1. minimize

where is a free parameter. This problem is not equivalent to the original, but as approaches zero, it becomes an ever-better approximation.

Logarithmic barrier function

tends to 0.

), while having relatively low impact on the function away from these extremes.

Logarithmic barrier functions may be favored over less computationally expensive inverse barrier functions depending on the function being optimized.

Higher dimensions

.

Formal definition

Define logarithmic barrier

See also

References