11. Primal feasibility repair


Section 10.2.2 discusses how MOSEK treats infeasible problems. In particular, it is discussed which information MOSEK returns when a problem is infeasible and how this information can be used to pinpoint the elements causing the infeasibility.

In this section we will discuss a method for repairing a primal infeasible problem by relaxing the constraints in a controlled way. For the sake of simplicity we discuss the method in the context of linear optimization. MOSEK can also repair infeasibilities in quadratic and conic optimization problems possibly having integer constrained variables. Please note that infeasibilities in nonlinear optimization problems can't be repaired using the method described below.

11.1. The main idea

Consider the linear optimization problem with m constraints and n variables

\begin{math}\nonumber{}\begin{array}{lccccl}\nonumber{}\mbox{minimize} &  &  & c^{T}x+c^{f} &  & \\\nonumber{}\mbox{subject to} & l^{c} & \leq{} & Ax & \leq{} & u^{c},\\\nonumber{} & l^{x} & \leq{} & x & \leq{} & u^{x},\end{array}\end{math} (11.1.1)

which we assume is infeasible. Moreover, we assume that

\begin{math}\nonumber{}(l^{c})_{i}\leq{}(u^{c})_{i},~\forall i\end{math} (11.1.2)

and

\begin{math}\nonumber{}(l^{x})_{j}\leq{}(u^{x})_{j},~\forall j\end{math} (11.1.3)

because otherwise the problem (11.1.1) is trivially infeasible.

One way of making the problem feasible is to reduce the lower bounds and increase the upper bounds. If the change is sufficiently large the problem becomes feasible.

One obvious question is: What is the smallest change to the bounds that will make the problem feasible?

We associate a weight with each bound:

Now, the problem

\begin{math}\nonumber{}\begin{array}{lccccl}\nonumber{}\mbox{minimize} &  &  & p &  & \\\nonumber{}\mbox{subject to} & l^{c} & \leq{} & Ax+v_{l}^{c}-v_{u}^{c} & \leq{} & u^{c},\\\nonumber{} & l^{x} & \leq{} & x+v_{l}^{x}-v_{u}^{x} & \leq{} & u^{x},\\\nonumber{} &  &  & (w_{l}^{c})^{T}v_{l}^{c}+(w_{u}^{c})^{T}v_{u}^{c}+(w_{l}^{x})^{T}v_{l}^{x}+(w_{u}^{x})^{T}v_{u}^{x}-p & \leq{} & 0,\\\nonumber{} &  &  & v_{l}^{c},v_{u}^{c},v_{l}^{x},v_{u}^{x}\geq{}0 &  &\end{array}\end{math} (11.1.4)

minimizes the weighted sum of changes to the bounds that makes the problem feasible. The variables [[MathCmd 497]], [[MathCmd 498]], [[MathCmd 499]] and [[MathCmd 498]] are elasticity variables because they allow a constraint to be violated and hence add some elasticity to the problem. For instance, the elasticity variable [[MathCmd 497]] shows how much the lower bound [[MathCmd 502]] should be relaxed to make the problem feasible. Since p is minimized and

\begin{math}\nonumber{}(w_{l}^{c})^{T}v_{l}^{c}+(w_{u}^{c})^{T}v_{u}^{c}+(w_{l}^{x})^{T}v_{l}^{x}+(w_{u}^{x})^{T}v_{u}^{x}-p\leq{}0,\end{math} (11.1.5)

a large [[MathCmd 504]] tends to imply that the elasticity variable [[MathCmd 497]] will be small in an optimal solution.

The reader may want to verify that the problem (11.1.4) is always feasible given the assumptions (11.1.2) and (11.1.3).

Please note that if a weight is negative then the resulting problem (11.1.4) is unbounded.

The weights [[MathCmd 506]], [[MathCmd 507]], [[MathCmd 508]], and [[MathCmd 509]] can be regarded as a costs (penalties) for violating the associated constraints. Thus a higher weight implies that higher priority is given to the satisfaction of the associated constraint.

The main idea can now be presented as follows. If you have an infeasible problem, then form the problem (11.1.4) and optimize it. Next inspect the optimal solution [[MathCmd 510]], and [[MathCmd 511]] to problem (11.1.4). This solution provides a suggested relaxation of the bounds that will make the problem feasible.

Assume that [[MathCmd 512]] is an optimal objective value to (11.1.4). An extension of the idea presented above is to solve the problem

\begin{math}\nonumber{}\begin{array}{lccccl}\nonumber{}\mbox{minimize} &  &  & c^{T}x &  & \\\nonumber{}\mbox{subject to} & l^{c} & \leq{} & Ax+v_{l}^{c}-v_{u}^{c} & \leq{} & u^{c},\\\nonumber{} & l^{x} & \leq{} & x+v_{l}^{x}-v_{u}^{x} & \leq{} & u^{x},\\\nonumber{} &  &  & (w_{l}^{c})^{T}v_{l}^{c}+(w_{u}^{c})^{T}v_{u}^{c}+(w_{l}^{x})^{T}v_{l}^{x}+(w_{u}^{x})^{T}v_{u}^{x}-p & \leq{} & 0,\\\nonumber{} &  &  & p & = & p^{*},\\\nonumber{} &  &  & v_{l}^{c},v_{u}^{c},v_{l}^{x},v_{u}^{x}\geq{}0 &  &\end{array}\end{math} (11.1.6)

which minimizes the true objective while making sure that total weighted violations of the bounds is minimal, i.e. equals to [[MathCmd 512]].

11.2. Feasibility repair in MOSEK

MOSEK includes functionality that help you construct the problem (11.1.4) simply by passing a set of weights to MOSEK. This can be used for linear, quadratic, and conic optimization problems, possibly having integer constrained variables.

11.2.1. Usage of negative weights

As the problem (11.1.4) is presented it does not make sense to use negative weights since that makes the problem unbounded. Therefore, if the value of a weight is negative MOSEK fixes the associated elasticity variable to zero, e.g. if

\begin{displaymath}\nonumber{}(w_{l}^{c})_{i}<0\end{displaymath}

then MOSEK imposes the bound

\begin{displaymath}\nonumber{}(v_{l}^{c})_{i}\leq{}0.\end{displaymath}

This implies that the lower bound on the ith constraint will not be violated. (Clearly, this could also imply that the problem is infeasible so negative weight should be used with care). Associating a negative weights with a constraint tells MOSEK that the constraint should not be relaxed.

11.2.2. Automatical naming

MOSEK can automatically create a new problem of the form (11.1.4) starting from an existing problem by adding the elasticity variables and the extra constraints. Specificly, the variables [[MathCmd 517]], [[MathCmd 518]], [[MathCmd 519]], [[MathCmd 520]], and p are appended to existing variable vector x in their natural order. Moreover, the constraint (11.1.5) is appended to the constraints.

The new variables and constraints are automatically given names as follows:

  • The names of the variables [[MathCmd 497]] and [[MathCmd 498]] are constructed from the name of the ith constraint. For instance, if the 9th original constraint is named c9, then by default [[MathCmd 523]] and [[MathCmd 524]] are given the names LO*c9 and UP*c9 respectively. If necessary, the character “*” can be replaced by a different string by changing the
    mosek.sparam.feasrepair_name_separator
    parameter.
  • The additional constraints

    \begin{displaymath}\nonumber{}l^{x}\leq{}x+v_{l}^{x}-v_{u}^{x}\leq{}u^{x}\end{displaymath}

    are given names as follows. There is exactly one constraint per variable in the original problem, and thus the ith of these constraints is named after the ith variable in the original problem. For instance, if the first original variable is named “x0”, then the first of the above constraints is named “MSK-x1”. If necessary, the prefix “MSK-” can be replaced by a different string by changing the
    mosek.sparam.feasrepair_name_prefix
    parameter.

  • The variable p is by default given the name WSUMVIOLVAR, and the constraint (11.1.5) is given the name WSUMVIOLCON.

    The substring “WSUMVIOL” can be replaced by a different string by changing the
    mosek.sparam.feasrepair_name_wsumviol
    parameter.

11.2.3. Feasibility repair using the API

The Task.relaxprimal function takes an existing problem as input and creates a new task containing the problem (11.1.4). Moreover, if requested this function can solve the problems (11.1.4) and (11.1.6) automatically.

The parameter mosek.iparam.feasrepair_optimize controls which problem is solved. Its value is used as follows:

For further details, please see the description of the function Task.relaxprimal in the reference.

11.2.4. An example

Consider this example of linear optimization

\begin{math}\nonumber{}\begin{array}{lccccc}\nonumber{}\mbox{minimize} & -10x_{1} &  & -9x_{2}, &  & \\\nonumber{}\mbox{subject to} & 7/10x_{1} & + & 1x_{2} & \leq{} & 630,\\\nonumber{} & 1/2x_{1} & + & 5/6x_{2} & \leq{} & 600,\\\nonumber{} & 1x_{1} & + & 2/3x_{2} & \leq{} & 708,\\\nonumber{} & 1/10x_{1} & + & 1/4x_{2} & \leq{} & 135,\\\nonumber{} & x_{1}, &  & x_{2} & \geq{} & 0.\\\nonumber{} &  & x_{2}\geq{}650 &  &  &\end{array}\end{math} (11.2.1)

This is an infeasible problem. Suppose that we want MOSEK to suggest a modification to the bounds such that the problem becomes feasible. The following example performs this task:

# # Copyright: Copyright (c) 1998-2011 MOSEK ApS, Denmark. All rights reserved. # # File: feasrepairex1.py # # Purpose: To demonstrate how to use the MSK_relaxprimal function to # locate the cause of an infeasibility. # # Syntax: On command line # feasrepairex1 feasrepair.lp # feasrepair.lp is located in mosek\<version>\tools\examples. import sys import mosek # If numpy is installed, use that, otherwise use the # Mosek's array module. try: from numpy import array,zeros,ones except ImportError: from mosek.array import array, zeros, ones # Since the actual value of Infinity is ignores, we define it solely # for symbolic purposes: inf = 0.0 # Define a stream printer to grab output from MOSEK def streamprinter(text): sys.stdout.write(text) sys.stdout.flush() def formatdarray(a): r = [] for v in a: r.append(str(v)) return ','.join(r) # We might write everything directly as a script, but it looks nicer # to create a function. def main (inputfile): # Make a MOSEK environment env = mosek.Env () # Attach a printer to the environment env.set_Stream (mosek.streamtype.log, streamprinter) # Create a task task = env.Task(0,0) # Attach a printer to the task task.set_Stream (mosek.streamtype.log, streamprinter) # Read data task.readdata(inputfile) task.putintparam(mosek.iparam.feasrepair_optimize, mosek.feasrepairtype.optimize_penalty) # Relax wlc = array([ 1.0, 1.0, 1.0, 1.0 ]) wuc = array([ 1.0, 1.0, 1.0, 1.0 ]) wlx = array([ 1.0, 1.0 ]) wux = array([ 1.0, 1.0 ]) relaxed_task = task.relaxprimal(wlc, wuc, wlx, wux); sum_violation = relaxed_task.getprimalobj (mosek.soltype.bas) print 'lbc =', formatdarray(wlc) print 'ubc =', formatdarray(wuc) print 'lbx =', formatdarray(wlx) print 'ubx =', formatdarray(wux) # call the main function try: main (sys.argv[1]) except mosek.Exception, (code,msg): print "ERROR: %s" % str(code) if msg is not None: print "\t%s" % msg sys.exit(1) except: import traceback traceback.print_exc() sys.exit(1) sys.exit(0)

The output from the program above is:

lbc = -inf,-inf,-inf,-inf
ubc = 630.0,600.0,708.0,135.0
lbx = 0.0,-inf
ubx = inf,inf

To make the problem feasible it is suggested increasing the upper bound on the activity of the fourth constraint from 134 to 157.5 and decreasing the lower bound on the variable [[MathCmd 73]] to 630.

Wed Feb 29 16:13:02 2012