Keeping Optimization Tight to Parameters

I'm not sure what is the best route to take. I'm trying to keep my optimization solution close my inequality values but on a few of them it's off because inequalities are set to be greater then. When I change my inequalities to equalities (A and b to Aeq and beq) I'm getting an error:

Exiting: One or more of the residuals, duality gap, or total relative error has grown 100000 times greater than its minimum value so far: the primal appears to be infeasible (and the dual unbounded). (The dual residual < TolFun=1.00e-008.)

Is there a way to tell matlab to hold b's within tolerance. it doesn't seem like lb and ub will do the job. Should I subtract b's and equate it to zero and then ub and lb the subtracted value

Need a hint in the right direction. Thank You