Why one can get right result on A6000, but problem can't converge on H100 in FP64? #382

Franc-Z · 2024-12-05T05:16:29Z

As title, I just use MadNLPGPU to solve a NLP problem.
I found I can get the right result on A6000, but problem can't converge on H100 (which runs much faster than on A6000 in Float64).
Below is the solver configuration:

solver = MadNLPGPU.MadNLPSolver
(nlp;
tol= tol,
callback=MadNLP.DenseCallback,
kkt_system=MadNLP.DenseCondensedKKTSystem,
#blas_num_threads = 10000,
linear_solver=MadNLPGPU.LapackGPUSolver,
lapack_algorithm=MadNLP.CHOLESKY,
acceptable_tol = tol,
equality_treatment = MadNLP.EnforceEquality,
print_level = MadNLP.INFO,
max_iter = 500,
)
@time CUDA.@allowscalar results = MadNLPGPU.solve!(solver)

Franc-Z · 2024-12-05T05:19:31Z

Output on A6000:
This is MadNLP version v0.8.4, running with Lapack-GPU (CHOLESKY)

Number of nonzeros in constraint Jacobian............: 9118
Number of nonzeros in Lagrangian Hessian.............: 10394520

Total number of variables............................: 4559
variables with only lower bounds: 0
variables with lower and upper bounds: 4559
variables with only upper bounds: 0
Total number of equality constraints.................: 0
Total number of inequality constraints...............: 2
inequality constraints with only lower bounds: 0
inequality constraints with lower and upper bounds: 1
inequality constraints with only upper bounds: 1

iter objective inf_pr inf_du lg(mu) 0 1.3816189e+01 4.46e+01 2.06e+00 -1.0 0.00e+00 1 8.3623945e+00 3.02e+01 4.29e+00 -1.0 1.88e-01 2 8.2379484e+00 2.35e+01 1.06e+01 -1.0 1.33e+00 3 2.4690285e+00 7.18e+00 6.81e+00 -1.0 1.20e-01 4 1.6755572e+00 3.43e+00 2.79e+01 -1.0 3.75e-01 5 6.2126960e-01 5.66e-01 1.84e+01 -1.0 5.44e-02 6 5.9947989e-01 1.86e-01 3.77e+01 -1.0 4.13e-02 7 5.0819440e-01 1.62e-04 7.18e-04 -1.0 3.78e-03 8 3.8242275e-01 2.00e-06 5.36e+01 -2.5 1.27e-01 9 3.8395118e-01 3.00e-07 1.02e-04 -2.5 1.95e-03 iter objective inf_pr inf_du lg(mu) 10 3.7158660e-01 1.55e-06 1.61e+00 -5.7 3.55e-03 11 4.0813292e-02 4.33e-02 1.51e+00 -5.7 1.41e-01 12 -3.2275168e-01 3.53e-02 9.77e-01 -5.7 2.28e-01 13 -8.5762411e-01 9.61e-02 5.73e-01 -5.7 2.17e-01 14 -9.4477755e-01 5.31e-03 2.64e-01 -5.7 1.17e-01 15 -1.0120117e+00 1.32e-02 1.53e-01 -5.7 8.91e-02 16 -1.0119785e+00 2.14e-03 7.86e-02 -5.7 5.05e-02 17 -1.0115181e+00 2.04e-04 2.81e-02 -5.7 1.50e-02 18 -1.0115552e+00 1.44e-05 4.10e-03 -5.7 3.59e-03 19 -1.0115981e+00 2.02e-06 3.12e-06 -5.7 9.95e-04 iter objective inf_pr inf_du lg(mu) 20 -1.0194991e+00 1.25e-06 4.02e-06 -7.0 1.98e-03 21 -1.0195005e+00 3.07e-11 7.77e-11 -7.0 4.61e-06 ||d|| lg(rg) alpha_du alpha_pr ls
- 0.00e+00 0.00e+00 0
- 1.01e-01 3.23e-01h 1
- 1.00e+00 2.22e-01h 1
- 8.95e-01 6.94e-01h 1
- 1.00e+00 5.23e-01h 1
- 1.00e+00 8.35e-01h 1
- 1.00e+00 6.71e-01h 1
- 1.00e+00 1.00e+00h 1
- 8.61e-01 9.88e-01h 1
- 1.00e+00 1.00e+00h 1
||d|| lg(rg) alpha_du alpha_pr ls
- 8.62e-01 9.88e-01h 1
- 2.24e-03 1.00e+00h 1
- 1.28e-01 1.00e+00h 1
- 9.12e-02 1.00e+00h 1
- 3.78e-01 1.00e+00h 1
- 3.19e-01 1.00e+00h 1
- 4.20e-01 1.00e+00h 1
- 6.21e-01 1.00e+00h 1
- 8.54e-01 1.00e+00h 1
- 1.00e+00 1.00e+00h 1
||d|| lg(rg) alpha_du alpha_pr ls
- 1.00e+00 1.00e+00h 1
- 1.00e+00 1.00e+00h 1

Number of Iterations....: 21

                               (scaled)                 (unscaled)

Objective...............: -1.0195004737747260e+00 -1.0195004737747260e+00
Dual infeasibility......: 7.7675865739479377e-11 7.7675865739479377e-11
Constraint violation....: 3.0653383753908838e-11 3.0653383753908838e-11
Complementarity.........: 1.0909855582169436e-07 1.0909855582169436e-07
Overall NLP error.......: 1.0909855582169436e-07 1.0909855582169436e-07

Number of objective function evaluations = 22
Number of objective gradient evaluations = 22
Number of constraint evaluations = 22
Number of constraint Jacobian evaluations = 22
Number of Lagrangian Hessian evaluations = 21
Total wall-clock secs in solver (w/o fun. eval./lin. alg.) = 2.514
Total wall-clock secs in linear solver = 0.141
Total wall-clock secs in NLP function evaluations = 7.547
Total wall-clock secs = 10.202

EXIT: Optimal Solution Found (tol = 1.2e-06).

Franc-Z · 2024-12-05T05:21:06Z

with exactly same code, output on H100 in Float64:
This is MadNLP version v0.8.4, running with Lapack-GPU (CHOLESKY)

Number of nonzeros in constraint Jacobian............: 9118
Number of nonzeros in Lagrangian Hessian.............: 10394520

Total number of variables............................: 4559
variables with only lower bounds: 0
variables with lower and upper bounds: 4559
variables with only upper bounds: 0
Total number of equality constraints.................: 0
Total number of inequality constraints...............: 2
inequality constraints with only lower bounds: 0
inequality constraints with lower and upper bounds: 1
inequality constraints with only upper bounds: 1

iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
0 1.3817578e+01 4.46e+01 2.07e+00 -1.0 0.00e+00 - 0.00e+00 0.00e+00 0
1 8.4795274e+00 3.04e+01 4.29e+00 -1.0 1.92e-01 - 9.69e-02 3.19e-01h 1
2 8.2456710e+00 2.37e+01 1.06e+01 -1.0 1.35e+00 - 1.00e+00 2.20e-01h 1
3 2.5141870e+00 7.24e+00 7.00e+00 -1.0 1.15e-01 - 9.09e-01 6.94e-01h 1
4 1.6682559e+00 3.45e+00 2.78e+01 -1.0 3.86e-01 - 1.00e+00 5.24e-01h 1
5 6.3130994e-01 5.80e-01 1.88e+01 -1.0 5.05e-02 - 1.00e+00 8.32e-01h 1
6 5.9703178e-01 1.91e-01 3.79e+01 -1.0 4.16e-02 - 1.00e+00 6.71e-01h 1
7 5.0867892e-01 2.16e-04 2.38e-02 -1.0 3.95e-03 - 1.00e+00 1.00e+00h 1
8 3.8297603e-01 3.85e-06 5.37e+01 -2.5 1.27e-01 - 8.62e-01 9.88e-01h 1
9 3.8441422e-01 4.85e-06 5.93e-02 -2.5 1.95e-03 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
10 3.8181301e-01 2.35e-05 7.01e-02 -2.5 1.87e-03 - 1.00e+00 1.00e+00h 1
11 3.8182970e-01 1.23e-06 2.68e-02 -2.5 2.18e-05 - 1.00e+00 1.00e+00h 1
12 3.7046038e-01 1.32e-05 1.12e+00 -3.8 3.04e-03 - 9.08e-01 1.00e+00h 1
13 2.6951371e-01 7.52e-04 1.13e+00 -3.8 1.34e-02 - 3.29e-02 1.00e+00h 1
14 -2.5291761e-02 3.51e-02 6.43e-01 -3.8 1.29e-01 - 2.04e-01 1.00e+00h 1
15 -2.5368120e-01 2.11e-02 3.50e-01 -3.8 8.90e-02 - 1.57e-01 1.00e+00h 1
16 -3.1531739e-01 1.28e-03 1.59e-01 -3.8 2.79e-02 - 4.64e-01 1.00e+00h 1
17 -3.4805526e-01 2.75e-03 7.37e-02 -3.8 3.31e-02 - 6.72e-01 1.00e+00h 1
18 -3.5186175e-01 3.36e-04 3.03e-02 -3.8 1.63e-02 - 1.00e+00 1.00e+00h 1
19 -3.5165156e-01 1.06e-05 9.60e-02 -3.8 2.50e-03 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
20 -3.5139008e-01 4.97e-07 3.32e-02 -3.8 2.11e-04 - 1.00e+00 1.00e+00h 1
21 -3.5145282e-01 1.16e-06 3.71e-02 -3.8 1.90e-05 - 1.00e+00 1.00e+00h 1
22 -3.5150952e-01 9.87e-07 5.46e-02 -3.8 1.03e-05 - 1.00e+00 1.00e+00h 1
23 -3.5145605e-01 1.02e-06 5.46e-02 -3.8 1.60e-05 - 1.00e+00 1.00e+00h 1
24 -3.5153863e-01 3.04e-06 2.33e-02 -3.8 2.41e-05 - 1.00e+00 1.00e+00h 1
25 -3.5150957e-01 2.44e-07 3.69e-02 -3.8 2.10e-05 - 1.00e+00 1.00e+00h 1
26 -3.5164888e-01 7.20e-13 2.08e-02 -3.8 2.88e-05 - 1.00e+00 1.00e+00H 1
27 -3.5160697e-01 8.53e-14 2.71e-02 -3.8 7.25e-06 - 1.00e+00 1.00e+00H 1
28 -3.5171046e-01 1.12e-05 3.78e-02 -3.8 1.21e-05 - 1.00e+00 1.00e+00H 1
29 -3.5168090e-01 5.58e-06 6.47e-02 -3.8 7.99e-06 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
30 -3.5163738e-01 4.19e-06 4.30e-02 -3.8 3.08e-05 - 1.00e+00 2.50e-01h 3
31 -3.5163893e-01 4.05e-06 7.37e-02 -3.8 7.23e-06 - 1.00e+00 3.12e-02h 6
32 -3.5146510e-01 7.73e-08 3.75e-02 -3.8 2.92e-05 - 1.00e+00 1.00e+00h 1
33 -3.5137768e-01 1.16e-07 1.18e-02 -3.8 2.60e-05 - 1.00e+00 1.00e+00h 1
34 -3.5138982e-01 1.01e-07 2.82e-02 -3.8 4.43e-06 - 1.00e+00 1.00e+00h 1
35 -3.5146562e-01 9.51e-07 2.17e-02 -3.8 1.34e-05 - 1.00e+00 1.00e+00h 1
36 -3.5140447e-01 8.57e-09 2.97e-02 -3.8 1.12e-05 - 1.00e+00 1.00e+00h 1
37 -3.5138981e-01 7.36e-08 9.80e-02 -3.8 2.50e-06 - 1.00e+00 1.00e+00h 1
38 -3.5166212e-01 9.49e-06 1.06e-01 -3.8 4.58e-05 - 1.00e+00 1.00e+00h 1
39 -3.5155338e-01 4.13e-06 2.93e-02 -3.8 3.21e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
40 -3.5147749e-01 2.12e-06 3.33e-02 -3.8 2.64e-05 - 1.00e+00 5.00e-01h 2
41 -3.5147233e-01 1.50e-06 1.00e-01 -3.8 6.49e-06 - 1.00e+00 5.00e-01h 2
42 -3.5162413e-01 8.41e-13 2.37e-02 -3.8 2.44e-05 - 1.00e+00 1.00e+00H 1
43 -3.5168281e-01 2.78e-13 7.96e-02 -3.8 1.06e-05 - 1.00e+00 1.00e+00H 1
44 -3.5152164e-01 1.33e-13 4.00e-02 -3.8 2.44e-05 - 1.00e+00 1.00e+00H 1
45 -3.5147518e-01 8.52e-15 4.13e-02 -3.8 2.80e-05 - 1.00e+00 1.00e+00H 1
46 -3.5161572e-01 1.95e-05 4.64e-02 -3.8 1.95e-05 - 1.00e+00 1.00e+00H 1
47 -3.5153407e-01 9.73e-06 4.90e-02 -3.8 2.67e-05 - 1.00e+00 5.00e-01h 2
48 -3.5154764e-01 4.86e-06 5.52e-02 -3.8 1.09e-05 - 1.00e+00 5.00e-01h 2
49 -3.5151538e-01 2.43e-06 4.57e-02 -3.8 1.24e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
50 -3.5151539e-01 2.39e-06 7.83e-02 -3.8 1.04e-05 - 1.00e+00 1.56e-02h 7
51 -3.5139146e-01 3.10e-07 6.40e-02 -3.8 2.67e-05 - 1.00e+00 1.00e+00h 1
52 -3.5159519e-01 5.13e-06 6.46e-02 -3.8 3.59e-05 - 1.00e+00 1.00e+00h 1
53 -3.5151973e-01 2.37e-06 3.92e-02 -3.8 3.17e-05 - 1.00e+00 5.00e-01h 2
54 -3.5137672e-01 1.69e-07 1.09e-01 -3.8 2.35e-05 - 1.00e+00 1.00e+00h 1
55 -3.5180007e-01 1.54e-05 4.27e-02 -3.8 6.79e-05 - 1.00e+00 1.00e+00h 1
56 -3.5175786e-01 1.09e-05 4.12e-02 -3.8 2.39e-05 - 1.00e+00 2.50e-01h 3
57 -3.5175530e-01 9.45e-06 1.07e-01 -3.8 1.06e-05 - 1.00e+00 1.25e-01h 4
58 -3.5162493e-01 4.57e-06 5.33e-02 -3.8 4.25e-05 - 1.00e+00 5.00e-01h 2
59 -3.5163029e-01 4.31e-06 7.97e-02 -3.8 1.28e-05 - 1.00e+00 2.50e-01h 3
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
60 -3.5147365e-01 3.61e-07 8.24e-02 -3.8 2.22e-05 - 1.00e+00 1.00e+00h 1
61 -3.5162462e-01 4.10e-06 4.97e-02 -3.8 2.18e-05 - 1.00e+00 1.00e+00h 1
62 -3.5153360e-01 1.49e-06 6.46e-02 -3.8 3.01e-05 - 1.00e+00 5.00e-01h 2
63 -3.5178390e-01 1.71e-12 4.45e-02 -3.8 3.99e-05 - 1.00e+00 1.00e+00H 1
64 -3.5162966e-01 1.35e-13 1.05e-01 -3.8 2.20e-05 - 1.00e+00 1.00e+00H 1
65 -3.5153764e-01 5.96e-07 4.19e-02 -3.8 2.14e-05 - 1.00e+00 1.00e+00h 1
66 -3.5143058e-01 3.92e-07 9.35e-02 -3.8 1.65e-05 - 1.00e+00 1.00e+00h 1
67 -3.5181890e-01 1.33e-05 3.95e-02 -3.8 5.68e-05 - 1.00e+00 1.00e+00h 1
68 -3.5176568e-01 9.17e-06 1.91e-02 -3.8 2.69e-05 - 1.00e+00 2.50e-01h 3
69 -3.5175603e-01 8.44e-06 5.88e-02 -3.8 1.84e-05 - 1.00e+00 6.25e-02h 5
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
70 -3.5139750e-01 6.57e-07 1.59e-02 -3.8 5.47e-05 - 1.00e+00 1.00e+00h 1
71 -3.5139137e-01 2.39e-07 3.16e-02 -3.8 1.55e-05 - 1.00e+00 1.00e+00h 1
72 -3.5147503e-01 1.17e-06 2.77e-02 -3.8 1.43e-05 - 1.00e+00 1.00e+00h 1
73 -3.5151261e-01 1.20e-13 2.07e-02 -3.8 1.89e-05 - 1.00e+00 1.00e+00H 1
74 -3.5147778e-01 3.65e-14 5.87e-02 -3.8 2.24e-05 - 1.00e+00 1.00e+00H 1
75 -3.5161643e-01 4.21e-06 2.88e-02 -3.8 2.15e-05 - 1.00e+00 1.00e+00h 1
76 -3.5161073e-01 3.87e-06 2.76e-02 -3.8 1.32e-05 - 1.00e+00 6.25e-02h 5
77 -3.5161038e-01 3.84e-06 2.00e-02 -3.8 6.48e-06 - 1.00e+00 7.81e-03h 8
78 -3.5160277e-01 1.01e-07 1.41e-02 -3.8 1.50e-05 - 1.00e+00 1.00e+00h 1
79 -3.5159891e-01 7.54e-14 3.01e-02 -3.8 1.45e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
80 -3.5156146e-01 7.36e-14 2.36e-02 -3.8 2.31e-05 - 1.00e+00 1.00e+00H 1
81 -3.5164333e-01 1.30e-05 8.09e-02 -3.8 3.41e-05 - 1.00e+00 1.00e+00H 1
82 -3.5137090e-01 5.05e-08 8.73e-02 -3.8 4.85e-05 - 1.00e+00 1.00e+00h 1
83 -3.5157320e-01 5.70e-06 2.93e-02 -3.8 3.21e-05 - 1.00e+00 1.00e+00h 1
84 -3.5157895e-01 5.19e-06 4.22e-02 -3.8 1.74e-05 - 1.00e+00 1.25e-01h 4
85 -3.5155544e-01 3.54e-06 2.91e-02 -3.8 1.47e-05 - 1.00e+00 2.50e-01h 3
86 -3.5153085e-01 2.49e-06 2.92e-02 -3.8 1.58e-05 - 1.00e+00 2.50e-01h 3
87 -3.5145440e-01 1.08e-06 2.65e-02 -3.8 2.60e-05 - 1.00e+00 5.00e-01h 2
88 -3.5146433e-01 2.59e-07 3.20e-02 -3.8 4.54e-06 - 1.00e+00 1.00e+00h 1
89 -3.5149208e-01 1.01e-06 5.06e-02 -3.8 5.91e-06 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
90 -3.5142784e-01 7.16e-08 7.19e-02 -3.8 1.49e-05 - 1.00e+00 1.00e+00h 1
91 -3.5162917e-01 5.11e-06 2.56e-02 -3.8 2.95e-05 - 1.00e+00 1.00e+00h 1
92 -3.5161294e-01 3.65e-06 2.17e-02 -3.8 8.19e-06 - 1.00e+00 2.50e-01h 3
93 -3.5161282e-01 3.55e-06 5.29e-02 -3.8 6.50e-06 - 1.00e+00 3.12e-02h 6
94 -3.5158757e-01 3.01e-06 3.53e-02 -3.8 3.07e-05 - 1.00e+00 1.25e-01h 4
95 -3.5154260e-01 2.15e-06 6.64e-02 -3.8 2.85e-05 - 1.00e+00 2.50e-01h 3
96 -3.5147058e-01 8.82e-08 5.36e-02 -3.8 9.96e-06 - 1.00e+00 1.00e+00h 1
97 -3.5144714e-01 3.12e-08 2.96e-02 -3.8 1.45e-05 - 1.00e+00 1.00e+00h 1
98 -3.5136700e-01 1.29e-08 3.77e-02 -3.8 1.40e-05 - 1.00e+00 1.00e+00h 1
99 -3.5148563e-01 2.09e-06 4.04e-02 -3.8 1.94e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
100 -3.5160453e-01 3.93e-13 3.56e-02 -3.8 2.01e-05 - 1.00e+00 1.00e+00H 1
101 -3.5148613e-01 6.69e-14 5.40e-02 -3.8 2.15e-05 - 1.00e+00 1.00e+00H 1
102 -3.5149282e-01 2.82e-06 8.20e-02 -3.8 1.24e-05 - 1.00e+00 1.00e+00H 1
103 -3.5152225e-01 1.70e-06 5.64e-02 -3.8 1.33e-05 - 1.00e+00 5.00e-01h 2
104 -3.5153405e-01 1.55e-06 3.75e-02 -3.8 7.34e-06 - 1.00e+00 2.50e-01h 3
105 -3.5149039e-01 8.34e-07 4.35e-02 -3.8 2.13e-05 - 1.00e+00 5.00e-01h 2
106 -3.5160329e-01 5.14e-13 7.25e-02 -3.8 2.10e-05 - 1.00e+00 1.00e+00H 1
107 -3.5146141e-01 1.53e-14 1.67e-02 -3.8 2.71e-05 - 1.00e+00 1.00e+00H 1
108 -3.5144939e-01 7.41e-15 3.45e-02 -3.8 3.48e-06 - 1.00e+00 1.00e+00H 1
109 -3.5139166e-01 1.79e-15 5.79e-02 -3.8 9.44e-06 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
110 -3.5154941e-01 1.91e-05 4.28e-02 -3.8 2.20e-05 - 1.00e+00 1.00e+00H 1
111 -3.5148966e-01 9.55e-06 3.47e-02 -3.8 1.94e-05 - 1.00e+00 5.00e-01h 2
112 -3.5145792e-01 4.78e-06 1.01e-01 -3.8 1.77e-05 - 1.00e+00 5.00e-01h 2
113 -3.5164551e-01 1.14e-12 8.55e-02 -3.8 2.99e-05 - 1.00e+00 1.00e+00H 1
114 -3.5139756e-01 3.58e-15 1.76e-02 -3.8 4.30e-05 - 1.00e+00 1.00e+00H 1
115 -3.5142409e-01 3.32e-07 3.67e-02 -3.8 5.64e-06 - 1.00e+00 1.00e+00h 1
116 -3.5146231e-01 1.02e-06 3.00e-02 -3.8 7.81e-06 - 1.00e+00 1.00e+00h 1
117 -3.5143473e-01 5.57e-07 1.49e-02 -3.8 8.75e-06 - 1.00e+00 5.00e-01h 2
118 -3.5143298e-01 4.81e-07 1.44e-02 -3.8 7.12e-06 - 1.00e+00 1.25e-01h 4
119 -3.5143089e-01 4.45e-07 4.90e-02 -3.8 6.08e-06 - 1.00e+00 6.25e-02h 5
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
120 -3.5152495e-01 1.93e-13 4.44e-02 -3.8 1.46e-05 - 1.00e+00 1.00e+00H 1
121 -3.5159524e-01 3.48e-06 2.32e-02 -3.8 1.17e-05 - 1.00e+00 1.00e+00H 1
122 -3.5159530e-01 3.37e-06 4.79e-02 -3.8 9.23e-06 - 1.00e+00 3.12e-02h 6
123 -3.5159036e-01 3.27e-06 2.20e-02 -3.8 2.52e-05 - 1.00e+00 3.12e-02h 6
124 -3.5151139e-01 1.63e-06 2.30e-02 -3.8 2.63e-05 - 1.00e+00 5.00e-01h 2
125 -3.5145673e-01 8.17e-07 4.67e-02 -3.8 1.95e-05 - 1.00e+00 5.00e-01h 2
126 -3.5157251e-01 3.03e-06 4.35e-02 -3.8 2.61e-05 - 1.00e+00 1.00e+00h 1
127 -3.5144182e-01 4.71e-07 4.05e-02 -3.8 2.06e-05 - 1.00e+00 1.00e+00h 1
128 -3.5136167e-01 1.44e-09 3.08e-02 -3.8 1.74e-05 - 1.00e+00 1.00e+00h 1
129 -3.5141289e-01 6.55e-07 7.38e-02 -3.8 8.28e-06 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
130 -3.5158432e-01 4.48e-06 6.02e-02 -3.8 2.84e-05 - 1.00e+00 1.00e+00h 1
131 -3.5150031e-01 2.16e-06 4.27e-02 -3.8 3.10e-05 - 1.00e+00 5.00e-01h 2
132 -3.5153375e-01 1.82e-06 3.93e-02 -3.8 1.33e-05 - 1.00e+00 5.00e-01h 2
133 -3.5149819e-01 1.30e-06 9.05e-02 -3.8 2.30e-05 - 1.00e+00 2.50e-01h 3
134 -3.5160841e-01 4.32e-13 6.17e-02 -3.8 1.82e-05 - 1.00e+00 1.00e+00H 1
135 -3.5141685e-01 1.50e-14 2.85e-02 -3.8 3.30e-05 - 1.00e+00 1.00e+00H 1
136 -3.5136449e-01 8.82e-11 5.90e-02 -3.8 1.08e-05 - 1.00e+00 1.00e+00h 1
137 -3.5154482e-01 3.89e-06 4.35e-02 -3.8 2.84e-05 - 1.00e+00 1.00e+00h 1
138 -3.5177524e-01 1.41e-12 9.95e-02 -3.8 3.87e-05 - 1.00e+00 1.00e+00H 1
139 -3.5152116e-01 3.14e-14 4.72e-02 -3.8 4.21e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
140 -3.5142463e-01 7.93e-15 2.14e-02 -3.8 1.67e-05 - 1.00e+00 1.00e+00H 1
141 -3.5138396e-01 9.94e-08 7.81e-02 -3.8 1.72e-05 - 1.00e+00 1.00e+00h 1
142 -3.5156593e-01 4.80e-06 4.88e-02 -3.8 3.74e-05 - 1.00e+00 1.00e+00h 1
143 -3.5183688e-01 2.19e-12 7.17e-02 -3.8 4.50e-05 - 1.00e+00 1.00e+00H 1
144 -3.5146057e-01 4.35e-14 3.51e-02 -3.8 6.38e-05 - 1.00e+00 1.00e+00H 1
145 -3.5145600e-01 4.04e-14 7.03e-02 -3.8 7.51e-06 - 1.00e+00 1.00e+00H 1
146 -3.5156156e-01 1.14e-05 4.64e-02 -3.8 1.83e-05 - 1.00e+00 1.00e+00H 1
147 -3.5149368e-01 5.72e-06 4.38e-02 -3.8 2.32e-05 - 1.00e+00 5.00e-01h 2
148 -3.5151193e-01 2.86e-06 7.00e-02 -3.8 6.71e-06 - 1.00e+00 5.00e-01h 2
149 -3.5174247e-01 1.61e-12 7.83e-02 -3.8 3.78e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
150 -3.5143557e-01 3.64e-14 3.26e-02 -3.8 5.05e-05 - 1.00e+00 1.00e+00H 1
151 -3.5141971e-01 1.04e-14 3.82e-02 -3.8 1.16e-05 - 1.00e+00 1.00e+00H 1
152 -3.5168107e-01 3.21e-05 2.73e-02 -3.8 3.58e-05 - 1.00e+00 1.00e+00H 1
153 -3.5165736e-01 1.60e-05 5.25e-02 -3.8 6.34e-06 - 1.00e+00 5.00e-01h 2
154 -3.5157387e-01 8.02e-06 7.99e-02 -3.8 2.66e-05 - 1.00e+00 5.00e-01h 2
155 -3.5157643e-01 4.01e-06 3.93e-02 -3.8 1.28e-05 - 1.00e+00 5.00e-01h 2
156 -3.5152002e-01 2.00e-06 6.66e-02 -3.8 1.77e-05 - 1.00e+00 5.00e-01h 2
157 -3.5146146e-01 1.07e-06 4.79e-02 -3.8 2.51e-05 - 1.00e+00 1.00e+00h 1
158 -3.5147336e-01 1.19e-06 2.81e-02 -3.8 3.73e-05 - 1.00e+00 1.00e+00h 1
159 -3.5140012e-01 2.90e-07 3.03e-02 -3.8 2.46e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
160 -3.5147335e-01 1.12e-06 4.86e-02 -3.8 1.05e-05 - 1.00e+00 1.00e+00h 1
161 -3.5159909e-01 5.15e-13 5.19e-02 -3.8 4.19e-05 - 1.00e+00 1.00e+00H 1
162 -3.5147515e-01 4.13e-08 8.52e-02 -3.8 2.85e-05 - 1.00e+00 1.00e+00h 1
163 -3.5162982e-01 6.40e-06 3.25e-02 -3.8 2.64e-05 - 1.00e+00 1.00e+00h 1
164 -3.5163516e-01 6.15e-06 1.06e-01 -3.8 1.67e-05 - 1.00e+00 6.25e-02h 5
165 -3.5154325e-01 2.51e-06 7.09e-02 -3.8 3.24e-05 - 1.00e+00 5.00e-01h 2
166 -3.5159623e-01 4.01e-13 5.54e-02 -3.8 1.53e-05 - 1.00e+00 1.00e+00H 1
167 -3.5139001e-01 8.72e-16 6.34e-02 -3.8 3.38e-05 - 1.00e+00 1.00e+00H 1
168 -3.5148620e-01 2.05e-06 2.04e-02 -3.8 1.69e-05 - 1.00e+00 1.00e+00h 1
169 -3.5148475e-01 1.59e-06 4.12e-02 -3.8 1.06e-05 - 1.00e+00 2.50e-01h 3
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
170 -3.5158946e-01 4.54e-13 8.54e-02 -3.8 1.85e-05 - 1.00e+00 1.00e+00H 1
171 -3.5159451e-01 1.76e-13 6.87e-02 -3.8 1.71e-05 - 1.00e+00 1.00e+00H 1
172 -3.5163856e-01 5.41e-06 3.03e-02 -3.8 1.17e-05 - 1.00e+00 1.00e+00H 1
173 -3.5161536e-01 4.06e-06 5.50e-02 -3.8 1.41e-05 - 1.00e+00 2.50e-01h 3
174 -3.5150162e-01 2.03e-06 5.50e-02 -3.8 3.82e-05 - 1.00e+00 5.00e-01h 2
175 -3.5152128e-01 1.52e-06 4.11e-02 -3.8 1.33e-05 - 1.00e+00 2.50e-01h 3
176 -3.5147162e-01 7.61e-07 3.66e-02 -3.8 1.64e-05 - 1.00e+00 5.00e-01h 2
177 -3.5157249e-01 1.90e-13 3.30e-02 -3.8 1.26e-05 - 1.00e+00 1.00e+00H 1
178 -3.5164870e-01 6.78e-06 6.15e-02 -3.8 1.44e-05 - 1.00e+00 1.00e+00H 1
179 -3.5139081e-01 6.10e-07 3.82e-02 -3.8 4.38e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
180 -3.5156121e-01 2.82e-06 2.15e-02 -3.8 2.37e-05 - 1.00e+00 1.00e+00h 1
181 -3.5156718e-01 2.44e-06 1.87e-02 -3.8 1.20e-05 - 1.00e+00 2.50e-01h 3
182 -3.5156957e-01 2.42e-06 4.79e-02 -3.8 1.95e-05 - 1.00e+00 6.25e-02h 5
183 -3.5149187e-01 5.40e-07 1.47e-02 -3.8 1.33e-05 - 1.00e+00 1.00e+00h 1
184 -3.5149233e-01 6.59e-07 2.34e-02 -3.8 2.02e-05 - 1.00e+00 1.00e+00h 1
185 -3.5148011e-01 1.13e-07 2.42e-02 -3.8 1.88e-05 - 1.00e+00 1.00e+00h 1
186 -3.5147833e-01 1.87e-07 4.81e-02 -3.8 1.58e-05 - 1.00e+00 1.00e+00h 1
187 -3.5155447e-01 3.49e-13 4.62e-02 -3.8 1.51e-05 - 1.00e+00 1.00e+00H 1
188 -3.5181024e-01 2.23e-05 4.83e-02 -3.8 3.15e-05 - 1.00e+00 1.00e+00H 1
189 -3.5169644e-01 1.12e-05 3.81e-02 -3.8 3.11e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
190 -3.5162945e-01 5.58e-06 6.27e-02 -3.8 2.12e-05 - 1.00e+00 5.00e-01h 2
191 -3.5138824e-01 2.83e-07 4.56e-02 -3.8 4.41e-05 - 1.00e+00 1.00e+00h 1
192 -3.5145644e-01 1.55e-06 3.60e-02 -3.8 1.10e-05 - 1.00e+00 1.00e+00h 1
193 -3.5146033e-01 1.11e-06 3.28e-02 -3.8 1.90e-05 - 1.00e+00 5.00e-01h 2
194 -3.5147636e-01 9.11e-07 6.54e-02 -3.8 1.04e-05 - 1.00e+00 5.00e-01h 2
195 -3.5162658e-01 5.98e-13 5.96e-02 -3.8 2.45e-05 - 1.00e+00 1.00e+00H 1
196 -3.5188719e-01 2.04e-05 6.25e-02 -3.8 3.48e-05 - 1.00e+00 1.00e+00H 1
197 -3.5170743e-01 1.02e-05 3.52e-02 -3.8 5.40e-05 - 1.00e+00 5.00e-01h 2
198 -3.5166589e-01 5.09e-06 7.18e-02 -3.8 1.36e-05 - 1.00e+00 5.00e-01h 2
199 -3.5136848e-01 1.91e-08 9.01e-02 -3.8 5.28e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
200 -3.5162472e-01 7.95e-06 2.06e-02 -3.8 4.49e-05 - 1.00e+00 1.00e+00h 1
201 -3.5162218e-01 6.88e-06 3.97e-02 -3.8 7.19e-06 - 1.00e+00 1.25e-01h 4
202 -3.5159177e-01 4.73e-06 2.70e-02 -3.8 1.74e-05 - 1.00e+00 2.50e-01h 3
203 -3.5157602e-01 4.01e-06 5.98e-02 -3.8 2.25e-05 - 1.00e+00 1.25e-01h 4
204 -3.5158132e-01 3.90e-06 6.73e-02 -3.8 1.52e-05 - 1.00e+00 6.25e-02h 5
205 -3.5142811e-01 8.64e-07 1.59e-02 -3.8 2.50e-05 - 1.00e+00 1.00e+00h 1
206 -3.5141178e-01 4.26e-08 7.05e-02 -3.8 1.01e-05 - 1.00e+00 1.00e+00h 1
207 -3.5164246e-01 7.02e-06 2.10e-02 -3.8 3.94e-05 - 1.00e+00 1.00e+00h 1
208 -3.5164254e-01 5.44e-06 5.49e-02 -3.8 7.71e-06 - 1.00e+00 2.50e-01h 3
209 -3.5159428e-01 3.67e-06 3.10e-02 -3.8 2.87e-05 - 1.00e+00 2.50e-01h 3
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
210 -3.5158716e-01 3.15e-06 5.38e-02 -3.8 7.48e-06 - 1.00e+00 1.25e-01h 4
211 -3.5154736e-01 2.08e-06 5.67e-02 -3.8 2.52e-05 - 1.00e+00 2.50e-01h 3
212 -3.5157457e-01 1.09e-06 2.90e-02 -3.8 9.15e-06 - 1.00e+00 1.00e+00h 1
213 -3.5148729e-01 6.97e-14 4.53e-02 -3.8 1.80e-05 - 1.00e+00 1.00e+00H 1
214 -3.5138936e-01 1.88e-07 1.98e-02 -3.8 2.03e-05 - 1.00e+00 1.00e+00h 1
215 -3.5143253e-01 5.49e-07 3.82e-02 -3.8 1.20e-05 - 1.00e+00 1.00e+00h 1
216 -3.5142583e-01 3.39e-07 5.32e-02 -3.8 8.79e-06 - 1.00e+00 1.00e+00h 1
217 -3.5142685e-01 4.80e-07 1.07e-01 -3.8 8.53e-06 - 1.00e+00 1.00e+00h 1
218 -3.5186206e-01 1.72e-05 5.90e-02 -3.8 6.82e-05 - 1.00e+00 1.00e+00h 1
219 -3.5169297e-01 6.74e-06 3.58e-02 -3.8 4.76e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
220 -3.5167217e-01 4.89e-06 5.97e-02 -3.8 1.24e-05 - 1.00e+00 2.50e-01h 3
221 -3.5161456e-01 3.33e-06 3.27e-02 -3.8 3.58e-05 - 1.00e+00 2.50e-01h 3
222 -3.5137690e-01 1.23e-07 4.18e-02 -3.8 4.02e-05 - 1.00e+00 1.00e+00h 1
223 -3.5144986e-01 1.19e-06 6.07e-02 -3.8 1.20e-05 - 1.00e+00 1.00e+00h 1
224 -3.5172419e-01 8.56e-06 6.24e-02 -3.8 4.34e-05 - 1.00e+00 1.00e+00h 1
225 -3.5158365e-01 3.36e-06 3.84e-02 -3.8 4.26e-05 - 1.00e+00 5.00e-01h 2
226 -3.5148041e-01 1.59e-06 7.34e-02 -3.8 3.42e-05 - 1.00e+00 5.00e-01h 2
227 -3.5158766e-01 4.98e-13 3.14e-02 -3.8 2.82e-05 - 1.00e+00 1.00e+00H 1
228 -3.5150752e-01 8.91e-14 4.32e-02 -3.8 1.70e-05 - 1.00e+00 1.00e+00H 1
229 -3.5140516e-01 6.48e-15 2.32e-02 -3.8 1.73e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
230 -3.5138016e-01 1.65e-07 6.75e-02 -3.8 2.30e-05 - 1.00e+00 1.00e+00h 1
231 -3.5160268e-01 6.13e-06 8.48e-02 -3.8 3.56e-05 - 1.00e+00 1.00e+00h 1
232 -3.5149079e-01 5.13e-08 5.62e-02 -3.8 1.59e-05 - 1.00e+00 1.00e+00h 1
233 -3.5166289e-01 6.61e-13 7.67e-02 -3.8 2.33e-05 - 1.00e+00 1.00e+00H 1
234 -3.5152942e-01 6.88e-14 5.64e-02 -3.8 1.75e-05 - 1.00e+00 1.00e+00H 1
235 -3.5140997e-01 1.12e-07 6.77e-02 -3.8 2.41e-05 - 1.00e+00 1.00e+00h 1
236 -3.5156586e-01 4.47e-06 7.11e-02 -3.8 2.36e-05 - 1.00e+00 1.00e+00h 1
237 -3.5154403e-01 2.95e-06 6.64e-02 -3.8 1.37e-05 - 1.00e+00 5.00e-01h 2
238 -3.5155493e-01 2.84e-06 7.05e-02 -3.8 1.39e-05 - 1.00e+00 1.25e-01h 4
239 -3.5156054e-01 2.81e-06 7.52e-02 -3.8 1.08e-05 - 1.00e+00 1.25e-01h 4
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
240 -3.5147238e-01 1.31e-06 7.60e-02 -3.8 2.92e-05 - 1.00e+00 5.00e-01h 2
241 -3.5164076e-01 5.30e-06 4.87e-02 -3.8 2.69e-05 - 1.00e+00 1.00e+00h 1
242 -3.5143421e-01 1.21e-06 4.65e-02 -3.8 3.12e-05 - 1.00e+00 1.00e+00h 1
243 -3.5140100e-01 9.15e-08 7.07e-02 -3.8 1.25e-05 - 1.00e+00 1.00e+00h 1
244 -3.5161470e-01 5.90e-06 4.26e-02 -3.8 3.48e-05 - 1.00e+00 1.00e+00h 1
245 -3.5158410e-01 4.06e-06 3.40e-02 -3.8 2.08e-05 - 1.00e+00 2.50e-01h 3
246 -3.5157952e-01 3.50e-06 4.41e-02 -3.8 1.93e-05 - 1.00e+00 1.25e-01h 4
247 -3.5150254e-01 1.30e-06 1.92e-02 -3.8 2.58e-05 - 1.00e+00 5.00e-01h 2
248 -3.5144755e-01 5.18e-07 5.76e-02 -3.8 1.71e-05 - 1.00e+00 5.00e-01h 2
249 -3.5167215e-01 1.03e-12 5.45e-02 -3.8 3.39e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
250 -3.5140993e-01 1.25e-14 2.58e-02 -3.8 4.23e-05 - 1.00e+00 1.00e+00H 1
251 -3.5142430e-01 2.48e-07 6.07e-02 -3.8 7.30e-06 - 1.00e+00 1.00e+00h 1
252 -3.5156481e-01 3.20e-06 3.28e-02 -3.8 2.32e-05 - 1.00e+00 1.00e+00h 1
253 -3.5154436e-01 2.30e-06 3.91e-02 -3.8 1.43e-05 - 1.00e+00 2.50e-01h 3
254 -3.5149026e-01 7.28e-08 4.19e-02 -3.8 6.03e-06 - 1.00e+00 1.00e+00h 1
255 -3.5160021e-01 3.20e-13 4.96e-02 -3.8 1.61e-05 - 1.00e+00 1.00e+00H 1
256 -3.5157783e-01 1.50e-13 9.73e-02 -3.8 7.02e-06 - 1.00e+00 1.00e+00H 1
257 -3.5141393e-01 1.48e-14 6.55e-02 -3.8 3.06e-05 - 1.00e+00 1.00e+00H 1
258 -3.5161952e-01 4.42e-06 5.29e-02 -3.8 3.07e-05 - 1.00e+00 1.00e+00h 1
259 -3.5151002e-01 1.98e-06 8.03e-02 -3.8 3.54e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
260 -3.5168053e-01 1.04e-12 5.94e-02 -3.8 2.84e-05 - 1.00e+00 1.00e+00H 1
261 -3.5146382e-01 4.69e-14 4.21e-02 -3.8 3.82e-05 - 1.00e+00 1.00e+00H 1
262 -3.5146257e-01 3.09e-14 8.25e-02 -3.8 1.18e-05 - 1.00e+00 1.00e+00H 1
263 -3.5157815e-01 3.52e-06 8.24e-02 -3.8 2.99e-05 - 1.00e+00 5.00e-01h 2
264 -3.5166900e-01 7.83e-13 6.06e-02 -3.8 2.05e-05 - 1.00e+00 1.00e+00H 1
265 -3.5152308e-01 1.21e-13 7.36e-02 -3.8 2.48e-05 - 1.00e+00 1.00e+00H 1
266 -3.5152523e-01 6.96e-08 2.94e-02 -3.8 2.09e-05 - 1.00e+00 1.56e-02h 7
267 -3.5171310e-01 1.17e-12 6.60e-02 -3.8 2.84e-05 - 1.00e+00 1.00e+00H 1
268 -3.5148449e-01 1.22e-13 3.34e-02 -3.8 3.51e-05 - 1.00e+00 1.00e+00H 1
269 -3.5140305e-01 2.26e-07 8.47e-02 -3.8 1.75e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
270 -3.5164489e-01 1.33e-12 7.62e-02 -3.8 4.06e-05 - 1.00e+00 1.00e+00H 1
271 -3.5140833e-01 6.00e-15 8.34e-02 -3.8 4.13e-05 - 1.00e+00 1.00e+00H 1
272 -3.5155147e-01 4.35e-06 8.85e-02 -3.8 4.36e-05 - 1.00e+00 5.00e-01h 2
273 -3.5149791e-01 1.91e-06 2.14e-02 -3.8 1.57e-05 - 1.00e+00 5.00e-01h 2
274 -3.5146350e-01 7.94e-07 5.69e-02 -3.8 1.16e-05 - 1.00e+00 5.00e-01h 2
275 -3.5167596e-01 1.01e-12 3.11e-02 -3.8 3.27e-05 - 1.00e+00 1.00e+00H 1
276 -3.5153016e-01 1.38e-13 6.49e-02 -3.8 2.05e-05 - 1.00e+00 1.00e+00H 1
277 -3.5140141e-01 5.29e-15 1.51e-02 -3.8 2.30e-05 - 1.00e+00 1.00e+00H 1
278 -3.5136711e-01 2.04e-08 1.93e-02 -3.8 1.27e-05 - 1.00e+00 1.00e+00h 1
279 -3.5143897e-01 6.74e-07 5.22e-02 -3.8 1.26e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
280 -3.5155666e-01 3.51e-06 1.96e-02 -3.8 2.76e-05 - 1.00e+00 1.00e+00h 1
281 -3.5155669e-01 3.45e-06 3.43e-02 -3.8 5.06e-06 - 1.00e+00 1.56e-02h 7
282 -3.5155751e-01 3.45e-06 7.44e-02 -3.8 1.83e-05 - 1.00e+00 7.81e-03h 8
283 -3.5155654e-01 3.42e-06 7.68e-02 -3.8 1.78e-05 - 1.00e+00 7.81e-03h 8
284 -3.5155666e-01 3.42e-06 6.90e-02 -3.8 2.04e-05 - 1.00e+00 9.77e-04h 11
285 -3.5155664e-01 3.42e-06 4.14e-02 -3.8 1.38e-05 - 1.00e+00 2.44e-04h 13
286 -3.5155664e-01 3.42e-06 2.66e-02 -3.8 9.28e-06 - 1.00e+00 1.22e-04h 14
287 -3.5155664e-01 3.42e-06 8.85e-02 -3.8 6.53e-06 - 1.00e+00 1.53e-05h 17
288 -3.5186428e-01 2.84e-12 8.85e-02 -3.8 4.37e-05 - 1.00e+00 1.00e+00H 1
289 -3.5150874e-01 2.31e-14 1.67e-02 -3.8 5.52e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
290 -3.5150897e-01 1.49e-08 4.71e-02 -3.8 1.98e-05 - 1.00e+00 1.56e-02h 7
291 -3.5140871e-01 6.12e-15 7.20e-02 -3.8 1.83e-05 - 1.00e+00 1.00e+00H 1
292 -3.5148778e-01 2.26e-06 9.25e-02 -3.8 2.58e-05 - 1.00e+00 5.00e-01h 2
293 -3.5148552e-01 1.61e-06 4.72e-02 -3.8 7.95e-06 - 1.00e+00 5.00e-01h 2
294 -3.5156912e-01 3.55e-13 4.25e-02 -3.8 1.72e-05 - 1.00e+00 1.00e+00H 1
295 -3.5156941e-01 7.78e-09 8.97e-02 -3.8 2.11e-05 - 1.00e+00 1.95e-03h 10
296 -3.5141646e-01 8.58e-15 7.28e-02 -3.8 2.73e-05 - 1.00e+00 1.00e+00H 1
297 -3.5154944e-01 4.14e-06 4.18e-02 -3.8 3.87e-05 - 1.00e+00 5.00e-01h 2
298 -3.5155648e-01 3.41e-06 3.17e-02 -3.8 7.27e-06 - 1.00e+00 2.50e-01h 3
299 -3.5156217e-01 3.21e-06 2.62e-02 -3.8 1.02e-05 - 1.00e+00 1.25e-01h 4
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
300 -3.5156223e-01 3.06e-06 5.21e-02 -3.8 9.83e-06 - 1.00e+00 6.25e-02h 5
301 -3.5165209e-01 4.55e-13 9.49e-02 -3.8 1.67e-05 - 1.00e+00 1.00e+00H 1
302 -3.5146696e-01 4.44e-14 5.88e-02 -3.8 3.13e-05 - 1.00e+00 1.00e+00H 1
303 -3.5146756e-01 1.54e-08 5.60e-02 -3.8 2.39e-05 - 1.00e+00 3.91e-03h 9
304 -3.5138998e-01 9.63e-16 3.44e-02 -3.8 1.44e-05 - 1.00e+00 1.00e+00H 1
305 -3.5146398e-01 1.28e-06 3.18e-02 -3.8 2.08e-05 - 1.00e+00 5.00e-01h 2
306 -3.5147435e-01 1.11e-06 3.44e-02 -3.8 8.93e-06 - 1.00e+00 5.00e-01h 2
307 -3.5147477e-01 1.09e-06 3.79e-02 -3.8 1.40e-05 - 1.00e+00 6.25e-02h 5
308 -3.5147434e-01 1.08e-06 1.51e-02 -3.8 8.08e-06 - 1.00e+00 7.81e-03h 8
309 -3.5144634e-01 4.38e-07 3.67e-02 -3.8 1.12e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
310 -3.5151452e-01 1.59e-13 4.91e-02 -3.8 2.25e-05 - 1.00e+00 1.00e+00H 1
311 -3.5150424e-01 4.62e-14 7.93e-02 -3.8 9.31e-06 - 1.00e+00 1.00e+00H 1
312 -3.5150450e-01 1.02e-08 1.01e-01 -3.8 3.81e-05 - 1.00e+00 9.77e-04h 11
313 -3.5149614e-01 5.44e-14 5.17e-02 -3.8 6.79e-06 - 1.00e+00 1.00e+00H 1
314 -3.5150357e-01 1.37e-08 2.81e-02 -3.8 8.06e-06 - 1.00e+00 1.00e+00h 1
315 -3.5138943e-01 2.44e-16 1.56e-02 -3.8 1.85e-05 - 1.00e+00 1.00e+00H 1
316 -3.5138413e-01 1.00e-07 6.81e-02 -3.8 4.39e-06 - 1.00e+00 1.00e+00h 1
317 -3.5169168e-01 1.87e-12 2.64e-02 -3.8 5.23e-05 - 1.00e+00 1.00e+00H 1
318 -3.5159255e-01 1.68e-13 8.83e-02 -3.8 1.47e-05 - 1.00e+00 1.00e+00H 1
319 -3.5154792e-01 1.38e-13 8.14e-02 -3.8 1.31e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
320 -3.5154795e-01 5.36e-09 6.10e-02 -3.8 2.12e-05 - 1.00e+00 1.95e-03h 10
321 -3.5144034e-01 8.73e-16 3.50e-02 -3.8 2.06e-05 - 1.00e+00 1.00e+00H 1
322 -3.5144080e-01 1.38e-08 4.18e-02 -3.8 1.33e-05 - 1.00e+00 1.56e-02h 7
323 -3.5137740e-01 2.75e-16 7.13e-02 -3.8 1.07e-05 - 1.00e+00 1.00e+00H 1
324 -3.5154302e-01 3.95e-06 4.80e-02 -3.8 2.76e-05 - 1.00e+00 1.00e+00h 1
325 -3.5150925e-01 2.83e-06 7.61e-02 -3.8 2.68e-05 - 1.00e+00 2.50e-01h 3
326 -3.5160513e-01 5.24e-13 7.62e-02 -3.8 1.32e-05 - 1.00e+00 1.00e+00H 1
327 -3.5144161e-01 1.13e-14 5.73e-02 -3.8 2.60e-05 - 1.00e+00 1.00e+00H 1
328 -3.5144187e-01 1.21e-08 1.09e-01 -3.8 8.72e-06 - 1.00e+00 7.81e-03h 8
329 -3.5174621e-01 2.06e-12 7.26e-02 -3.8 4.53e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
330 -3.5160691e-01 2.41e-13 3.69e-02 -3.8 1.88e-05 - 1.00e+00 1.00e+00H 1
331 -3.5149612e-01 4.15e-14 2.02e-02 -3.8 1.86e-05 - 1.00e+00 1.00e+00H 1
332 -3.5146134e-01 1.91e-14 2.73e-02 -3.8 7.09e-06 - 1.00e+00 1.00e+00H 1
333 -3.5146183e-01 1.10e-08 8.40e-02 -3.8 9.08e-06 - 1.00e+00 7.81e-03h 8
334 -3.5166516e-01 9.53e-13 8.40e-02 -3.8 2.55e-05 - 1.00e+00 1.00e+00H 1
335 -3.5140903e-01 2.53e-15 8.11e-02 -3.8 3.87e-05 - 1.00e+00 1.00e+00H 1
336 -3.5156022e-01 4.85e-06 3.02e-02 -3.8 4.61e-05 - 1.00e+00 5.00e-01h 2
337 -3.5156417e-01 4.68e-06 8.63e-02 -3.8 1.55e-05 - 1.00e+00 6.25e-02h 5
338 -3.5153454e-01 3.48e-06 2.61e-02 -3.8 1.74e-05 - 1.00e+00 2.50e-01h 3
339 -3.5146600e-01 1.56e-06 4.79e-02 -3.8 2.12e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
340 -3.5153346e-01 2.05e-13 4.80e-02 -3.8 1.03e-05 - 1.00e+00 1.00e+00H 1
341 -3.5142311e-01 3.92e-15 3.43e-02 -3.8 2.15e-05 - 1.00e+00 1.00e+00H 1
342 -3.5144661e-01 7.22e-07 6.69e-02 -3.8 2.45e-05 - 1.00e+00 5.00e-01h 2
343 -3.5153255e-01 2.62e-13 2.79e-02 -3.8 2.08e-05 - 1.00e+00 1.00e+00H 1
344 -3.5157114e-01 1.10e-13 5.71e-02 -3.8 6.40e-06 - 1.00e+00 1.00e+00H 1
345 -3.5137751e-01 1.18e-15 1.55e-02 -3.8 3.43e-05 - 1.00e+00 1.00e+00H 1
346 -3.5137847e-01 1.67e-08 7.10e-02 -3.8 2.24e-06 - 1.00e+00 1.25e-01h 4
347 -3.5175553e-01 2.43e-12 4.49e-02 -3.8 5.76e-05 - 1.00e+00 1.00e+00H 1
348 -3.5154057e-01 1.59e-13 2.80e-02 -3.8 3.36e-05 - 1.00e+00 1.00e+00H 1
349 -3.5148685e-01 7.31e-15 8.15e-02 -3.8 1.01e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
350 -3.5148699e-01 5.37e-09 8.63e-02 -3.8 1.11e-05 - 1.00e+00 1.95e-03h 10
351 -3.5164511e-01 6.40e-13 1.83e-02 -3.8 2.62e-05 - 1.00e+00 1.00e+00H 1
352 -3.5163456e-01 4.38e-14 7.51e-02 -3.8 8.08e-06 - 1.00e+00 1.00e+00H 1
353 -3.5137979e-01 2.72e-15 1.35e-02 -3.8 4.36e-05 - 1.00e+00 1.00e+00H 1
354 -3.5138729e-01 1.46e-07 1.66e-02 -3.8 5.01e-06 - 1.00e+00 1.00e+00h 1
355 -3.5137411e-01 5.27e-08 4.25e-02 -3.8 5.24e-06 - 1.00e+00 1.00e+00h 1
356 -3.5149649e-01 1.85e-13 4.58e-02 -3.8 1.86e-05 - 1.00e+00 1.00e+00H 1
357 -3.5142806e-01 6.38e-15 7.62e-02 -3.8 1.05e-05 - 1.00e+00 1.00e+00H 1
358 -3.5150368e-01 2.15e-06 7.62e-02 -3.8 2.04e-05 - 1.00e+00 5.00e-01h 2
359 -3.5146229e-01 1.04e-06 6.86e-02 -3.8 1.19e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
360 -3.5161377e-01 6.47e-13 2.40e-02 -3.8 2.54e-05 - 1.00e+00 1.00e+00H 1
361 -3.5165912e-01 1.85e-13 4.85e-02 -3.8 8.17e-06 - 1.00e+00 1.00e+00H 1
362 -3.5148606e-01 7.81e-14 6.99e-02 -3.8 2.76e-05 - 1.00e+00 1.00e+00H 1
363 -3.5148636e-01 1.01e-08 1.09e-01 -3.8 2.30e-05 - 1.00e+00 1.95e-03h 10
364 -3.5148415e-01 7.80e-14 5.59e-02 -3.8 2.48e-05 - 1.00e+00 1.00e+00H 1
365 -3.5143068e-01 5.13e-07 3.05e-02 -3.8 1.26e-05 - 1.00e+00 1.00e+00h 1
366 -3.5141653e-01 3.08e-07 6.20e-02 -3.8 1.29e-05 - 1.00e+00 5.00e-01h 2
367 -3.5158097e-01 5.28e-13 5.13e-02 -3.8 2.85e-05 - 1.00e+00 1.00e+00H 1
368 -3.5148603e-01 4.25e-14 3.38e-02 -3.8 1.59e-05 - 1.00e+00 1.00e+00H 1
369 -3.5148625e-01 5.95e-09 5.89e-02 -3.8 1.36e-05 - 1.00e+00 3.91e-03h 9
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
370 -3.5165380e-01 6.92e-13 5.18e-02 -3.8 2.27e-05 - 1.00e+00 1.00e+00H 1
371 -3.5144954e-01 7.23e-15 4.78e-02 -3.8 3.03e-05 - 1.00e+00 1.00e+00H 1
372 -3.5144988e-01 7.18e-09 3.08e-02 -3.8 8.85e-06 - 1.00e+00 7.81e-03h 8
373 -3.5159775e-01 3.94e-13 6.03e-02 -3.8 1.71e-05 - 1.00e+00 1.00e+00H 1
374 -3.5148409e-01 4.14e-14 3.72e-02 -3.8 1.50e-05 - 1.00e+00 1.00e+00H 1
375 -3.5136418e-01 2.15e-09 7.05e-02 -3.8 3.22e-05 - 1.00e+00 1.00e+00h 1
376 -3.5165448e-01 1.27e-12 7.05e-02 -3.8 4.49e-05 - 1.00e+00 1.00e+00H 1
377 -3.5145990e-01 1.56e-14 6.26e-02 -3.8 3.13e-05 - 1.00e+00 1.00e+00H 1
378 -3.5145996e-01 1.69e-09 3.58e-02 -3.8 2.53e-05 - 1.00e+00 4.88e-04h 12
379 -3.5150648e-01 1.20e-13 6.04e-02 -3.8 8.94e-06 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
380 -3.5148853e-01 7.79e-14 9.10e-02 -3.8 1.43e-05 - 1.00e+00 1.00e+00H 1
381 -3.5148855e-01 9.10e-10 5.18e-02 -3.8 3.47e-05 - 1.00e+00 1.22e-04h 14
382 -3.5148127e-01 6.84e-14 3.27e-02 -3.8 8.39e-06 - 1.00e+00 1.00e+00H 1
383 -3.5148132e-01 6.97e-10 4.10e-02 -3.8 1.17e-05 - 1.00e+00 4.88e-04h 12
384 -3.5144612e-01 1.16e-14 2.95e-02 -3.8 1.26e-05 - 1.00e+00 1.00e+00H 1
385 -3.5144619e-01 1.51e-09 5.11e-02 -3.8 1.28e-05 - 1.00e+00 9.77e-04h 11
386 -3.5138194e-01 1.11e-16 6.96e-02 -3.8 1.50e-05 - 1.00e+00 1.00e+00H 1
387 -3.5147495e-01 2.24e-06 2.67e-02 -3.8 3.03e-05 - 1.00e+00 5.00e-01h 2
388 -3.5148593e-01 2.00e-06 2.23e-02 -3.8 1.65e-05 - 1.00e+00 2.50e-01h 3
389 -3.5158708e-01 3.43e-13 7.69e-02 -3.8 2.20e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
390 -3.5158708e-01 4.51e-10 7.69e-02 -3.8 1.42e-05 - 1.00e+00 1.22e-04h 14
391 -3.5139007e-01 1.28e-15 3.96e-02 -3.8 3.47e-05 - 1.00e+00 1.00e+00H 1
392 -3.5146145e-01 1.77e-06 2.86e-02 -3.8 2.80e-05 - 1.00e+00 5.00e-01h 2
393 -3.5146112e-01 1.67e-06 2.17e-02 -3.8 4.24e-06 - 1.00e+00 6.25e-02h 5
394 -3.5145315e-01 1.21e-06 1.35e-02 -3.8 8.81e-06 - 1.00e+00 2.50e-01h 3
395 -3.5143140e-01 5.60e-07 3.18e-02 -3.8 1.52e-05 - 1.00e+00 5.00e-01h 2
396 -3.5148403e-01 9.59e-14 5.50e-02 -3.8 1.58e-05 - 1.00e+00 1.00e+00H 1
397 -3.5148406e-01 8.53e-10 7.15e-02 -3.8 2.05e-05 - 1.00e+00 2.44e-04h 13
398 -3.5141318e-01 8.89e-15 7.97e-02 -3.8 1.22e-05 - 1.00e+00 1.00e+00H 1
399 -3.5141322e-01 1.18e-09 3.37e-02 -3.8 2.59e-05 - 1.00e+00 2.44e-04h 13
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
400 -3.5153420e-01 2.77e-13 5.07e-02 -3.8 1.84e-05 - 1.00e+00 1.00e+00H 1
401 -3.5147713e-01 4.79e-14 3.86e-02 -3.8 1.35e-05 - 1.00e+00 1.00e+00H 1
402 -3.5138634e-01 1.26e-16 2.12e-02 -3.8 1.55e-05 - 1.00e+00 1.00e+00H 1
403 -3.5142921e-01 5.11e-07 3.48e-02 -3.8 6.95e-06 - 1.00e+00 1.00e+00h 1
404 -3.5144253e-01 3.17e-14 8.46e-02 -3.8 4.92e-06 - 1.00e+00 1.00e+00H 1
405 -3.5155418e-01 3.03e-06 8.46e-02 -3.8 3.69e-05 - 1.00e+00 5.00e-01h 2
406 -3.5155694e-01 2.92e-06 6.56e-02 -3.8 8.04e-06 - 1.00e+00 1.25e-01h 4
407 -3.5155668e-01 2.88e-06 6.13e-02 -3.8 8.01e-06 - 1.00e+00 3.12e-02h 6
408 -3.5146461e-01 1.41e-06 8.44e-02 -3.8 2.83e-05 - 1.00e+00 5.00e-01h 2
409 -3.5166111e-01 1.11e-12 5.61e-02 -3.8 3.44e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
410 -3.5144941e-01 5.84e-14 3.60e-02 -3.8 3.70e-05 - 1.00e+00 1.00e+00H 1
411 -3.5136981e-01 2.92e-16 8.24e-02 -3.8 1.61e-05 - 1.00e+00 1.00e+00H 1
412 -3.5147437e-01 2.60e-06 1.84e-02 -3.8 3.25e-05 - 1.00e+00 5.00e-01h 2
413 -3.5156525e-01 3.52e-13 2.49e-02 -3.8 1.93e-05 - 1.00e+00 1.00e+00H 1
414 -3.5160974e-01 1.52e-13 2.87e-02 -3.8 8.28e-06 - 1.00e+00 1.00e+00H 1
415 -3.5152926e-01 1.19e-13 3.30e-02 -3.8 1.42e-05 - 1.00e+00 1.00e+00H 1
416 -3.5144108e-01 1.74e-14 4.09e-02 -3.8 1.76e-05 - 1.00e+00 1.00e+00H 1
417 -3.5144109e-01 7.98e-10 8.81e-02 -3.8 3.35e-05 - 1.00e+00 4.88e-04h 12
418 -3.5171821e-01 1.72e-12 7.44e-02 -3.8 4.39e-05 - 1.00e+00 1.00e+00H 1
419 -3.5152007e-01 1.22e-13 4.61e-02 -3.8 3.11e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
420 -3.5138496e-01 2.10e-16 4.94e-02 -3.8 2.49e-05 - 1.00e+00 1.00e+00H 1
421 -3.5142194e-01 7.03e-07 4.94e-02 -3.8 2.20e-05 - 1.00e+00 2.50e-01h 3
422 -3.5139354e-01 3.15e-07 1.75e-02 -3.8 9.14e-06 - 1.00e+00 1.00e+00h 1
423 -3.5140694e-01 2.99e-07 2.60e-02 -3.8 4.60e-06 - 1.00e+00 5.00e-01h 2
424 -3.5141169e-01 5.46e-07 2.14e-02 -3.8 1.11e-05 - 1.00e+00 1.00e+00h 1
425 -3.5140995e-01 4.35e-07 3.17e-02 -3.8 4.90e-06 - 1.00e+00 2.50e-01h 3
426 -3.5144510e-01 4.84e-14 3.02e-02 -3.8 1.27e-05 - 1.00e+00 1.00e+00H 1
427 -3.5144513e-01 5.48e-10 2.41e-02 -3.8 1.88e-05 - 1.00e+00 2.44e-04h 13
428 -3.5157444e-01 3.99e-13 7.31e-02 -3.8 2.11e-05 - 1.00e+00 1.00e+00H 1
429 -3.5154508e-01 1.24e-13 1.12e-01 -3.8 1.17e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
430 -3.5154509e-01 3.99e-10 2.77e-02 -3.8 2.50e-05 - 1.00e+00 6.10e-05h 15
431 -3.5159330e-01 4.22e-13 8.15e-02 -3.8 1.79e-05 - 1.00e+00 1.00e+00H 1
432 -3.5142496e-01 1.79e-14 5.82e-02 -3.8 2.97e-05 - 1.00e+00 1.00e+00H 1
433 -3.5142501e-01 9.17e-10 3.82e-02 -3.8 1.52e-05 - 1.00e+00 4.88e-04h 12
434 -3.5141943e-01 2.66e-14 6.28e-02 -3.8 2.23e-05 - 1.00e+00 1.00e+00H 1
435 -3.5141944e-01 6.20e-10 6.26e-02 -3.8 5.11e-05 - 1.00e+00 6.10e-05h 15
436 -3.5142035e-01 6.65e-15 6.74e-02 -3.8 1.91e-05 - 1.00e+00 1.00e+00H 1
437 -3.5142039e-01 9.89e-10 1.09e-01 -3.8 1.83e-05 - 1.00e+00 2.44e-04h 13
438 -3.5169217e-01 1.60e-12 1.09e-01 -3.8 4.48e-05 - 1.00e+00 1.00e+00H 1
439 -3.5138975e-01 2.07e-15 7.73e-02 -3.8 5.68e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
440 -3.5153026e-01 4.03e-06 7.73e-02 -3.8 4.20e-05 - 1.00e+00 5.00e-01h 2
441 -3.5145633e-01 2.00e-06 3.52e-02 -3.8 2.31e-05 - 1.00e+00 5.00e-01h 2
442 -3.5145992e-01 1.73e-06 4.68e-02 -3.8 1.44e-05 - 1.00e+00 2.50e-01h 3
443 -3.5152065e-01 1.81e-13 2.95e-02 -3.8 1.43e-05 - 1.00e+00 1.00e+00H 1
444 -3.5152066e-01 3.29e-10 9.97e-02 -3.8 1.53e-05 - 1.00e+00 1.22e-04h 14
445 -3.5154015e-01 1.70e-13 6.76e-02 -3.8 1.00e-05 - 1.00e+00 1.00e+00H 1
446 -3.5154015e-01 2.70e-10 6.76e-02 -3.8 1.37e-05 - 1.00e+00 1.22e-04h 14
447 -3.5148062e-01 3.31e-14 7.11e-02 -3.8 9.59e-06 - 1.00e+00 1.00e+00H 1
448 -3.5148063e-01 2.83e-10 1.90e-02 -3.8 1.11e-05 - 1.00e+00 1.22e-04h 14
449 -3.5160941e-01 6.31e-13 6.45e-02 -3.8 2.23e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
450 -3.5141198e-01 1.09e-14 1.81e-02 -3.8 3.54e-05 - 1.00e+00 1.00e+00H 1
451 -3.5141207e-01 2.11e-09 1.80e-02 -3.8 6.00e-06 - 1.00e+00 3.91e-03h 9
452 -3.5141006e-01 5.50e-15 3.13e-02 -3.8 5.60e-06 - 1.00e+00 1.00e+00H 1
453 -3.5141012e-01 1.58e-09 7.53e-02 -3.8 2.86e-05 - 1.00e+00 4.88e-04h 12
454 -3.5137450e-01 1.05e-16 4.95e-02 -3.8 5.99e-06 - 1.00e+00 1.00e+00H 1
455 -3.5147312e-01 1.90e-06 4.44e-02 -3.8 2.97e-05 - 1.00e+00 5.00e-01h 2
456 -3.5155432e-01 2.47e-13 9.49e-02 -3.8 1.35e-05 - 1.00e+00 1.00e+00H 1
457 -3.5155433e-01 1.96e-10 4.64e-02 -3.8 2.20e-05 - 1.00e+00 3.05e-05h 16
458 -3.5147049e-01 6.62e-14 2.92e-02 -3.8 1.20e-05 - 1.00e+00 1.00e+00H 1
459 -3.5146820e-01 2.87e-14 4.56e-02 -3.8 7.71e-06 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
460 -3.5144174e-01 2.09e-16 9.08e-02 -3.8 1.80e-05 - 1.00e+00 1.00e+00H 1
461 -3.5152316e-01 2.58e-06 2.38e-02 -3.8 4.71e-05 - 1.00e+00 2.50e-01h 3
462 -3.5167861e-01 8.84e-13 8.94e-02 -3.8 2.57e-05 - 1.00e+00 1.00e+00H 1
463 -3.5142634e-01 8.02e-15 4.56e-02 -3.8 4.09e-05 - 1.00e+00 1.00e+00H 1
464 -3.5141755e-01 1.13e-14 3.75e-02 -3.8 1.03e-05 - 1.00e+00 1.00e+00H 1
465 -3.5145536e-01 1.14e-06 2.76e-02 -3.8 2.16e-05 - 1.00e+00 5.00e-01h 2
466 -3.5151056e-01 1.77e-13 2.27e-02 -3.8 1.04e-05 - 1.00e+00 1.00e+00H 1
467 -3.5158908e-01 1.53e-13 6.33e-02 -3.8 1.15e-05 - 1.00e+00 1.00e+00H 1
468 -3.5147309e-01 2.13e-14 5.62e-02 -3.8 2.16e-05 - 1.00e+00 1.00e+00H 1
469 -3.5136436e-01 1.11e-16 6.86e-02 -3.8 1.99e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
470 -3.5147119e-01 2.83e-06 4.67e-02 -3.8 3.39e-05 - 1.00e+00 5.00e-01h 2
471 -3.5147174e-01 2.59e-06 7.23e-02 -3.8 1.23e-05 - 1.00e+00 1.25e-01h 4
472 -3.5165752e-01 9.65e-13 8.00e-02 -3.8 3.12e-05 - 1.00e+00 1.00e+00H 1
473 -3.5162388e-01 3.58e-13 8.00e-02 -3.8 1.40e-05 - 1.00e+00 1.00e+00H 1
474 -3.5138518e-01 1.28e-07 6.36e-02 -3.8 4.03e-05 - 1.00e+00 1.00e+00h 1
475 -3.5154905e-01 3.93e-13 2.32e-02 -3.8 2.69e-05 - 1.00e+00 1.00e+00H 1
476 -3.5150744e-01 7.35e-15 2.39e-02 -3.8 5.80e-06 - 1.00e+00 1.00e+00H 1
477 -3.5150744e-01 1.64e-10 6.06e-02 -3.8 9.88e-06 - 1.00e+00 1.22e-04h 14
478 -3.5144955e-01 1.48e-14 8.09e-02 -3.8 1.17e-05 - 1.00e+00 1.00e+00H 1
479 -3.5144956e-01 5.76e-10 9.20e-02 -3.8 4.35e-05 - 1.00e+00 6.10e-05h 15
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
480 -3.5137971e-01 6.01e-16 5.17e-02 -3.8 1.27e-05 - 1.00e+00 1.00e+00H 1
481 -3.5149574e-01 2.52e-06 2.67e-02 -3.8 3.59e-05 - 1.00e+00 5.00e-01h 2
482 -3.5149592e-01 2.49e-06 2.72e-02 -3.8 4.93e-06 - 1.00e+00 1.56e-02h 7
483 -3.5149584e-01 2.49e-06 2.90e-02 -3.8 1.07e-05 - 1.00e+00 9.77e-04h 11
484 -3.5144271e-01 1.21e-06 1.79e-02 -3.8 1.62e-05 - 1.00e+00 5.00e-01h 2
485 -3.5141266e-01 6.26e-07 4.70e-02 -3.8 1.16e-05 - 1.00e+00 5.00e-01h 2
486 -3.5145967e-01 9.20e-14 4.49e-02 -3.8 2.10e-05 - 1.00e+00 1.00e+00H 1
487 -3.5141246e-01 7.85e-15 2.11e-02 -3.8 9.22e-06 - 1.00e+00 1.00e+00H 1
488 -3.5141254e-01 1.43e-09 2.70e-02 -3.8 8.55e-06 - 1.00e+00 1.95e-03h 10
489 -3.5145611e-01 3.67e-14 2.94e-02 -3.8 6.02e-06 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
490 -3.5150474e-01 2.70e-06 2.60e-02 -3.8 7.41e-06 - 1.00e+00 1.00e+00H 1
491 -3.5150387e-01 2.62e-06 3.80e-02 -3.8 5.80e-06 - 1.00e+00 3.12e-02h 6
492 -3.5166542e-01 6.81e-13 4.56e-02 -3.8 2.71e-05 - 1.00e+00 1.00e+00H 1
493 -3.5168523e-01 3.60e-13 4.05e-02 -3.8 1.03e-05 - 1.00e+00 1.00e+00H 1
494 -3.5153445e-01 1.45e-13 9.12e-02 -3.8 2.23e-05 - 1.00e+00 1.00e+00H 1
495 -3.5155210e-01 1.42e-13 1.02e-01 -3.8 1.71e-05 - 1.00e+00 1.00e+00H 1
496 -3.5155210e-01 1.28e-10 3.25e-02 -3.8 3.18e-05 - 1.00e+00 1.53e-05h 17
497 -3.5154198e-01 2.24e-13 7.31e-02 -3.8 1.55e-05 - 1.00e+00 1.00e+00H 1
498 -3.5137743e-01 1.39e-15 6.30e-02 -3.8 3.34e-05 - 1.00e+00 1.00e+00H 1
499 -3.5143196e-01 1.63e-06 6.30e-02 -3.8 2.66e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
500 -3.5140182e-01 8.04e-07 7.11e-03 -3.8 1.05e-05 - 1.00e+00 5.00e-01h 2

Number of Iterations....: 500

                               (scaled)                 (unscaled)

Objective...............: -3.5140181986441943e-01 -3.5140181986441943e-01
Dual infeasibility......: 7.1100437675397643e-03 7.1100437675397643e-03
Constraint violation....: 8.0400442901021958e-07 8.0400442901021958e-07
Complementarity.........: 1.5061935863985854e-04 1.5061935863985854e-04
Overall NLP error.......: 7.1100437675397643e-03 7.1100437675397643e-03

Number of objective function evaluations = 1558
Number of objective gradient evaluations = 501
Number of constraint evaluations = 1558
Number of constraint Jacobian evaluations = 501
Number of Lagrangian Hessian evaluations = 500
Total wall-clock secs in solver (w/o fun. eval./lin. alg.) = 3.888
Total wall-clock secs in linear solver = 1.274
Total wall-clock secs in NLP function evaluations = 3.243
Total wall-clock secs = 8.404

EXIT: Maximum Number of Iterations Exceeded.

frapac · 2024-12-05T10:18:12Z

Hi @Franc-Z
thank you for your interest in MadNLP. If you use MadNLP with dense linear algebra running on the GPU (LapackGPUSolver), then you don't have any guarantee that the results are deterministic. The code of the solver is highly parallel, and can return different results on different hardware (as we are observing here).

By any chance, can you try running this code on your A6000 and on your H100 (just to test what result we get using a different factorization algorithm):

solver = MadNLPGPU.MadNLPSolver(
    nlp;
    tol= tol,
    callback=MadNLP.DenseCallback,
    kkt_system=MadNLP.DenseCondensedKKTSystem,
    linear_solver=MadNLPGPU.LapackGPUSolver,
    lapack_algorithm=MadNLP.LU,
    acceptable_tol = tol,
    equality_treatment = MadNLP.EnforceEquality,
    print_level = MadNLP.INFO,
    max_iter = 500,
)
@time CUDA.@allowscalar results = MadNLPGPU.solve!(solver)

Franc-Z · 2024-12-05T10:59:13Z

hi, @frapac Francois, I have tested the LU decomposition, on A6000 we can get right results, and on H100 it can't converge either. I'm quite curious that why "LapackGPUSolver would return different results on different hardware"? Is there a stable solver (if for dense case would be better ) in MadNLP, since I want to try it in quant tasks. Thanks!

Franc-Z · 2024-12-05T12:28:38Z

This is the output of MadNLP.LU: (doesn't converge)
This is MadNLP version v0.8.4, running with Lapack-GPU (LU)

Number of nonzeros in constraint Jacobian............: 9118
Number of nonzeros in Lagrangian Hessian.............: 10394520

Total number of variables............................: 4559
variables with only lower bounds: 0
variables with lower and upper bounds: 4559
variables with only upper bounds: 0
Total number of equality constraints.................: 0
Total number of inequality constraints...............: 2
inequality constraints with only lower bounds: 0
inequality constraints with lower and upper bounds: 1
inequality constraints with only upper bounds: 1

iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
0 1.1642654e+01 4.46e+01 2.06e+00 -1.0 0.00e+00 - 0.00e+00 0.00e+00 0
1 6.9332722e+00 3.02e+01 4.32e+00 -1.0 1.91e-01 - 9.80e-02 3.23e-01h 1
2 7.0844536e+00 2.36e+01 1.07e+01 -1.0 1.36e+00 - 1.00e+00 2.19e-01h 1
3 2.1243267e+00 7.15e+00 6.84e+00 -1.0 1.18e-01 - 9.03e-01 6.97e-01h 1
4 1.5020424e+00 3.44e+00 2.82e+01 -1.0 3.78e-01 - 1.00e+00 5.19e-01h 1
5 5.9553081e-01 5.67e-01 1.85e+01 -1.0 5.49e-02 - 1.00e+00 8.35e-01h 1
6 5.8778716e-01 1.87e-01 3.80e+01 -1.0 3.87e-02 - 1.00e+00 6.69e-01h 1
7 5.0843564e-01 3.88e-04 2.23e-02 -1.0 4.13e-03 - 1.00e+00 1.00e+00h 1
8 3.8286124e-01 5.72e-06 5.37e+01 -2.5 1.27e-01 - 8.62e-01 9.87e-01h 1
9 3.8432988e-01 1.79e-06 6.42e-02 -2.5 1.95e-03 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
10 3.8185525e-01 7.35e-06 8.74e-02 -2.5 1.81e-03 - 1.00e+00 1.00e+00h 1
11 3.8184973e-01 2.82e-06 8.77e-02 -2.5 3.90e-06 - 1.00e+00 1.00e+00h 1
12 3.8186227e-01 7.72e-08 1.30e-01 -2.5 3.13e-06 - 1.00e+00 1.00e+00h 1
13 3.8184964e-01 2.79e-06 1.12e-01 -2.5 2.90e-06 - 1.00e+00 1.00e+00h 1
14 3.8185522e-01 1.19e-06 8.86e-02 -2.5 3.21e-06 - 1.00e+00 5.00e-01h 2
15 3.8185074e-01 4.17e-13 3.98e-02 -2.5 6.09e-07 - 1.00e+00 1.00e+00H 1
16 3.8185256e-01 5.83e-08 5.92e-02 -2.5 6.42e-07 - 1.00e+00 1.00e+00h 1
17 3.8185896e-01 3.30e-14 4.90e-02 -2.5 9.04e-07 - 1.00e+00 1.00e+00H 1
18 3.8191381e-01 1.51e-04 6.52e-02 -2.5 7.73e-07 - 1.00e+00 1.00e+00H 1
19 3.8188774e-01 7.57e-05 7.63e-02 -2.5 2.29e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
20 3.8185284e-01 1.57e-06 7.64e-02 -2.5 1.33e-05 - 1.00e+00 1.00e+00h 1
21 3.8185677e-01 3.26e-07 6.88e-02 -2.5 1.25e-06 - 1.00e+00 1.00e+00h 1
22 3.8186230e-01 2.77e-08 9.63e-02 -2.5 1.03e-06 - 1.00e+00 1.00e+00h 1
23 3.8184903e-01 2.59e-06 9.63e-02 -2.5 3.02e-06 - 1.00e+00 1.00e+00h 1
24 3.8186125e-01 1.30e-08 1.82e-02 -2.5 2.98e-06 - 1.00e+00 1.00e+00h 1
25 3.7051954e-01 1.70e-06 1.12e+00 -3.8 3.03e-03 - 9.08e-01 1.00e+00h 1
26 2.6970843e-01 6.82e-04 9.98e-01 -3.8 1.34e-02 - 3.30e-02 1.00e+00h 1
27 -2.5302300e-02 3.52e-02 6.13e-01 -3.8 1.29e-01 - 2.04e-01 1.00e+00h 1
28 -2.5323355e-01 2.11e-02 3.50e-01 -3.8 8.89e-02 - 1.57e-01 1.00e+00h 1
29 -3.1452675e-01 1.25e-03 1.63e-01 -3.8 2.79e-02 - 4.65e-01 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
30 -3.4712763e-01 2.73e-03 4.56e-02 -3.8 3.30e-02 - 6.73e-01 1.00e+00h 1
31 -3.5127133e-01 3.41e-04 6.74e-02 -3.8 1.63e-02 - 1.00e+00 1.00e+00h 1
32 -3.5079394e-01 9.13e-06 1.99e-02 -3.8 2.53e-03 - 1.00e+00 1.00e+00h 1
33 -3.5081063e-01 7.84e-07 6.57e-02 -3.8 1.81e-04 - 1.00e+00 1.00e+00h 1
34 -3.5101614e-01 5.69e-06 7.91e-02 -3.8 2.83e-05 - 1.00e+00 1.00e+00h 1
35 -3.5098613e-01 3.87e-06 7.64e-02 -3.8 1.56e-05 - 1.00e+00 5.00e-01h 2
36 -3.5078044e-01 4.19e-07 5.73e-02 -3.8 3.04e-05 - 1.00e+00 1.00e+00h 1
37 -3.5097436e-01 5.44e-13 6.00e-02 -3.8 3.15e-05 - 1.00e+00 1.00e+00H 1
38 -3.5096373e-01 1.59e-13 4.80e-02 -3.8 1.10e-05 - 1.00e+00 1.00e+00H 1
39 -3.5076413e-01 1.94e-07 7.23e-02 -3.8 3.30e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
40 -3.5095573e-01 4.62e-06 2.22e-02 -3.8 3.01e-05 - 1.00e+00 1.00e+00h 1
41 -3.5091178e-01 4.50e-08 3.52e-02 -3.8 9.24e-06 - 1.00e+00 1.00e+00h 1
42 -3.5091942e-01 6.05e-14 3.82e-02 -3.8 4.82e-06 - 1.00e+00 1.00e+00H 1
43 -3.5097188e-01 8.49e-14 4.54e-02 -3.8 7.46e-06 - 1.00e+00 1.00e+00H 1
44 -3.5079061e-01 4.50e-15 2.61e-02 -3.8 2.98e-05 - 1.00e+00 1.00e+00H 1
45 -3.5075124e-01 1.16e-10 5.43e-02 -3.8 8.11e-06 - 1.00e+00 1.00e+00h 1
46 -3.5097138e-01 3.72e-06 5.43e-02 -3.8 3.32e-05 - 1.00e+00 1.00e+00h 1
47 -3.5086233e-01 1.76e-06 3.61e-02 -3.8 3.17e-05 - 1.00e+00 5.00e-01h 2
48 -3.5085525e-01 1.35e-06 4.40e-02 -3.8 2.07e-05 - 1.00e+00 5.00e-01h 2
49 -3.5102448e-01 7.33e-13 8.19e-02 -3.8 2.70e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
50 -3.5078074e-01 1.63e-15 1.69e-02 -3.8 4.14e-05 - 1.00e+00 1.00e+00H 1
51 -3.5075167e-01 5.19e-08 1.67e-02 -3.8 9.10e-06 - 1.00e+00 1.00e+00h 1
52 -3.5076209e-01 1.42e-07 7.64e-02 -3.8 3.40e-06 - 1.00e+00 1.00e+00h 1
53 -3.5102272e-01 7.35e-06 1.03e-01 -3.8 4.10e-05 - 1.00e+00 1.00e+00h 1
54 -3.5100155e-01 5.37e-06 1.01e-01 -3.8 1.98e-05 - 1.00e+00 5.00e-01h 2
55 -3.5087831e-01 2.63e-06 3.18e-02 -3.8 3.85e-05 - 1.00e+00 5.00e-01h 2
56 -3.5085160e-01 1.47e-06 7.06e-02 -3.8 6.48e-06 - 1.00e+00 5.00e-01h 2
57 -3.5116684e-01 2.17e-12 1.02e-01 -3.8 4.59e-05 - 1.00e+00 1.00e+00H 1
58 -3.5077312e-01 7.31e-15 1.06e-01 -3.8 6.50e-05 - 1.00e+00 1.00e+00H 1
59 -3.5119282e-01 4.59e-05 5.93e-02 -3.8 5.64e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
60 -3.5104492e-01 2.29e-05 4.62e-02 -3.8 4.41e-05 - 1.00e+00 5.00e-01h 2
61 -3.5103720e-01 1.15e-05 7.97e-02 -3.8 8.65e-06 - 1.00e+00 5.00e-01h 2
62 -3.5095011e-01 5.73e-06 5.50e-02 -3.8 2.82e-05 - 1.00e+00 5.00e-01h 2
63 -3.5089115e-01 2.87e-06 3.23e-02 -3.8 2.28e-05 - 1.00e+00 5.00e-01h 2
64 -3.5102440e-01 3.71e-06 6.99e-02 -3.8 1.77e-05 - 1.00e+00 1.00e+00h 1
65 -3.5082289e-01 1.06e-07 6.33e-02 -3.8 2.86e-05 - 1.00e+00 1.00e+00h 1
66 -3.5101748e-01 8.51e-13 2.67e-02 -3.8 3.21e-05 - 1.00e+00 1.00e+00H 1
67 -3.5105579e-01 2.03e-13 9.89e-02 -3.8 5.15e-06 - 1.00e+00 1.00e+00H 1
68 -3.5075815e-01 3.68e-08 7.11e-02 -3.8 5.33e-05 - 1.00e+00 1.00e+00h 1
69 -3.5102387e-01 9.55e-13 2.45e-02 -3.8 4.08e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
70 -3.5101433e-01 7.26e-14 3.03e-02 -3.8 1.12e-05 - 1.00e+00 1.00e+00H 1
71 -3.5093560e-01 4.01e-14 7.03e-02 -3.8 1.27e-05 - 1.00e+00 1.00e+00H 1
72 -3.5075834e-01 1.14e-15 5.00e-02 -3.8 3.23e-05 - 1.00e+00 1.00e+00H 1
73 -3.5106677e-01 4.93e-05 3.84e-02 -3.8 3.85e-05 - 1.00e+00 1.00e+00H 1
74 -3.5100035e-01 2.47e-05 3.44e-02 -3.8 1.84e-05 - 1.00e+00 5.00e-01h 2
75 -3.5090369e-01 1.23e-05 8.83e-02 -3.8 3.37e-05 - 1.00e+00 5.00e-01h 2
76 -3.5098795e-01 6.17e-06 4.51e-02 -3.8 2.40e-05 - 1.00e+00 5.00e-01h 2
77 -3.5099702e-01 4.63e-06 3.09e-02 -3.8 2.05e-05 - 1.00e+00 2.50e-01h 3
78 -3.5090996e-01 6.75e-07 5.26e-02 -3.8 1.14e-05 - 1.00e+00 1.00e+00h 1
79 -3.5104826e-01 4.98e-06 6.82e-02 -3.8 1.96e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
80 -3.5097530e-01 1.64e-06 3.03e-02 -3.8 1.98e-05 - 1.00e+00 5.00e-01h 2
81 -3.5079482e-01 5.44e-07 6.14e-02 -3.8 3.01e-05 - 1.00e+00 1.00e+00h 1
82 -3.5102354e-01 5.76e-06 7.17e-02 -3.8 3.33e-05 - 1.00e+00 1.00e+00h 1
83 -3.5081121e-01 1.05e-06 5.06e-02 -3.8 3.13e-05 - 1.00e+00 1.00e+00h 1
84 -3.5106831e-01 6.95e-06 4.80e-02 -3.8 4.02e-05 - 1.00e+00 1.00e+00h 1
85 -3.5096313e-01 2.75e-06 3.97e-02 -3.8 3.28e-05 - 1.00e+00 5.00e-01h 2
86 -3.5075118e-01 1.55e-07 4.77e-02 -3.8 3.40e-05 - 1.00e+00 1.00e+00h 1
87 -3.5088409e-01 3.30e-06 4.82e-02 -3.8 3.10e-05 - 1.00e+00 1.00e+00h 1
88 -3.5075539e-01 9.43e-09 3.49e-02 -3.8 3.32e-05 - 1.00e+00 1.00e+00h 1
89 -3.5094296e-01 3.13e-06 4.14e-02 -3.8 2.92e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
90 -3.5092403e-01 2.11e-06 4.14e-02 -3.8 6.78e-06 - 1.00e+00 5.00e-01h 2
91 -3.5084376e-01 8.98e-07 5.90e-02 -3.8 2.51e-05 - 1.00e+00 5.00e-01h 2
92 -3.5087652e-01 1.05e-13 2.19e-02 -3.8 6.87e-06 - 1.00e+00 1.00e+00H 1
93 -3.5084633e-01 8.67e-15 2.90e-02 -3.8 1.02e-05 - 1.00e+00 1.00e+00H 1
94 -3.5078299e-01 4.06e-15 4.04e-02 -3.8 1.10e-05 - 1.00e+00 1.00e+00H 1
95 -3.5090061e-01 2.24e-06 2.35e-02 -3.8 2.64e-05 - 1.00e+00 1.00e+00h 1
96 -3.5089505e-01 1.91e-06 3.04e-02 -3.8 1.20e-05 - 1.00e+00 1.25e-01h 4
97 -3.5082781e-01 8.43e-07 4.75e-02 -3.8 2.25e-05 - 1.00e+00 5.00e-01h 2
98 -3.5093123e-01 1.97e-13 2.97e-02 -3.8 1.59e-05 - 1.00e+00 1.00e+00H 1
99 -3.5085567e-01 8.61e-15 2.89e-02 -3.8 1.01e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
100 -3.5084637e-01 9.13e-15 2.26e-02 -3.8 1.66e-05 - 1.00e+00 1.00e+00H 1
101 -3.5080738e-01 4.62e-15 2.56e-02 -3.8 7.77e-06 - 1.00e+00 1.00e+00H 1
102 -3.5078847e-01 5.16e-07 9.98e-02 -3.8 1.23e-05 - 1.00e+00 1.00e+00h 1
103 -3.5119432e-01 1.48e-05 9.97e-02 -3.8 5.92e-05 - 1.00e+00 1.00e+00h 1
104 -3.5098188e-01 7.26e-06 1.76e-02 -3.8 6.17e-05 - 1.00e+00 5.00e-01h 2
105 -3.5087962e-01 3.41e-06 8.60e-02 -3.8 3.06e-05 - 1.00e+00 5.00e-01h 2
106 -3.5098119e-01 5.01e-13 6.41e-02 -3.8 1.92e-05 - 1.00e+00 1.00e+00H 1
107 -3.5081959e-01 2.52e-14 1.93e-02 -3.8 2.96e-05 - 1.00e+00 1.00e+00H 1
108 -3.5078705e-01 1.22e-15 3.76e-02 -3.8 1.01e-05 - 1.00e+00 1.00e+00H 1
109 -3.5083634e-01 7.26e-06 5.01e-02 -3.8 8.66e-06 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
110 -3.5091476e-01 3.63e-06 5.13e-02 -3.8 2.32e-05 - 1.00e+00 5.00e-01h 2
111 -3.5083108e-01 1.82e-06 6.03e-02 -3.8 2.59e-05 - 1.00e+00 5.00e-01h 2
112 -3.5087287e-01 1.82e-06 3.83e-02 -3.8 1.41e-05 - 1.00e+00 5.00e-01h 2
113 -3.5100812e-01 8.24e-13 3.69e-02 -3.8 2.52e-05 - 1.00e+00 1.00e+00H 1
114 -3.5088716e-01 1.22e-13 5.60e-02 -3.8 2.13e-05 - 1.00e+00 1.00e+00H 1
115 -3.5076415e-01 1.19e-15 1.20e-02 -3.8 2.23e-05 - 1.00e+00 1.00e+00H 1
116 -3.5074466e-01 7.16e-10 4.56e-02 -3.8 4.33e-06 - 1.00e+00 1.00e+00h 1
117 -3.5096069e-01 5.97e-13 4.32e-02 -3.8 3.58e-05 - 1.00e+00 1.00e+00H 1
118 -3.5076226e-01 9.77e-16 2.23e-02 -3.8 3.40e-05 - 1.00e+00 1.00e+00H 1
119 -3.5074803e-01 1.11e-16 3.50e-02 -3.8 4.25e-06 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
120 -3.5086297e-01 2.04e-06 3.51e-02 -3.8 2.32e-05 - 1.00e+00 1.00e+00h 1
121 -3.5082999e-01 9.43e-07 1.77e-02 -3.8 1.15e-05 - 1.00e+00 5.00e-01h 2
122 -3.5074192e-01 7.52e-11 1.83e-02 -3.8 1.73e-05 - 1.00e+00 1.00e+00h 1
123 -3.5077326e-01 2.88e-07 3.26e-02 -3.8 8.00e-06 - 1.00e+00 1.00e+00h 1
124 -3.5084684e-01 1.80e-06 7.26e-02 -3.8 1.50e-05 - 1.00e+00 1.00e+00h 1
125 -3.5102880e-01 8.37e-13 7.26e-02 -3.8 2.91e-05 - 1.00e+00 1.00e+00H 1
126 -3.5083778e-01 6.15e-15 4.32e-02 -3.8 3.17e-05 - 1.00e+00 1.00e+00H 1
127 -3.5075489e-01 1.03e-07 5.33e-02 -3.8 2.20e-05 - 1.00e+00 1.00e+00h 1
128 -3.5093093e-01 4.60e-13 3.39e-02 -3.8 3.89e-05 - 1.00e+00 1.00e+00H 1
129 -3.5101763e-01 3.99e-13 8.96e-02 -3.8 1.38e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
130 -3.5074970e-01 1.02e-08 1.63e-02 -3.8 4.78e-05 - 1.00e+00 1.00e+00h 1
131 -3.5076888e-01 2.79e-07 3.99e-02 -3.8 1.45e-05 - 1.00e+00 1.00e+00h 1
132 -3.5080473e-01 4.52e-14 4.71e-02 -3.8 1.68e-05 - 1.00e+00 1.00e+00H 1
133 -3.5092690e-01 1.07e-05 4.13e-02 -3.8 1.46e-05 - 1.00e+00 1.00e+00H 1
134 -3.5086650e-01 5.33e-06 3.93e-02 -3.8 1.87e-05 - 1.00e+00 5.00e-01h 2
135 -3.5090588e-01 2.67e-06 4.25e-02 -3.8 2.14e-05 - 1.00e+00 5.00e-01h 2
136 -3.5087233e-01 1.33e-06 8.74e-02 -3.8 9.77e-06 - 1.00e+00 5.00e-01h 2
137 -3.5109630e-01 1.52e-12 8.58e-02 -3.8 3.62e-05 - 1.00e+00 1.00e+00H 1
138 -3.5079755e-01 9.62e-15 2.94e-02 -3.8 5.13e-05 - 1.00e+00 1.00e+00H 1
139 -3.5075625e-01 3.31e-16 3.30e-02 -3.8 1.12e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
140 -3.5082772e-01 1.40e-06 3.61e-02 -3.8 1.29e-05 - 1.00e+00 1.00e+00h 1
141 -3.5083206e-01 9.97e-07 5.40e-02 -3.8 1.13e-05 - 1.00e+00 5.00e-01h 2
142 -3.5083642e-01 9.21e-07 5.15e-02 -3.8 6.94e-06 - 1.00e+00 2.50e-01h 3
143 -3.5082616e-01 6.95e-07 2.80e-02 -3.8 9.93e-06 - 1.00e+00 2.50e-01h 3
144 -3.5082047e-01 6.06e-07 2.48e-02 -3.8 6.99e-06 - 1.00e+00 1.25e-01h 4
145 -3.5078955e-01 1.32e-07 2.38e-02 -3.8 1.34e-05 - 1.00e+00 1.00e+00h 1
146 -3.5084461e-01 1.32e-06 2.58e-02 -3.8 2.94e-05 - 1.00e+00 1.00e+00h 1
147 -3.5092513e-01 1.53e-13 3.14e-02 -3.8 1.48e-05 - 1.00e+00 1.00e+00H 1
148 -3.5083394e-01 2.32e-14 2.33e-02 -3.8 2.45e-05 - 1.00e+00 1.00e+00H 1
149 -3.5089202e-01 1.05e-05 7.10e-02 -3.8 1.80e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
150 -3.5091483e-01 5.26e-06 4.98e-02 -3.8 1.29e-05 - 1.00e+00 5.00e-01h 2
151 -3.5085986e-01 4.65e-08 4.85e-02 -3.8 8.17e-06 - 1.00e+00 1.00e+00h 1
152 -3.5096192e-01 2.48e-06 4.85e-02 -3.8 1.32e-05 - 1.00e+00 1.00e+00h 1
153 -3.5075217e-01 9.43e-08 4.43e-02 -3.8 3.09e-05 - 1.00e+00 1.00e+00h 1
154 -3.5086559e-01 2.04e-06 3.25e-02 -3.8 1.96e-05 - 1.00e+00 1.00e+00h 1
155 -3.5081660e-01 9.20e-07 4.29e-02 -3.8 2.46e-05 - 1.00e+00 5.00e-01h 2
156 -3.5097606e-01 3.90e-06 4.45e-02 -3.8 2.53e-05 - 1.00e+00 1.00e+00h 1
157 -3.5086883e-01 1.74e-06 3.95e-02 -3.8 3.17e-05 - 1.00e+00 5.00e-01h 2
158 -3.5086101e-01 1.33e-06 3.54e-02 -3.8 1.10e-05 - 1.00e+00 2.50e-01h 3
159 -3.5080744e-01 5.91e-07 4.27e-02 -3.8 1.73e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
160 -3.5090421e-01 2.28e-13 3.43e-02 -3.8 1.83e-05 - 1.00e+00 1.00e+00H 1
161 -3.5080349e-01 1.65e-14 5.74e-02 -3.8 2.41e-05 - 1.00e+00 1.00e+00H 1
162 -3.5082707e-01 1.65e-06 5.74e-02 -3.8 7.25e-06 - 1.00e+00 1.00e+00h 1
163 -3.5076000e-01 7.45e-09 3.32e-02 -3.8 9.96e-06 - 1.00e+00 1.00e+00h 1
164 -3.5082169e-01 5.54e-14 2.36e-02 -3.8 1.49e-05 - 1.00e+00 1.00e+00H 1
165 -3.5079785e-01 2.94e-15 7.05e-02 -3.8 7.09e-06 - 1.00e+00 1.00e+00H 1
166 -3.5106309e-01 3.28e-05 6.48e-02 -3.8 3.54e-05 - 1.00e+00 1.00e+00H 1
167 -3.5095704e-01 1.64e-05 1.88e-02 -3.8 3.12e-05 - 1.00e+00 5.00e-01h 2
168 -3.5090140e-01 8.19e-06 2.57e-02 -3.8 1.66e-05 - 1.00e+00 5.00e-01h 2
169 -3.5089226e-01 4.10e-06 2.83e-02 -3.8 8.64e-06 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
170 -3.5090605e-01 2.05e-06 3.14e-02 -3.8 5.61e-06 - 1.00e+00 5.00e-01h 2
171 -3.5077949e-01 3.87e-07 4.54e-02 -3.8 2.08e-05 - 1.00e+00 1.00e+00h 1
172 -3.5102589e-01 6.07e-06 3.49e-02 -3.8 3.61e-05 - 1.00e+00 1.00e+00h 1
173 -3.5094400e-01 2.45e-06 3.94e-02 -3.8 2.12e-05 - 1.00e+00 5.00e-01h 2
174 -3.5087384e-01 8.52e-07 2.00e-02 -3.8 2.17e-05 - 1.00e+00 5.00e-01h 2
175 -3.5083694e-01 7.29e-08 3.17e-02 -3.8 1.20e-05 - 1.00e+00 1.00e+00h 1
176 -3.5074502e-01 1.45e-08 4.69e-02 -3.8 1.70e-05 - 1.00e+00 1.00e+00h 1
177 -3.5087590e-01 2.46e-06 3.42e-02 -3.8 2.42e-05 - 1.00e+00 1.00e+00h 1
178 -3.5084147e-01 1.07e-06 2.93e-02 -3.8 1.61e-05 - 1.00e+00 5.00e-01h 2
179 -3.5083073e-01 5.29e-07 8.75e-02 -3.8 1.25e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
180 -3.5104468e-01 7.77e-06 8.75e-02 -3.8 4.19e-05 - 1.00e+00 1.00e+00h 1
181 -3.5074937e-01 1.29e-08 4.18e-02 -3.8 4.77e-05 - 1.00e+00 1.00e+00h 1
182 -3.5081757e-01 9.02e-07 6.77e-02 -3.8 1.00e-05 - 1.00e+00 1.00e+00h 1
183 -3.5103284e-01 6.95e-06 3.05e-02 -3.8 3.35e-05 - 1.00e+00 1.00e+00h 1
184 -3.5099443e-01 4.88e-06 6.52e-02 -3.8 2.28e-05 - 1.00e+00 2.50e-01h 3
185 -3.5098983e-01 4.45e-06 4.65e-02 -3.8 1.37e-05 - 1.00e+00 1.25e-01h 4
186 -3.5093747e-01 2.39e-06 5.23e-02 -3.8 1.25e-05 - 1.00e+00 5.00e-01h 2
187 -3.5106760e-01 8.66e-13 7.98e-02 -3.8 2.25e-05 - 1.00e+00 1.00e+00H 1
188 -3.5076700e-01 5.92e-15 6.26e-02 -3.8 5.27e-05 - 1.00e+00 1.00e+00H 1
189 -3.5107899e-01 9.20e-06 3.20e-02 -3.8 4.81e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
190 -3.5108252e-01 8.74e-06 8.34e-02 -3.8 1.81e-05 - 1.00e+00 6.25e-02h 5
191 -3.5094884e-01 3.81e-06 8.81e-02 -3.8 4.36e-05 - 1.00e+00 5.00e-01h 2
192 -3.5095078e-01 3.74e-06 9.67e-02 -3.8 1.31e-05 - 1.00e+00 6.25e-02h 5
193 -3.5074551e-01 5.64e-09 6.97e-02 -3.8 3.31e-05 - 1.00e+00 1.00e+00h 1
194 -3.5107507e-01 9.88e-06 5.72e-02 -3.8 5.62e-05 - 1.00e+00 1.00e+00h 1
195 -3.5093300e-01 4.54e-06 2.43e-02 -3.8 5.39e-05 - 1.00e+00 5.00e-01h 2
196 -3.5085657e-01 2.04e-06 7.09e-02 -3.8 2.67e-05 - 1.00e+00 5.00e-01h 2
197 -3.5095476e-01 2.75e-13 7.34e-02 -3.8 1.60e-05 - 1.00e+00 1.00e+00H 1
198 -3.5077606e-01 1.15e-15 6.70e-02 -3.8 3.06e-05 - 1.00e+00 1.00e+00H 1
199 -3.5103501e-01 6.97e-06 8.52e-02 -3.8 3.69e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
200 -3.5103958e-01 6.08e-06 8.52e-02 -3.8 1.85e-05 - 1.00e+00 2.50e-01h 3
201 -3.5089734e-01 2.90e-06 3.77e-02 -3.8 4.04e-05 - 1.00e+00 5.00e-01h 2
202 -3.5088332e-01 1.97e-06 4.35e-02 -3.8 1.55e-05 - 1.00e+00 5.00e-01h 2
203 -3.5081951e-01 9.14e-07 1.05e-02 -3.8 2.15e-05 - 1.00e+00 5.00e-01h 2
204 -3.5076469e-01 7.12e-08 7.73e-02 -3.8 9.75e-06 - 1.00e+00 1.00e+00h 1
205 -3.5099815e-01 6.20e-06 8.82e-02 -3.8 3.68e-05 - 1.00e+00 1.00e+00h 1
206 -3.5088512e-01 2.91e-06 1.57e-02 -3.8 3.58e-05 - 1.00e+00 5.00e-01h 2
207 -3.5082094e-01 1.37e-06 8.12e-02 -3.8 2.05e-05 - 1.00e+00 5.00e-01h 2
208 -3.5107803e-01 1.28e-12 6.91e-02 -3.8 4.07e-05 - 1.00e+00 1.00e+00H 1
209 -3.5082529e-01 3.18e-14 2.50e-02 -3.8 3.93e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
210 -3.5077668e-01 1.80e-07 4.50e-02 -3.8 1.24e-05 - 1.00e+00 1.00e+00h 1
211 -3.5088650e-01 2.48e-06 2.08e-02 -3.8 3.45e-05 - 1.00e+00 1.00e+00h 1
212 -3.5088590e-01 2.41e-06 2.44e-02 -3.8 4.39e-06 - 1.00e+00 3.12e-02h 6
213 -3.5088522e-01 2.39e-06 1.54e-02 -3.8 2.36e-05 - 1.00e+00 7.81e-03h 8
214 -3.5074564e-01 6.36e-08 7.33e-02 -3.8 3.99e-05 - 1.00e+00 1.00e+00h 1
215 -3.5087544e-01 2.65e-13 7.12e-02 -3.8 2.62e-05 - 1.00e+00 1.00e+00H 1
216 -3.5080106e-01 5.39e-15 1.94e-02 -3.8 1.54e-05 - 1.00e+00 1.00e+00H 1
217 -3.5079041e-01 5.75e-08 3.05e-02 -3.8 7.77e-06 - 1.00e+00 1.00e+00h 1
218 -3.5094068e-01 3.03e-13 5.61e-02 -3.8 2.40e-05 - 1.00e+00 1.00e+00H 1
219 -3.5086479e-01 6.63e-14 5.61e-02 -3.8 2.95e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
220 -3.5075814e-01 1.51e-08 4.18e-02 -3.8 1.57e-05 - 1.00e+00 1.00e+00h 1
221 -3.5083334e-01 8.75e-14 4.47e-02 -3.8 1.84e-05 - 1.00e+00 1.00e+00H 1
222 -3.5076149e-01 1.10e-08 9.15e-02 -3.8 2.10e-05 - 1.00e+00 1.00e+00h 1
223 -3.5104414e-01 8.27e-06 9.15e-02 -3.8 4.45e-05 - 1.00e+00 1.00e+00h 1
224 -3.5098706e-01 4.64e-06 8.94e-02 -3.8 1.66e-05 - 1.00e+00 5.00e-01h 2
225 -3.5098997e-01 4.50e-06 3.08e-02 -3.8 1.24e-05 - 1.00e+00 6.25e-02h 5
226 -3.5098900e-01 4.44e-06 4.64e-02 -3.8 5.61e-06 - 1.00e+00 1.56e-02h 7
227 -3.5098633e-01 4.36e-06 3.60e-02 -3.8 2.43e-05 - 1.00e+00 1.56e-02h 7
228 -3.5088990e-01 5.47e-07 6.24e-02 -3.8 1.43e-05 - 1.00e+00 1.00e+00h 1
229 -3.5093009e-01 2.54e-06 6.24e-02 -3.8 7.87e-06 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
230 -3.5080798e-01 1.61e-07 2.60e-02 -3.8 1.82e-05 - 1.00e+00 1.00e+00h 1
231 -3.5074134e-01 7.98e-10 3.18e-02 -3.8 1.37e-05 - 1.00e+00 1.00e+00h 1
232 -3.5083990e-01 1.56e-06 3.18e-02 -3.8 1.90e-05 - 1.00e+00 1.00e+00h 1
233 -3.5079643e-01 7.76e-07 3.21e-02 -3.8 1.84e-05 - 1.00e+00 5.00e-01h 2
234 -3.5090529e-01 1.98e-13 9.19e-02 -3.8 1.80e-05 - 1.00e+00 1.00e+00H 1
235 -3.5123070e-01 1.07e-05 1.09e-01 -3.8 5.04e-05 - 1.00e+00 1.00e+00h 1
236 -3.5106135e-01 5.20e-06 6.28e-02 -3.8 4.99e-05 - 1.00e+00 5.00e-01h 2
237 -3.5105679e-01 4.10e-06 6.29e-02 -3.8 7.89e-06 - 1.00e+00 2.50e-01h 3
238 -3.5106065e-01 3.88e-06 5.29e-02 -3.8 1.25e-05 - 1.00e+00 1.25e-01h 4
239 -3.5105279e-01 3.73e-06 4.83e-02 -3.8 3.73e-05 - 1.00e+00 3.12e-02h 6
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
240 -3.5092851e-01 8.24e-08 4.84e-02 -3.8 1.95e-05 - 1.00e+00 1.00e+00h 1
241 -3.5084786e-01 3.72e-07 3.75e-02 -3.8 1.16e-05 - 1.00e+00 1.00e+00h 1
242 -3.5078668e-01 2.92e-07 4.31e-02 -3.8 2.72e-05 - 1.00e+00 1.00e+00h 1
243 -3.5075523e-01 2.85e-08 1.06e-01 -3.8 6.95e-06 - 1.00e+00 1.00e+00h 1
244 -3.5113498e-01 1.19e-05 1.08e-01 -3.8 6.01e-05 - 1.00e+00 1.00e+00h 1
245 -3.5106362e-01 6.32e-06 9.33e-02 -3.8 3.08e-05 - 1.00e+00 5.00e-01h 2
246 -3.5107093e-01 5.62e-06 3.89e-02 -3.8 9.88e-06 - 1.00e+00 2.50e-01h 3
247 -3.5106192e-01 4.88e-06 4.94e-02 -3.8 1.06e-05 - 1.00e+00 1.25e-01h 4
248 -3.5093194e-01 2.20e-06 2.40e-02 -3.8 3.89e-05 - 1.00e+00 5.00e-01h 2
249 -3.5078726e-01 5.09e-07 4.81e-02 -3.8 2.21e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
250 -3.5095352e-01 3.64e-06 5.42e-02 -3.8 2.81e-05 - 1.00e+00 1.00e+00h 1
251 -3.5087651e-01 1.40e-06 3.51e-02 -3.8 2.34e-05 - 1.00e+00 5.00e-01h 2
252 -3.5086093e-01 2.25e-07 2.68e-02 -3.8 4.40e-06 - 1.00e+00 1.00e+00h 1
253 -3.5085453e-01 2.68e-07 3.87e-02 -3.8 1.80e-05 - 1.00e+00 1.00e+00h 1
254 -3.5081972e-01 4.69e-07 2.96e-02 -3.8 6.45e-06 - 1.00e+00 1.00e+00h 1
255 -3.5089295e-01 1.71e-13 2.70e-02 -3.8 1.49e-05 - 1.00e+00 1.00e+00H 1
256 -3.5083466e-01 1.48e-14 4.39e-02 -3.8 1.27e-05 - 1.00e+00 1.00e+00H 1
257 -3.5076686e-01 1.64e-07 1.80e-02 -3.8 2.94e-05 - 1.00e+00 1.00e+00h 1
258 -3.5080080e-01 4.82e-07 5.43e-02 -3.8 7.57e-06 - 1.00e+00 1.00e+00h 1
259 -3.5102519e-01 4.43e-06 3.23e-02 -3.8 3.57e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
260 -3.5098190e-01 3.16e-06 5.87e-02 -3.8 2.40e-05 - 1.00e+00 2.50e-01h 3
261 -3.5088996e-01 1.43e-06 2.17e-02 -3.8 2.72e-05 - 1.00e+00 5.00e-01h 2
262 -3.5086757e-01 9.83e-07 2.12e-02 -3.8 1.45e-05 - 1.00e+00 2.50e-01h 3
263 -3.5075642e-01 1.47e-07 2.75e-02 -3.8 2.77e-05 - 1.00e+00 1.00e+00h 1
264 -3.5078184e-01 3.93e-07 2.88e-02 -3.8 8.94e-06 - 1.00e+00 1.00e+00h 1
265 -3.5076016e-01 2.06e-07 2.64e-02 -3.8 5.16e-06 - 1.00e+00 1.00e+00h 1
266 -3.5076982e-01 2.79e-07 4.40e-02 -3.8 5.84e-06 - 1.00e+00 1.00e+00h 1
267 -3.5088828e-01 3.11e-06 4.64e-02 -3.8 3.03e-05 - 1.00e+00 1.00e+00h 1
268 -3.5106203e-01 7.45e-13 5.87e-02 -3.8 2.72e-05 - 1.00e+00 1.00e+00H 1
269 -3.5082921e-01 4.19e-14 5.63e-02 -3.8 3.83e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
270 -3.5090853e-01 1.26e-05 4.80e-02 -3.8 1.29e-05 - 1.00e+00 1.00e+00H 1
271 -3.5101438e-01 6.29e-06 7.72e-02 -3.8 2.92e-05 - 1.00e+00 5.00e-01h 2
272 -3.5092302e-01 3.14e-06 1.85e-02 -3.8 2.85e-05 - 1.00e+00 5.00e-01h 2
273 -3.5084818e-01 1.57e-06 9.23e-02 -3.8 2.47e-05 - 1.00e+00 5.00e-01h 2
274 -3.5114773e-01 2.13e-12 3.50e-02 -3.8 4.62e-05 - 1.00e+00 1.00e+00H 1
275 -3.5105540e-01 2.61e-13 8.56e-02 -3.8 1.27e-05 - 1.00e+00 1.00e+00H 1
276 -3.5083610e-01 3.97e-14 5.43e-02 -3.8 3.70e-05 - 1.00e+00 1.00e+00H 1
277 -3.5095813e-01 1.80e-05 3.56e-02 -3.8 1.56e-05 - 1.00e+00 1.00e+00H 1
278 -3.5101487e-01 8.99e-06 7.85e-02 -3.8 1.54e-05 - 1.00e+00 5.00e-01h 2
279 -3.5089316e-01 4.50e-06 4.13e-02 -3.8 4.05e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
280 -3.5082972e-01 4.26e-08 4.36e-02 -3.8 9.32e-06 - 1.00e+00 1.00e+00h 1
281 -3.5094767e-01 3.79e-13 4.53e-02 -3.8 1.89e-05 - 1.00e+00 1.00e+00H 1
282 -3.5085560e-01 4.63e-14 3.93e-02 -3.8 1.57e-05 - 1.00e+00 1.00e+00H 1
283 -3.5074539e-01 1.11e-08 3.27e-02 -3.8 2.05e-05 - 1.00e+00 1.00e+00h 1
284 -3.5089236e-01 2.20e-13 4.74e-02 -3.8 3.43e-05 - 1.00e+00 1.00e+00H 1
285 -3.5090421e-01 1.11e-13 4.74e-02 -3.8 1.82e-05 - 1.00e+00 1.00e+00H 1
286 -3.5077128e-01 4.41e-16 4.19e-02 -3.8 2.25e-05 - 1.00e+00 1.00e+00H 1
287 -3.5093930e-01 3.52e-06 4.27e-02 -3.8 2.88e-05 - 1.00e+00 1.00e+00h 1
288 -3.5085598e-01 1.52e-06 3.74e-02 -3.8 2.43e-05 - 1.00e+00 5.00e-01h 2
289 -3.5086767e-01 1.27e-06 5.47e-02 -3.8 1.03e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
290 -3.5089437e-01 1.04e-13 9.35e-02 -3.8 7.53e-06 - 1.00e+00 1.00e+00H 1
291 -3.5116747e-01 2.61e-05 4.09e-02 -3.8 3.98e-05 - 1.00e+00 1.00e+00H 1
292 -3.5107485e-01 1.30e-05 5.08e-02 -3.8 2.60e-05 - 1.00e+00 5.00e-01h 2
293 -3.5095234e-01 6.51e-06 4.22e-02 -3.8 4.03e-05 - 1.00e+00 5.00e-01h 2
294 -3.5088452e-01 3.26e-06 2.09e-02 -3.8 2.33e-05 - 1.00e+00 5.00e-01h 2
295 -3.5083596e-01 1.63e-06 1.38e-02 -3.8 1.67e-05 - 1.00e+00 5.00e-01h 2
296 -3.5079186e-01 3.11e-07 6.50e-02 -3.8 1.52e-05 - 1.00e+00 1.00e+00h 1
297 -3.5108325e-01 7.38e-06 7.66e-02 -3.8 4.17e-05 - 1.00e+00 1.00e+00h 1
298 -3.5109313e-01 6.33e-06 1.01e-01 -3.8 1.08e-05 - 1.00e+00 5.00e-01h 2
299 -3.5111409e-01 6.29e-06 1.01e-01 -3.8 1.86e-05 - 1.00e+00 2.50e-01h 3
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
300 -3.5098788e-01 1.47e-07 6.29e-02 -3.8 2.05e-05 - 1.00e+00 1.00e+00h 1
301 -3.5082951e-01 2.75e-07 5.37e-02 -3.8 2.35e-05 - 1.00e+00 1.00e+00h 1
302 -3.5097861e-01 4.76e-13 9.94e-02 -3.8 1.84e-05 - 1.00e+00 1.00e+00H 1
303 -3.5100719e-01 4.68e-13 2.54e-02 -3.8 1.77e-05 - 1.00e+00 1.00e+00H 1
304 -3.5093385e-01 4.56e-14 9.03e-02 -3.8 1.26e-05 - 1.00e+00 1.00e+00H 1
305 -3.5075421e-01 8.10e-08 9.58e-02 -3.8 3.43e-05 - 1.00e+00 1.00e+00h 1
306 -3.5113403e-01 1.23e-05 4.11e-02 -3.8 5.95e-05 - 1.00e+00 1.00e+00h 1
307 -3.5109616e-01 8.53e-06 5.51e-02 -3.8 2.09e-05 - 1.00e+00 2.50e-01h 3
308 -3.5077064e-01 2.25e-07 3.99e-02 -3.8 4.93e-05 - 1.00e+00 1.00e+00h 1
309 -3.5090368e-01 2.45e-13 3.92e-02 -3.8 2.15e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
310 -3.5076057e-01 7.97e-16 7.88e-02 -3.8 2.30e-05 - 1.00e+00 1.00e+00H 1
311 -3.5097796e-01 5.37e-06 3.07e-02 -3.8 3.25e-05 - 1.00e+00 1.00e+00h 1
312 -3.5098420e-01 4.96e-06 4.02e-02 -3.8 1.49e-05 - 1.00e+00 1.25e-01h 4
313 -3.5096149e-01 7.80e-08 4.67e-02 -3.8 1.30e-05 - 1.00e+00 1.00e+00h 1
314 -3.5081994e-01 2.53e-14 5.41e-02 -3.8 2.22e-05 - 1.00e+00 1.00e+00H 1
315 -3.5096471e-01 2.58e-05 4.27e-02 -3.8 2.32e-05 - 1.00e+00 1.00e+00H 1
316 -3.5093622e-01 1.29e-05 3.27e-02 -3.8 1.15e-05 - 1.00e+00 5.00e-01h 2
317 -3.5085968e-01 6.46e-06 2.30e-02 -3.8 2.67e-05 - 1.00e+00 5.00e-01h 2
318 -3.5074718e-01 8.37e-08 5.46e-02 -3.8 2.20e-05 - 1.00e+00 1.00e+00h 1
319 -3.5095537e-01 4.56e-06 5.46e-02 -3.8 3.04e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
320 -3.5093167e-01 3.55e-06 3.94e-02 -3.8 1.57e-05 - 1.00e+00 2.50e-01h 3
321 -3.5085763e-01 1.61e-06 1.00e-01 -3.8 2.08e-05 - 1.00e+00 5.00e-01h 2
322 -3.5118742e-01 2.90e-12 6.04e-02 -3.8 5.11e-05 - 1.00e+00 1.00e+00H 1
323 -3.5088949e-01 1.70e-13 4.77e-02 -3.8 4.56e-05 - 1.00e+00 1.00e+00H 1
324 -3.5074788e-01 3.08e-08 4.53e-02 -3.8 2.77e-05 - 1.00e+00 1.00e+00h 1
325 -3.5087773e-01 3.41e-06 2.64e-02 -3.8 3.91e-05 - 1.00e+00 1.00e+00h 1
326 -3.5087878e-01 3.23e-06 4.07e-02 -3.8 1.24e-05 - 1.00e+00 6.25e-02h 5
327 -3.5081620e-01 1.48e-06 7.10e-02 -3.8 3.06e-05 - 1.00e+00 5.00e-01h 2
328 -3.5100585e-01 7.11e-13 8.90e-02 -3.8 2.46e-05 - 1.00e+00 1.00e+00H 1
329 -3.5095650e-01 3.63e-13 4.91e-02 -3.8 1.89e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
330 -3.5084609e-01 5.82e-14 7.00e-02 -3.8 1.88e-05 - 1.00e+00 1.00e+00H 1
331 -3.5093307e-01 1.25e-05 4.42e-02 -3.8 1.67e-05 - 1.00e+00 1.00e+00H 1
332 -3.5085780e-01 6.24e-06 2.51e-02 -3.8 2.28e-05 - 1.00e+00 5.00e-01h 2
333 -3.5085376e-01 3.12e-06 6.25e-02 -3.8 2.83e-06 - 1.00e+00 5.00e-01h 2
334 -3.5101161e-01 6.99e-13 2.19e-02 -3.8 2.59e-05 - 1.00e+00 1.00e+00H 1
335 -3.5099417e-01 2.25e-08 6.28e-02 -3.8 9.93e-06 - 1.00e+00 1.00e+00h 1
336 -3.5078461e-01 6.57e-15 1.75e-02 -3.8 3.55e-05 - 1.00e+00 1.00e+00H 1
337 -3.5074758e-01 1.11e-08 9.45e-02 -3.8 1.38e-05 - 1.00e+00 1.00e+00h 1
338 -3.5100240e-01 1.04e-12 7.40e-02 -3.8 3.97e-05 - 1.00e+00 1.00e+00H 1
339 -3.5082148e-01 4.73e-14 2.52e-02 -3.8 2.86e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
340 -3.5090216e-01 1.35e-05 4.56e-02 -3.8 1.39e-05 - 1.00e+00 1.00e+00H 1
341 -3.5082958e-01 6.73e-06 7.87e-03 -3.8 2.61e-05 - 1.00e+00 5.00e-01h 2
342 -3.5079210e-01 3.37e-06 2.57e-02 -3.8 1.41e-05 - 1.00e+00 5.00e-01h 2
343 -3.5079070e-01 1.68e-06 7.99e-02 -3.8 6.19e-06 - 1.00e+00 5.00e-01h 2
344 -3.5100916e-01 9.39e-13 5.83e-02 -3.8 3.53e-05 - 1.00e+00 1.00e+00H 1
345 -3.5079112e-01 1.01e-14 2.94e-02 -3.8 3.66e-05 - 1.00e+00 1.00e+00H 1
346 -3.5074112e-01 5.25e-10 6.44e-02 -3.8 1.07e-05 - 1.00e+00 1.00e+00h 1
347 -3.5092294e-01 3.97e-13 4.29e-02 -3.8 2.87e-05 - 1.00e+00 1.00e+00H 1
348 -3.5081081e-01 1.72e-14 2.82e-02 -3.8 1.90e-05 - 1.00e+00 1.00e+00H 1
349 -3.5089306e-01 1.28e-06 5.35e-02 -3.8 1.40e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
350 -3.5101526e-01 6.67e-13 6.96e-02 -3.8 2.20e-05 - 1.00e+00 1.00e+00H 1
351 -3.5077644e-01 2.23e-15 1.64e-02 -3.8 4.16e-05 - 1.00e+00 1.00e+00H 1
352 -3.5082563e-01 8.50e-06 3.06e-02 -3.8 1.25e-05 - 1.00e+00 1.00e+00H 1
353 -3.5085473e-01 4.25e-06 4.90e-02 -3.8 7.52e-06 - 1.00e+00 5.00e-01h 2
354 -3.5087065e-01 3.19e-06 4.53e-02 -3.8 1.40e-05 - 1.00e+00 2.50e-01h 3
355 -3.5081544e-01 1.59e-06 3.72e-02 -3.8 1.89e-05 - 1.00e+00 5.00e-01h 2
356 -3.5084426e-01 9.81e-07 6.05e-02 -3.8 1.01e-05 - 1.00e+00 1.00e+00h 1
357 -3.5101910e-01 5.70e-13 7.22e-02 -3.8 2.44e-05 - 1.00e+00 1.00e+00H 1
358 -3.5077522e-01 6.06e-16 1.24e-02 -3.8 3.82e-05 - 1.00e+00 1.00e+00H 1
359 -3.5074666e-01 1.11e-16 7.69e-02 -3.8 6.22e-06 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
360 -3.5103386e-01 3.31e-05 7.69e-02 -3.8 3.85e-05 - 1.00e+00 1.00e+00H 1
361 -3.5095173e-01 1.65e-05 2.82e-02 -3.8 2.43e-05 - 1.00e+00 5.00e-01h 2
362 -3.5096766e-01 8.27e-06 4.26e-02 -3.8 1.01e-05 - 1.00e+00 5.00e-01h 2
363 -3.5101990e-01 6.21e-06 5.62e-02 -3.8 3.11e-05 - 1.00e+00 2.50e-01h 3
364 -3.5100768e-01 5.82e-06 5.54e-02 -3.8 2.80e-05 - 1.00e+00 6.25e-02h 5
365 -3.5077075e-01 4.65e-07 9.88e-02 -3.8 3.65e-05 - 1.00e+00 1.00e+00h 1
366 -3.5114114e-01 2.38e-12 4.88e-02 -3.8 5.68e-05 - 1.00e+00 1.00e+00H 1
367 -3.5087724e-01 1.17e-13 4.37e-02 -3.8 3.95e-05 - 1.00e+00 1.00e+00H 1
368 -3.5082163e-01 2.27e-07 6.25e-02 -3.8 2.43e-05 - 1.00e+00 1.00e+00h 1
369 -3.5087904e-01 2.26e-06 8.02e-02 -3.8 2.36e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
370 -3.5081100e-01 1.58e-09 7.58e-02 -3.8 1.99e-05 - 1.00e+00 1.00e+00h 1
371 -3.5103366e-01 6.33e-06 7.58e-02 -3.8 3.53e-05 - 1.00e+00 1.00e+00h 1
372 -3.5074983e-01 1.49e-08 3.04e-02 -3.8 4.48e-05 - 1.00e+00 1.00e+00h 1
373 -3.5082972e-01 1.12e-06 2.55e-02 -3.8 1.29e-05 - 1.00e+00 1.00e+00h 1
374 -3.5080259e-01 5.39e-07 1.74e-02 -3.8 1.51e-05 - 1.00e+00 5.00e-01h 2
375 -3.5077722e-01 2.49e-07 8.73e-02 -3.8 9.20e-06 - 1.00e+00 5.00e-01h 2
376 -3.5098987e-01 6.46e-06 8.52e-02 -3.8 3.98e-05 - 1.00e+00 1.00e+00h 1
377 -3.5088445e-01 3.15e-06 4.33e-02 -3.8 3.65e-05 - 1.00e+00 5.00e-01h 2
378 -3.5083613e-01 1.61e-06 6.00e-02 -3.8 2.07e-05 - 1.00e+00 5.00e-01h 2
379 -3.5109763e-01 1.32e-12 5.08e-02 -3.8 3.81e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
380 -3.5097276e-01 1.18e-13 4.41e-02 -3.8 1.50e-05 - 1.00e+00 1.00e+00H 1
381 -3.5086075e-01 6.20e-14 3.37e-02 -3.8 1.96e-05 - 1.00e+00 1.00e+00H 1
382 -3.5082875e-01 7.32e-15 7.16e-02 -3.8 2.16e-05 - 1.00e+00 1.00e+00H 1
383 -3.5079432e-01 6.22e-15 1.01e-01 -3.8 1.19e-05 - 1.00e+00 1.00e+00H 1
384 -3.5114334e-01 3.84e-05 3.89e-02 -3.8 5.10e-05 - 1.00e+00 1.00e+00H 1
385 -3.5100930e-01 1.92e-05 6.35e-02 -3.8 4.23e-05 - 1.00e+00 5.00e-01h 2
386 -3.5098342e-01 9.61e-06 9.68e-02 -3.8 1.91e-05 - 1.00e+00 5.00e-01h 2
387 -3.5103870e-01 4.80e-06 8.03e-02 -3.8 1.51e-05 - 1.00e+00 5.00e-01h 2
388 -3.5091587e-01 2.40e-06 6.16e-02 -3.8 3.82e-05 - 1.00e+00 5.00e-01h 2
389 -3.5098977e-01 3.03e-06 4.00e-02 -3.8 1.31e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
390 -3.5113095e-01 6.81e-13 6.46e-02 -3.8 2.05e-05 - 1.00e+00 1.00e+00H 1
391 -3.5086305e-01 8.17e-07 4.27e-02 -3.8 4.39e-05 - 1.00e+00 1.00e+00h 1
392 -3.5103831e-01 8.03e-13 4.25e-02 -3.8 2.74e-05 - 1.00e+00 1.00e+00H 1
393 -3.5089591e-01 1.01e-13 6.89e-02 -3.8 1.97e-05 - 1.00e+00 1.00e+00H 1
394 -3.5095246e-01 2.64e-06 6.89e-02 -3.8 1.46e-05 - 1.00e+00 5.00e-01h 2
395 -3.5083918e-01 6.08e-07 2.21e-02 -3.8 2.49e-05 - 1.00e+00 1.00e+00h 1
396 -3.5081856e-01 1.14e-07 6.79e-02 -3.8 8.26e-06 - 1.00e+00 1.00e+00h 1
397 -3.5088027e-01 2.84e-06 2.95e-02 -3.8 8.21e-06 - 1.00e+00 1.00e+00h 1
398 -3.5093240e-01 2.26e-06 4.56e-02 -3.8 2.14e-05 - 1.00e+00 5.00e-01h 2
399 -3.5076383e-01 1.62e-07 5.01e-02 -3.8 2.34e-05 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
400 -3.5090105e-01 2.86e-06 5.05e-02 -3.8 2.01e-05 - 1.00e+00 1.00e+00h 1
401 -3.5078477e-01 2.26e-08 3.41e-02 -3.8 1.75e-05 - 1.00e+00 1.00e+00h 1
402 -3.5081409e-01 1.03e-06 3.10e-02 -3.8 2.18e-05 - 1.00e+00 1.00e+00h 1
403 -3.5074223e-01 2.15e-09 1.91e-02 -3.8 2.74e-05 - 1.00e+00 1.00e+00h 1
404 -3.5078672e-01 5.17e-07 3.85e-02 -3.8 1.49e-05 - 1.00e+00 1.00e+00h 1
405 -3.5091298e-01 2.35e-06 5.05e-02 -3.8 1.87e-05 - 1.00e+00 1.00e+00h 1
406 -3.5084679e-01 1.58e-06 5.05e-02 -3.8 1.58e-05 - 1.00e+00 1.00e+00h 1
407 -3.5075478e-01 6.84e-08 2.42e-02 -3.8 1.39e-05 - 1.00e+00 1.00e+00h 1
408 -3.5084012e-01 1.07e-06 3.63e-02 -3.8 1.76e-05 - 1.00e+00 1.00e+00h 1
409 -3.5084130e-01 9.62e-07 4.30e-02 -3.8 7.61e-06 - 1.00e+00 2.50e-01h 3
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
410 -3.5080277e-01 4.68e-07 2.96e-02 -3.8 1.55e-05 - 1.00e+00 5.00e-01h 2
411 -3.5093146e-01 2.24e-13 5.34e-02 -3.8 1.95e-05 - 1.00e+00 1.00e+00H 1
412 -3.5089527e-01 9.11e-14 3.98e-02 -3.8 5.03e-06 - 1.00e+00 1.00e+00H 1
413 -3.5089915e-01 1.49e-14 3.59e-02 -3.8 1.06e-05 - 1.00e+00 1.00e+00H 1
414 -3.5089916e-01 1.79e-09 3.21e-02 -3.8 4.48e-06 - 1.00e+00 3.91e-03h 9
415 -3.5085065e-01 1.56e-14 2.55e-02 -3.8 2.01e-05 - 1.00e+00 1.00e+00H 1
416 -3.5077668e-01 1.26e-15 1.47e-02 -3.8 1.14e-05 - 1.00e+00 1.00e+00H 1
417 -3.5078293e-01 1.99e-06 5.36e-02 -3.8 2.60e-06 - 1.00e+00 1.00e+00H 1
418 -3.5102334e-01 8.43e-13 5.36e-02 -3.8 3.49e-05 - 1.00e+00 1.00e+00H 1
419 -3.5084000e-01 1.87e-14 4.86e-02 -3.8 2.84e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
420 -3.5075068e-01 1.11e-16 1.42e-02 -3.8 1.55e-05 - 1.00e+00 1.00e+00H 1
421 -3.5075971e-01 2.19e-06 6.69e-02 -3.8 2.78e-06 - 1.00e+00 1.00e+00H 1
422 -3.5083674e-01 1.99e-06 6.53e-02 -3.8 1.78e-05 - 1.00e+00 1.00e+00h 1
423 -3.5079578e-01 9.91e-07 1.05e-01 -3.8 2.29e-05 - 1.00e+00 5.00e-01h 2
424 -3.5121399e-01 3.21e-12 1.05e-01 -3.8 6.01e-05 - 1.00e+00 1.00e+00H 1
425 -3.5108398e-01 4.56e-13 1.00e-01 -3.8 2.15e-05 - 1.00e+00 1.00e+00H 1
426 -3.5078545e-01 5.06e-16 1.86e-02 -3.8 5.18e-05 - 1.00e+00 1.00e+00H 1
427 -3.5074393e-01 1.43e-08 4.94e-02 -3.8 9.42e-06 - 1.00e+00 1.00e+00h 1
428 -3.5092719e-01 3.56e-06 5.06e-02 -3.8 3.56e-05 - 1.00e+00 1.00e+00h 1
429 -3.5083835e-01 1.75e-06 8.89e-02 -3.8 3.12e-05 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
430 -3.5108078e-01 9.96e-13 4.27e-02 -3.8 3.28e-05 - 1.00e+00 1.00e+00H 1
431 -3.5105996e-01 3.07e-13 2.48e-02 -3.8 2.76e-05 - 1.00e+00 1.00e+00H 1
432 -3.5100962e-01 9.30e-14 4.71e-02 -3.8 9.91e-06 - 1.00e+00 1.00e+00H 1
433 -3.5088197e-01 9.69e-14 3.54e-02 -3.8 2.14e-05 - 1.00e+00 1.00e+00H 1
434 -3.5074685e-01 1.53e-09 3.35e-02 -3.8 2.56e-05 - 1.00e+00 1.00e+00h 1
435 -3.5085935e-01 1.69e-06 5.33e-02 -3.8 2.00e-05 - 1.00e+00 1.00e+00h 1
436 -3.5094771e-01 2.81e-13 6.11e-02 -3.8 1.59e-05 - 1.00e+00 1.00e+00H 1
437 -3.5082610e-01 3.02e-14 6.16e-02 -3.8 1.98e-05 - 1.00e+00 1.00e+00H 1
438 -3.5082613e-01 1.18e-09 7.27e-02 -3.8 1.35e-05 - 1.00e+00 4.88e-04h 12
439 -3.5079167e-01 2.07e-15 3.36e-02 -3.8 6.37e-06 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
440 -3.5081921e-01 2.17e-06 6.39e-02 -3.8 9.66e-06 - 1.00e+00 1.00e+00H 1
441 -3.5107227e-01 1.44e-12 4.70e-02 -3.8 4.06e-05 - 1.00e+00 1.00e+00H 1
442 -3.5093676e-01 1.51e-13 4.68e-02 -3.8 2.05e-05 - 1.00e+00 1.00e+00H 1
443 -3.5077625e-01 7.77e-16 1.87e-02 -3.8 3.11e-05 - 1.00e+00 1.00e+00H 1
444 -3.5076752e-01 1.11e-16 7.87e-02 -3.8 4.31e-06 - 1.00e+00 1.00e+00H 1
445 -3.5080167e-01 9.01e-07 4.52e-02 -3.8 2.34e-05 - 1.00e+00 2.50e-01h 3
446 -3.5099908e-01 6.29e-13 4.20e-02 -3.8 3.07e-05 - 1.00e+00 1.00e+00H 1
447 -3.5092144e-01 3.53e-14 6.29e-02 -3.8 9.95e-06 - 1.00e+00 1.00e+00H 1
448 -3.5083346e-01 2.49e-14 4.02e-02 -3.8 3.03e-05 - 1.00e+00 1.00e+00H 1
449 -3.5076858e-01 8.04e-16 5.38e-02 -3.8 1.01e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
450 -3.5086492e-01 2.10e-06 3.74e-02 -3.8 3.07e-05 - 1.00e+00 5.00e-01h 2
451 -3.5086385e-01 1.69e-06 6.02e-02 -3.8 4.77e-06 - 1.00e+00 2.50e-01h 3
452 -3.5111202e-01 1.28e-12 4.21e-02 -3.8 3.61e-05 - 1.00e+00 1.00e+00H 1
453 -3.5083262e-01 3.20e-14 9.60e-02 -3.8 4.39e-05 - 1.00e+00 1.00e+00H 1
454 -3.5097189e-01 4.78e-06 9.60e-02 -3.8 4.21e-05 - 1.00e+00 5.00e-01h 2
455 -3.5097429e-01 4.67e-06 7.84e-02 -3.8 9.76e-06 - 1.00e+00 6.25e-02h 5
456 -3.5088562e-01 2.09e-06 1.59e-02 -3.8 2.59e-05 - 1.00e+00 5.00e-01h 2
457 -3.5085952e-01 1.52e-06 1.52e-02 -3.8 1.59e-05 - 1.00e+00 2.50e-01h 3
458 -3.5080977e-01 6.92e-07 3.75e-02 -3.8 1.60e-05 - 1.00e+00 5.00e-01h 2
459 -3.5081099e-01 6.43e-07 5.94e-02 -3.8 8.15e-06 - 1.00e+00 5.00e-01h 2
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
460 -3.5113308e-01 2.17e-12 8.87e-02 -3.8 5.00e-05 - 1.00e+00 1.00e+00H 1
461 -3.5076437e-01 7.89e-15 5.20e-02 -3.8 6.40e-05 - 1.00e+00 1.00e+00H 1
462 -3.5085852e-01 2.05e-06 9.04e-02 -3.8 2.83e-05 - 1.00e+00 5.00e-01h 2
463 -3.5112163e-01 1.97e-12 4.19e-02 -3.8 4.49e-05 - 1.00e+00 1.00e+00H 1
464 -3.5090706e-01 1.52e-13 3.03e-02 -3.8 3.53e-05 - 1.00e+00 1.00e+00H 1
465 -3.5080425e-01 5.35e-15 4.93e-02 -3.8 1.79e-05 - 1.00e+00 1.00e+00H 1
466 -3.5080429e-01 8.15e-10 5.54e-02 -3.8 2.03e-05 - 1.00e+00 2.44e-04h 13
467 -3.5099206e-01 4.33e-13 5.54e-02 -3.8 2.58e-05 - 1.00e+00 1.00e+00H 1
468 -3.5075237e-01 1.02e-15 2.24e-02 -3.8 3.85e-05 - 1.00e+00 1.00e+00H 1
469 -3.5077942e-01 3.28e-07 2.00e-02 -3.8 6.31e-06 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
470 -3.5081532e-01 2.45e-14 2.89e-02 -3.8 5.42e-06 - 1.00e+00 1.00e+00H 1
471 -3.5074856e-01 2.22e-16 5.19e-02 -3.8 1.19e-05 - 1.00e+00 1.00e+00H 1
472 -3.5085039e-01 2.44e-06 5.18e-02 -3.8 3.26e-05 - 1.00e+00 5.00e-01h 2
473 -3.5085550e-01 2.23e-06 7.27e-02 -3.8 2.29e-05 - 1.00e+00 2.50e-01h 3
474 -3.5111791e-01 1.26e-12 4.46e-02 -3.8 3.68e-05 - 1.00e+00 1.00e+00H 1
475 -3.5088683e-01 8.27e-14 6.85e-02 -3.8 3.27e-05 - 1.00e+00 1.00e+00H 1
476 -3.5085627e-01 7.36e-14 2.41e-02 -3.8 1.44e-05 - 1.00e+00 1.00e+00H 1
477 -3.5086962e-01 1.15e-14 2.68e-02 -3.8 5.37e-06 - 1.00e+00 1.00e+00H 1
478 -3.5086964e-01 5.48e-10 2.48e-02 -3.8 1.48e-05 - 1.00e+00 2.44e-04h 13
479 -3.5095704e-01 2.45e-13 7.05e-02 -3.8 1.97e-05 - 1.00e+00 1.00e+00H 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
480 -3.5095705e-01 3.04e-10 8.47e-02 -3.8 1.40e-05 - 1.00e+00 1.22e-04h 14
481 -3.5098968e-01 1.41e-13 8.21e-02 -3.8 6.20e-06 - 1.00e+00 1.00e+00H 1
482 -3.5081614e-01 2.04e-14 2.99e-02 -3.8 3.01e-05 - 1.00e+00 1.00e+00H 1
483 -3.5074632e-01 3.24e-08 2.20e-02 -3.8 2.44e-05 - 1.00e+00 1.00e+00h 1
484 -3.5077253e-01 2.24e-07 5.21e-02 -3.8 7.81e-06 - 1.00e+00 1.00e+00h 1
485 -3.5090958e-01 2.87e-13 5.21e-02 -3.8 2.20e-05 - 1.00e+00 1.00e+00H 1
486 -3.5077851e-01 8.16e-16 6.59e-02 -3.8 2.24e-05 - 1.00e+00 1.00e+00H 1
487 -3.5088488e-01 3.35e-06 4.57e-02 -3.8 3.72e-05 - 1.00e+00 5.00e-01h 2
488 -3.5088536e-01 3.00e-06 4.16e-02 -3.8 3.67e-06 - 1.00e+00 1.25e-01h 4
489 -3.5088550e-01 2.98e-06 5.86e-02 -3.8 5.66e-06 - 1.00e+00 7.81e-03h 8
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
490 -3.5083208e-01 1.45e-06 5.92e-02 -3.8 2.27e-05 - 1.00e+00 5.00e-01h 2
491 -3.5096440e-01 4.31e-13 5.37e-02 -3.8 2.30e-05 - 1.00e+00 1.00e+00H 1
492 -3.5080935e-01 2.34e-14 2.41e-02 -3.8 2.59e-05 - 1.00e+00 1.00e+00H 1
493 -3.5080942e-01 6.31e-10 2.67e-02 -3.8 9.45e-06 - 1.00e+00 9.77e-04h 11
494 -3.5089281e-01 1.16e-13 5.01e-02 -3.8 1.06e-05 - 1.00e+00 1.00e+00H 1
495 -3.5075587e-01 1.88e-16 4.77e-02 -3.8 2.45e-05 - 1.00e+00 1.00e+00H 1
496 -3.5083951e-01 1.71e-06 4.77e-02 -3.8 2.70e-05 - 1.00e+00 5.00e-01h 2
497 -3.5082940e-01 1.15e-06 2.82e-02 -3.8 1.06e-05 - 1.00e+00 5.00e-01h 2
498 -3.5078617e-01 5.73e-07 4.44e-03 -3.8 1.40e-05 - 1.00e+00 5.00e-01h 2
499 -3.5074418e-01 1.42e-09 5.68e-02 -3.8 7.57e-06 - 1.00e+00 1.00e+00h 1
iter objective inf_pr inf_du lg(mu) ||d|| lg(rg) alpha_du alpha_pr ls
500 -3.5086428e-01 1.87e-13 2.52e-02 -3.8 2.23e-05 - 1.00e+00 1.00e+00H 1

Number of Iterations....: 500

                               (scaled)                 (unscaled)

Objective...............: -3.5086428274561127e-01 -3.5086428274561127e-01
Dual infeasibility......: 2.5186428752500989e-02 2.5186428752500989e-02
Constraint violation....: 1.8749864399807137e-13 1.8749864399807137e-13
Complementarity.........: 1.5042577456104297e-04 1.5042577456104297e-04
Overall NLP error.......: 2.5186428752500989e-02 2.5186428752500989e-02

Number of objective function evaluations = 1018
Number of objective gradient evaluations = 501
Number of constraint evaluations = 1018
Number of constraint Jacobian evaluations = 501
Number of Lagrangian Hessian evaluations = 500
Total wall-clock secs in solver (w/o fun. eval./lin. alg.) = 32.920
Total wall-clock secs in linear solver = 12.018
Total wall-clock secs in NLP function evaluations = 1.734
Total wall-clock secs = 46.672

EXIT: Maximum Number of Iterations Exceeded.

frapac · 2024-12-05T13:05:55Z

Apparently the convergence is the same, not sure the linear solver is faulty there. By any chance, can you share your code so I can try to reproduce the results locally?

sshin23 · 2024-12-05T17:43:19Z

I concur with @frapac. Could you check if your callbacks are returning the same values on A6000 and H100? obj, cons!, grad!, jac_coord!, and hess_coord!

Franc-Z · 2024-12-06T01:15:00Z

Thanks, I will test and post the callbacks' results on H100.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Why one can get right result on A6000, but problem can't converge on H100 in FP64? #382

Why one can get right result on A6000, but problem can't converge on H100 in FP64? #382

Franc-Z commented Dec 5, 2024 •

edited

Loading

Franc-Z commented Dec 5, 2024

Franc-Z commented Dec 5, 2024 •

edited

Loading

frapac commented Dec 5, 2024

Franc-Z commented Dec 5, 2024 •

edited

Loading

Franc-Z commented Dec 5, 2024

frapac commented Dec 5, 2024

sshin23 commented Dec 5, 2024

Franc-Z commented Dec 6, 2024

Why one can get right result on A6000, but problem can't converge on H100 in FP64? #382

Why one can get right result on A6000, but problem can't converge on H100 in FP64? #382

Comments

Franc-Z commented Dec 5, 2024 • edited Loading

Franc-Z commented Dec 5, 2024

Franc-Z commented Dec 5, 2024 • edited Loading

frapac commented Dec 5, 2024

Franc-Z commented Dec 5, 2024 • edited Loading

Franc-Z commented Dec 5, 2024

frapac commented Dec 5, 2024

sshin23 commented Dec 5, 2024

Franc-Z commented Dec 6, 2024

Franc-Z commented Dec 5, 2024 •

edited

Loading

Franc-Z commented Dec 5, 2024 •

edited

Loading

Franc-Z commented Dec 5, 2024 •

edited

Loading