Rasmussen's minimize.
Rasmussen's minimize.
Rasmussen's fmincg.
Implementation of the conjugate gradient descent as described in the article "A new conjugate gradient method wyth guaranteed descent and an efficient line search" by William W.
Line search algorithm as described in Carl Edward Rasmussen's unpublished (?) document "Function minimization using conjugate gradients: conj" (May 15 1996)
Curried error function, which gets a target value and returns a differentiable function that represents some sort of error between the input and the target value.
Differentiable Double-valued function suitable for line-search
algorithms.
This termination criterion first just waits until numberOfInitialSteps
have passed.
Termination criterion that limits the number of line searches for CG-type optimization algorithms.
Generic nonlinear conjugate gradient method for optimization of nonlinear twice differentiable functions which are bounded from below.
Version of nonlinear conjugate gradient descent based on the minimize.
Result selector takes a look at a sequence of intermediate results of some optimization or search, and caches the best result it has seen so far.
A fairly generic termination criterion that takes a look at the intermediate result achieved and resources used so far, and decides if an optimization procedure or some kind of search should be terminated.
Comparison of various re-implementations of conjugate gradient descent and a bunch of other, much simpler, optimization algorithms
Factory for error functions that can be applied to data with values in [0, 1] and reconstructions with values in (0, 1).
Returns half of the square of the norm induced by the scalar products structure on Real^n. The normalization factor 1/2 is there so that the residual corresponds to the gradient.
Trivial termination criterion that is never fulfilled.