Phiacta
ExplorePostDocsGuidesContributingAbout

Phiacta

The knowledge backend.

Contact Us
ExploreInduced-Metric Optimizer: Off-Diagonal Metric

Induced-Metric Optimizer: Off-Diagonal Metric

Induced-metric optimizer with non-zero off-diagonal blocks in the ambient metric: h = [[γI, a], [bᵀ, 1]]. The pullback becomes G = γI + ξ(alᵀ + lbᵀ + llᵀ) where l, a, b can be gradient, momentum, parameters, or zero. Inverse via rank-2 Woodbury or Sherman-Morrison. Setting a=b=l recovers the original metric.

ContentIssuesEditsHistoryFilesReferences3
Loading history...

Metadata

Type
method
Visibility
public
Published
Mar 27, 2026
Last updated
Jun 3, 2026

Tags

induced-metricJAXoff-diagonaloptimizerrank-2Woodbury