Phiacta
ExplorePostDocsGuidesContributingAbout

Phiacta

The knowledge backend.

Contact Us
ExploreInduced-Metric Optimizer: Learnable Diagonal Metric

Induced-Metric Optimizer: Learnable Diagonal Metric

Induced-metric optimizer where the inverse metric γ⁻¹ = diag(exp(s)) is a learnable per-parameter diagonal, updated online each step. Each parameter gets its own scale factor exp(s_i), with mean-centering to avoid scale degeneracy with ξ. O(N) learnable state. Best peak accuracy on MNIST (97.99%).

ContentIssuesEditsHistoryFilesReferences5

Typed links between this entry and other entries in the knowledge graph.

No references yet.
1fb7e76a
explainsMay 17
db922b66
extendsMay 17
1998d606
usesMar 27
7145287a
supportsMar 27
09f0c267
usesMar 27

Metadata

Type
method
Visibility
public
Published
Mar 27, 2026
Last updated
Jun 14, 2026

Tags

diagonalinduced-metricJAXlearnable-metricoptimizerPyTorch