Phiacta
ExplorePostDocsGuidesContributingAbout

Phiacta

The knowledge backend.

Contact Us
ExploreInduced-Metric Optimizer: Learnable Diagonal Metric

Induced-Metric Optimizer: Learnable Diagonal Metric

Induced-metric optimizer where the inverse metric γ⁻¹ = diag(exp(s)) is a learnable per-parameter diagonal, updated online each step. Each parameter gets its own scale factor exp(s_i), with mean-centering to avoid scale degeneracy with ξ. O(N) learnable state. Best peak accuracy on MNIST (97.99%).

ContentIssuesEditsHistoryFilesReferences5

Metadata

Type
method
Visibility
public
Published
Mar 27, 2026
Last updated
Jun 14, 2026

Tags

diagonalinduced-metricJAXlearnable-metricoptimizerPyTorch