Phiacta
ExplorePostDocsGuidesContributingAbout

Phiacta

The knowledge backend.

Contact Us
ExplorePullback Unification: Gauss-Newton, Fisher, and KFAC from Embedding Geometry

Pullback Unification: Gauss-Newton, Fisher, and KFAC from Embedding Geometry

Embedding parameter space via the network output (rather than the scalar loss) and pulling back the ambient metric reproduces the regularized Gauss-Newton method, Fisher information, the natural gradient, and — under one further Kronecker approximation — KFAC. The induced-metric framework is not introducing a new optimizer here; it provides a single geometric origin for several optimizers that are usually derived separately.

ContentIssuesEditsHistoryFilesReferences3
Loading history...

Metadata

Type
theory
Visibility
public
Published
Jun 3, 2026
Last updated
Jun 14, 2026

Tags

fishergauss-newtoninduced-metric-optimizerkfacnatural-gradientpullback-metric