Newsroom

Interpretable Models

  • FDS Colloquium: Jun’ichi Takeuchi (Kyushu), “Fisher information and Neural Tangent Kernels”

    Abstract: We argue relation between neural tangent kernels (NTK) and Fisher information matrices of neural networks. For the Fisher information matrices of two layer ReLU neural networks with random hidden weights, we demonstrated their approximate spectral decomposition, whose eigenvalue distribution highly concentrates (Takeishi et al. 2023). In particular, the sum of the top 3 eigenvalues…