The Hidden Geometry of Learning (IMAGE)

University of Pennsylvania School of Engineering and Applied Science

The Hidden Geometry of Learning

Caption

The manifold of models along training trajectories of networks with different configurations (architectures denoted by different colors, optimization algorithms, hyper-parameters, and regularization mechanisms) is effectively low-dimensional.

Credit

Pratik Chaudhari

Usage Restrictions

Credit must be given to the creator. Only noncommercial uses of the work are permitted. No derivatives or adaptations of the work are permitted.

License

CC BY-NC-ND

Disclaimer: AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert system.