Minliang Lin MinliangLin

## README.md

      
        
          
            
              
              2 files
            
          
          
            
              
              0 forks
            
          
            
              
                
                0 comments
              
            
          
            
              
              0 stars
            
          
        
        
          
              
          
          
            
                MinliangLin
                / README.md
            
            
              Last active
              September 14, 2025 07:53
                — forked from EmilienDupont/LICENSE
            
              
                Optimization Algorithms Visualization
              
          
        
      
        
  
      
    2025.09.14: Added Newton method and quadratic function.
Visualization of different optimization algorithms used in deep learning.

Click anywhere on the function heatmap to start a minimization. You can toggle the different algorithms (SGD, Momentum, RMSProp, Adam) by clicking
on the circles in the lower bar.
The global minimum is on the left. A local minimum is found on the right.
Interestingly, different initializations make some algorithms converge to the local minimum while others converge to the global minimum.