DOC PREVIEW
UW-Madison ECE 539 - Optimal Brain Surgeon Algorithm

This preview shows page 1-2 out of 5 pages.

Save
View full document
View full document
Premium Document
Do you want full access? Go Premium and unlock all 5 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 5 pages.
Access to all documents
Download any document
Ad free experience
Premium Document
Do you want full access? Go Premium and unlock all 5 pages.
Access to all documents
Download any document
Ad free experience

Unformatted text preview:

Optimal Brain Surgeon AlgorithmSummary of AlgorithmComputational Hurdles of the OBS algorithmSimplifying the OBSResultsOptimal Brain Surgeon AlgorithmRandy SkalaECE 539Section 1Summary of Algorithm1) Train the multilayer perceptron to a minimum in mean square error2) Compute the inverse Hessian (H-1)3) Eliminate weights will small saliencies4) Repeat until no more weights can be deleted without a large increase in the mean-square error.iiiiiiiiHHwwHwS 1][,][21,12,12Computational Hurdles of the OBS algorithmComputing the inverse Hessian matrixRecursive formula has order greater than n2Many Recursions are needed for convergenceUpdating the Weights, Hessian matrix and Saliencies every time a weight is eliminatedMany weights are typically eliminatedSimplifying the OBSEstimate dF/dw by finding the change in the cost function when each weight is eliminatedUse the initial Hessian matrix for all updatesDo “batch elimination” of weightsResultsIncompleteResults so far seem to show that classification problems are handled well with the simplification.Estimation problems do not seem to work as


View Full Document

UW-Madison ECE 539 - Optimal Brain Surgeon Algorithm

Documents in this Course
Load more
Download Optimal Brain Surgeon Algorithm
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view Optimal Brain Surgeon Algorithm and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view Optimal Brain Surgeon Algorithm 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?