Java Implementation of Optimal Brain SurgeonWhat Is OBSMy ProjectHow It WorksProgressJava Implementation of Optimal Brain SurgeonECE 539 ProjectCurtis ChristieWhat Is OBSOptimal Brain Surgeon–Takes a relatively large trained neural network –Calculates which weights can be removed with out introducing a lot of error–Adjusts remaining weight to account for removal of a weight–OBS can reduce number of weights by 70-90%My ProjectJava Implementation of OBS–InputsInput VectorTrained WeightsPartial Derivate’s of F(x,w) in terms of w–OutputsNew WeightsHow It WorksCalculates the inverse Hessian matrix using recursionFinds Saliency of each weight–Increase in error that results when the weight is eliminatedFinds lowest Saliency of all the weights, determines if weight should be removedAdjusts all weights for the removal of each a weightRepeats until no more weights can be removedProgressAccomplished–Found Hessian Inverse–Found minimum SaliencyRemaining–Remove weight–Adjust remaining weights–Run test
View Full Document
Unlocking...