DOC PREVIEW
USC CSCI 561 - session24-25

This preview shows page 1-2-3-25-26-27-28-50-51-52 out of 52 pages.

Save
View full document
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
View full document
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience
Premium Document
Do you want full access? Go Premium and unlock all 52 pages.
Access to all documents
Download any document
Ad free experience

Unformatted text preview:

CS 561, Sessions 24-251Final Exam• Thursday, December 11, 8:00am – 10:00am• rooms: pending…• No books, no questions, work alone, everything seen in class.CS 561, Sessions 24-252Artificial Neural Networks and AIArtificial Neural Networks provide…- A new computing paradigm- A technique for developing trainable classifiers, memories, dimension-reducing mappings, etc- A tool to study brain functionCS 561, Sessions 24-253Converging Frameworks• Artificial intelligence (AI): build a “packet of intelligence” into a machine• Cognitive psychology: explain human behavior by interacting processes (schemas) “in the head” but not localized in the brain• Brain Theory: interactions of components of the brain -- computational neuroscience - neurologically constrained-models• and abstracting from them as both Artificial intelligence andCognitive psychology:- connectionism: networks of trainable “quasi-neurons” to provide “parallel distributed models” little constrained by neurophysiology- abstract (computer program or control system) information processing modelsCS 561, Sessions 24-254Vision, AI and ANNs• 1940s: beginning of Artificial Neural NetworksMcCullogh & Pitts, 1942Σiwixi≥θPerceptron learning rule (Rosenblatt, 1962)BackpropagationHopfield networks (1982)Kohonen self-organizing maps… input outputneuronmMSmCS 561, Sessions 24-255Vision, AI and ANNs1950s: beginning of computer visionAim: give to machines same or better vision capability as oursDrive: AI, robotics applications and factory automationInitially: passive, feedforward, layered and hierarchical processthat was just going to provide input to higher reasoningprocesses (from AI)But soon: realized that could not handle real images1980s: Active vision: make the system more robust by allowing thevision to adapt with the ongoing recognition/interpretationCS 561, Sessions 24-256CS 561, Sessions 24-257CS 561, Sessions 24-258Major Functional Areas• Primary motor: voluntary movement• Primary somatosensory: tactile, pain, pressure, position, temp., mvt.• Motor association: coordination of complex movements• Sensory association: processing of multisensorial information• Prefrontal: planning, emotion, judgement• Speech center (Broca’s area): speech production and articulation• Wernicke’s area: comprehen-• sion of speech• Auditory: hearing• Auditory association: complex• auditory processing• Visual: low-level vision• Visual association: higher-level• visionCS 561, Sessions 24-259Felleman & Van Essen, 1991InterconnectCS 561, Sessions 24-2510More on ConnectivityWhich brain area is connected to which other one,And in which directions?CS 561, Sessions 24-2511Key terms:AxonDendritesSynapsesSoma (cell body)Remember? Neurons & synapsesCS 561, Sessions 24-2512Electron Micrograph of a Real NeuronCS 561, Sessions 24-2513Remember? Transmenbrane Ionic Transport•Ion channelsact as gates that allow or block the flow of specific ions into and out of the cell.CS 561, Sessions 24-2514Approaches to neural modeling• Biologically-realistic, detailed models• E.g., cable equation, multi-compartment models• The Hodgkin-Huxley model• Simulators like NEURON (Yale) or GENESIS (Caltech)• More abstract models, still keeping realism in mind• E.g., integrate & fire model, simple and low detail but preserves spiking behavior• Highly abstract models, neurons as operators• E.g., McCulloch & Pitts model• Classical “neural nets” modelingCS 561, Sessions 24-2515The Cable Equation• See http://diwww.epfl.ch/~gerstner/SPNM/SPNM.htmlfor excellent additional material (some reproduced here).• Just a piece of passive dendrite can yield complicated differential equations which have been extensively studied by electronicians in the context of the study of coaxial cables (TV antenna cable):CS 561, Sessions 24-2516The Hodgkin-Huxley ModelExample spike trains obtained…CS 561, Sessions 24-2517Detailed Neural ModelingA simulator, called “Neuron” has been developed at Yale to simulate the Hodgkin-Huxley equations, as well as other membranes/channels/etc. See http://www.neuron.yale.edu/CS 561, Sessions 24-2518The "basic" biological neuron• The soma and dendrites act as the input surface; the axon carries the outputs. • The tips of the branches of the axon form synapses upon other neurons or upon effectors (though synapses may occur along the branches of an axon as well as the ends). The arrows indicate the direction of "typical" information flow from inputs to outputs.Dendrites Soma Axon with branches andsynaptic terminalsCS 561, Sessions 24-2519• A McCulloch-Pitts neuron operates on a discrete time-scale, t = 0,1,2,3, ... with time tick equal to one refractory period• At each time step, an input or output is onoroff — 1 or 0, respectively. • Each connection or synapse from the output of one neuron to the input of another, has an attached weight. Warren McCulloch and Walter Pitts (1943)x (t)1x (t)nx (t)2y(t+1)w12nwwaxonθCS 561, Sessions 24-2520Excitatory and Inhibitory Synapses•We call a synapseexcitatory if wi> 0, andinhibitory if wi< 0. • We also associate a thresholdθ with each neuron• A neuron fires (i.e., has value 1 on its output line) at time t+1 if the weighted sum of inputs at t reaches or passes θ:y(t+1) = 1 if and only if Σ wixi(t) ≥ θCS 561, Sessions 24-2521From Logical Neurons to Finite AutomataAND111.5NOT-10OR110.5Brains, Machines, and Mathematics, 2nd Edition, 1987X Y→Boolean NetXYQFinite AutomatonCS 561, Sessions 24-2522Increasing the Realism of Neuron Models• The McCulloch-Pitts neuron of 1943 is importantas a basis for • logical analysis of the neurally computable, and• current design of some neural devices (especially when augmented by learning rules to adjust synaptic weights). • However, it is no longer considered a useful model for making contact with neurophysiological data concerning real neurons.CS 561, Sessions 24-2523Leaky Integrator Neuron• The simplest "realistic" neuron model is a continuous time model based on using the firing rate (e.g., the number of spikes traversing the axon in the most recent 20 msec.) as a continuously varying measure of the cell's activity• The state of the neuron is described by a single variable, the membrane potential. • The firing rate is approximated by a sigmoid, function of membrane potential.CS 561,


View Full Document

USC CSCI 561 - session24-25

Download session24-25
Our administrator received your request to download this document. We will send you the file to your email shortly.
Loading Unlocking...
Login

Join to view session24-25 and access 3M+ class-specific study document.

or
We will never post anything without your permission.
Don't have an account?
Sign Up

Join to view session24-25 2 2 and access 3M+ class-specific study document.

or

By creating an account you agree to our Privacy Policy and Terms Of Use

Already a member?