EE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.1University of CaliforniaBerkeleyCollege of EngineeringDepartment of Electrical Engineeringand Computer SciencesProfessors : N.Morgan / B.GoldEE225D Spring,1999Speech Perception Lecture 18EE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.2Figure 17.1 : Block diagram of sound representation in the auditory system.EE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.3Speech PerceptionProduction Physiology PsychophysicsConsonant PerceptionConsonants are more important than vowels. Cnsnnts r mr mprtnt thn vwls ooa ae oe ioa a oePerceptionEE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.4Figure 17.5 : Confusion matrix for S/N=+12dB and frequency response of 200-6500Hz.EE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.5Figure 17.5 : Confusion matrix for S/N=-6dB and frequency response of 200-6500Hz.EE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.6Condition S/N Band 1 -18 200 - 6500 2 -12 200 - 6500 3 - 6 200 - 6500 4 0 200 - 6500 5 6 200 - 6500 6 12 200 - 6500 7 12 200 - 300 8 12 200 - 400 9 12 200 - 60010 12 200 - 120011 12 200 - 250012 12 200 - 500013 12 1000 - 500014 12 2000 - 500015 12 2500 - 500016 12 3000 - 500017 12 4000 - 5000Figure 17.6 : Seventeen conditions of S/N and filtering.EE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.7Miller Nicely SystemVoicingNasalityAffricationDurationPlace of Articulations - zm, n, ng, other Soundsfricatives m,np, bp, k, tb, g, dEE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.8EE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.9EE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.10EE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.11Figure 17.7 : Binary distinctive feature set of Jakobson et al.EE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.12Jacobson, Fant, Halle.ProductionPerceptionHaskin’s Lab.Pattern Playbackspectrumburst(freq.)formant transitionplosure - fs vowelF3F2F1tkpsilenceEE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.13Figure 17.9 : Perceptual responses to different burst frequencies and vowels for the voiceless plosives.EE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.14Figure 17.11 : Smoothed spectra and corresponding ALSR’s for the fine 20ms. Intervals at the begining o f the - da - stimulus.Freq. (kHz.)Freq. (kHz.)Smoothed Stimulus Smoothed ALSREE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.15Figure 17.12 : Analysis by synthesis motor theory of speech perception.SpeechAnalysis ofStore Tentative Previous TentativeComparatorDifferences Controller / Phone Trail Pattern of Trial PhonemesSymthesis of PhonologicalArticulatory InputOutput Auditory FeaturesDecoding to Phonemes ContextPhonemesDecision Maker Auditory Pattern from Motor Instructions Motor Instructions Rules of the LanguageAuditory FeaturesABCDEFGHEE225D LECTURE ON SPEECH PERCEPTION N.MORGAN / B.GOLD LECTURE 18 18.16.Figure 17.13 : Neural firing patterns for different CF’s and spectrogram of same