Digital audio and computer musicCOS 116: 2/26/2008OverviewnSound and music in the physical world and in human experiencenRepresentations of musicnAnalyzing music with computersnCreating music with computers1. Sound and musicWhat is sound?Discussion Time“Pressure wave”What do we hear?Video: http://www.youtube.com/watch?v=0svoQcMQNYgFrequencyPitchLoudnessTimbre…PsychoacousticsRelationships between physical phenomenon of sound and our perceptionFrequency : pitch20-20,000HzAmplitude : loudnessIdentities and strengths of frequencies present : timbre+ =Discussion TimeWhat is music?“Organized sound” • Psychoacoustics play an important role• Also dependence upon history, culture, experience• Engages listeners’ psychological mechanisms for expectation/reward2. Representations of sound and musicScore: Audio samplesSpectrumDiscussion TimeHow do you represent music?Digital representation of musicCompressionA “better” representation with fewer bitsWhy? Security, transmission, storageHow?Psychoacoustic principlesMP3: MaskingPhysical principles of sound production (uses modelsof sound source)Choosing a representationRepresentations are compromisesStandard representations are somewhat arbitraryAppropriate representation is task-dependent3. Using technology to analyze sound and musicAnalyzing speechReal-life apps:Customer service phone routingVoice recognition softwareComputational Auditory Scene AnalysisApplications: Archival and retrieval, forensics, AIMusic information retrievalAnalyzing musical dataQuery, recommend, visualize, transcribe, detect plagiarism, follow along with a scoreSites you can trymidomi.comThemefinder.comPandora.com (human-driven), last.fmMachine learning for analysis4. Using technology to create music and soundA whirlwind tour of the 20th century, with a focus on computer technologyCreating music: SynthesisThree approaches to synthesisAdditive synthesis¨Figure out which frequencies are present, and in what proportions¨Synthesize a sine wave at each frequency, and superpose them.¨Physical modeling¨Start with knowledge about how physical systems oscillate¨Simulate oscillation of an arbitrary system. (RecallLecture 4)+ + …=Three approaches to synthesisCross-synthesisChoose filter for speech (vowel)Choose source to be another soundSome continua of computer music creationSynthesisControlling synthesisCompositionlowhighLevel of controlRunning a programComputer follows performerLive coding, special controllersInteractivityPerformer-Computer InteractionAugmented instrumentsSoftware and hardware interfacesDemo: PLOrk video, PBSDemo: using a Wii-mote to control soundDemo: SMELTNew instruments Demo: Perry’s MugLive codingDemo: Max’s drum machineQuestions: How can we….develop new ways to synthesize sound?give user control over synthesis parameters?make machines interactive in a musical way?augment human capabilities?design new instruments that are easy to play? allow expert musicality?create music that is emotionally and aesthetically compelling?Final remarksDistinctions in this presentation are superficialAnalysis, representation, and creation interactTechnology draws on and contributes to our understanding of the physics and psychophysics of soundComputer music is interdisciplinaryHCI, AI, programming languages, algorithms, systems buildingAlso psychology, music theory, acoustics, signal processing, engineering, physics, performance practice, library science, applied math & statistics, …Technology is constantly complicating and changing the landscape of our musical experiences as creators, participants, listeners, and consumers.http://soundlab.cs.princeton.edu/ΘυιχκΤιµε ανδ αTIFF (LZW) decompressorare needed to see this picture.ΘυιχκΤιµε ανδ αTIFF (LZW) decompressorare needed to see this
View Full Document