The GAMMA ProjectJim ClauseOverall pictureOverall pictureOverall pictureOverall pictureOverall pictureDebuggingRegression testingImpact analysisBehavior classificationRefactoring...Overall pictureDebuggingRegression testingImpact analysisBehavior classificationRefactoring...Field failures: Anomalous behavior (or crashes) of deployed software that occur on user machinesCrash logsUser-providedinformationOur solutionOur solutionRecordOur solutionRecordReplayOur solutionRecordReplayMinimize!Our solutionRecordReplayMinimizeDebug!Usage ScenarioIn house In the fieldMinimize!Record / Monitor!DevelopReplay / Debug!/"!!ExecutionrepositoryExisting record / replay approachesRegression testing(e.g. Elbaum et al. 06, Orso et al. 06, Orso and Kennedy 05, Saff et al. 05, Mercury WinRunner)• Replay only a portion of an execution by recording events for specific subsystemsDeterministic debugging(e.g. Chen et al. 01, King et al. 05, Narayanasamy et al. 05, Netzer and Weaver 94, Srinivasan et al. 04, VMWare)• Replay an entire execution by recording every component of an applicationBoth types of technique are not amenable tominimization and may cause unacceptable overheadOutline•Our technique•record / replay•minimization•Empirical evaluation•Conclusions•Future work Record & Replay•Goal: develop an approach that has low overhead and is amenable to minimization•Key insight: avoid focusing on low-level (internal) events•expensive (large number of events)•not amenable to minimization (high interdependence)Record & Replay•Goal: develop an approach that has low overhead and is amenable to minimization•Key insight: avoid focusing on low-level (internal) events•expensive (large number of events)•not amenable to minimization (high interdependence)!Focus on high-level (external) interactions with the environment•efficient (fewer, more “expensive” interactions)•amenable to minimization (low interdependence)Environment interactionsEnvironment interactionsStreamsEnvironment interactionsStreams FilesEnvironment interactionsStreams FilesEnvironment interactionsStreams FilesInteraction events: FILE — interaction with a file POLL — checks for availability of data on a stream PULL — read data from a streamEvent log:Environment data (files):Environment data (streams):Event log:Environment data (files):Environment data (streams):FILE foo.1foo.1Event log:Environment data (files):Environment data (streams):FILE foo.1foo.1Event log:Environment data (files):Environment data (streams):FILE foo.1foo.1POLL KEYBOARD NOKEvent log:Environment data (files):Environment data (streams):FILE foo.1foo.1POLL KEYBOARD NOKEvent log:Environment data (files):Environment data (streams):FILE foo.1foo.1KEYBOARD: {5680}POLL KEYBOARD OKPOLL KEYBOARD NOKEvent log:Environment data (files):Environment data (streams):FILE foo.1foo.1KEYBOARD: {5680}POLL KEYBOARD OKPOLL KEYBOARD NOKEvent log:Environment data (files):Environment data (streams):FILE foo.1foo.1KEYBOARD: {5680}helloPOLL KEYBOARD OKPULL KEYBOARD 5POLL KEYBOARD NOKEvent log:Environment data (files):Environment data (streams):FILE foo.1foo.1KEYBOARD: {5680}helloPOLL KEYBOARD OKPULL KEYBOARD 5POLL KEYBOARD NOKEvent log:Environment data (files):Environment data (streams):FILE foo.1foo.1KEYBOARD: {5680}helloPOLL KEYBOARD OKPULL KEYBOARD 5POLL KEYBOARD NOKPOLL NETWORK OKNETWORK: {3405}Event log:Environment data (files):Environment data (streams):FILE foo.1foo.1KEYBOARD: {5680}helloPOLL KEYBOARD OKPULL KEYBOARD 5POLL KEYBOARD NOKPOLL NETWORK OKNETWORK: {3405}!Event log:Environment data (files):Environment data (streams):FILE foo.1foo.1KEYBOARD: {5680}helloPOLL KEYBOARD OKPULL KEYBOARD 5POLL KEYBOARD NOKPOLL NETWORK OKNETWORK: {3405}!Environment data (files):Event log:Environment data (streams):KEYBOARD: {5680}hello ! {4056}c ! {300}...NETWORK: {3405}<html><body>... ! {202}...FILE foo.1POLL KEYBOARD NOKPOLL KEYBOARD OKPULL KEYBOARD 5POLL NETWORK OKPULL NETWORK 1024FILE bar.1POLL NETWORK NOKPOLL NETWORK OKFILE foo.2...PULL NETWORK 1024FILE foo.2POLL KEYBOARD NOK...foo.1 foo.2 bar.1Environment data (files):Event log:Environment data (streams):KEYBOARD: {5680}hello ! {4056}c ! {300}...NETWORK: {3405}<html><body>... ! {202}...FILE foo.1POLL KEYBOARD NOKPOLL KEYBOARD OKPULL KEYBOARD 5POLL NETWORK OKPULL NETWORK 1024FILE bar.1POLL NETWORK NOKPOLL NETWORK OKFILE foo.2...PULL NETWORK 1024FILE foo.2POLL KEYBOARD NOK...foo.1 foo.2 bar.1Environment data (files):Event log:Environment data (streams):KEYBOARD: {5680}hello ! {4056}c ! {300}...NETWORK: {3405}<html><body>... ! {202}...FILE foo.1POLL KEYBOARD NOKPOLL KEYBOARD OKPULL KEYBOARD 5POLL NETWORK OKPULL NETWORK 1024FILE bar.1POLL NETWORK NOKPOLL NETWORK OKFILE foo.2...PULL NETWORK 1024FILE foo.2POLL KEYBOARD NOK...foo.1 foo.2 bar.1Environment data (files):Event log:Environment data (streams):KEYBOARD: {5680}hello ! {4056}c ! {300}...NETWORK: {3405}<html><body>... ! {202}...FILE foo.1POLL KEYBOARD NOKPOLL KEYBOARD OKPULL KEYBOARD 5POLL NETWORK OKPULL NETWORK 1024FILE bar.1POLL NETWORK NOKPOLL NETWORK OKFILE foo.2...PULL NETWORK 1024FILE foo.2POLL KEYBOARD NOK...foo.1 foo.2 bar.1"Environment data (files):Event log:Environment data (streams):KEYBOARD: {5680}hello ! {4056}c ! {300}...NETWORK: {3405}<html><body>... ! {202}...FILE foo.1POLL KEYBOARD NOKPOLL KEYBOARD OKPULL KEYBOARD 5POLL NETWORK OKPULL NETWORK 1024FILE bar.1POLL NETWORK NOKPOLL NETWORK OKFILE foo.2...PULL NETWORK 1024FILE foo.2POLL KEYBOARD NOK...foo.1 foo.2 bar.1"Environment data (files):Event log:Environment data (streams):KEYBOARD: {5680}hello ! {4056}c ! {300}...NETWORK: {3405}<html><body>... ! {202}...FILE foo.1POLL KEYBOARD NOKPOLL KEYBOARD OKPULL KEYBOARD 5POLL NETWORK OKPULL NETWORK 1024FILE bar.1POLL NETWORK NOKPOLL NETWORK OKFILE foo.2...PULL NETWORK 1024FILE foo.2POLL KEYBOARD NOK...foo.1 foo.2 bar.1"Environment data (files):Event log:Environment data (streams):KEYBOARD: {5680}hello ! {4056}c ! {300}...NETWORK: {3405}<html><body>... ! {202}...FILE foo.1POLL KEYBOARD NOKPOLL KEYBOARD OKPULL KEYBOARD 5POLL NETWORK OKPULL NETWORK 1024FILE bar.1POLL NETWORK NOKPOLL NETWORK OKFILE foo.2...PULL NETWORK 1024FILE foo.2POLL KEYBOARD NOK...foo.1 foo.2 bar.1""""""""""""" Minimize!Goal: focus debugging effortMinimize!Goal: focus debugging effortExecutionrecording Minimize!Goal: focus debugging effortExecutionrecording!TimeminimizationMinimize!Goal: focus debugging
View Full Document
Unlocking...