4. EvaluationTwo major steps are involved in evaluating the design and prototype: test specification and testcertification. The specified tests are developed to determine whether the software and hardware meet thedesign constraints. 4.1. Test SpecificationTest specification involves applying a thorough understanding of the involved hardware and software andgenerating a battery of tests that will address all potential modes of operation. The requirements given insection 2 will be verified; however, the operation of the entire device will also need to be tested. To testthe operation of the recording system, the operational conditions were enumerated, and the properresponses to these stimuli were determined. In addition to actual tests, simulations will be used toconveniently pinpoint any problems before the device is finally constructed.4.1.1. SimulationMost of the simulation will involve the hardware, but the software and the interaction between softwareand hardware will also be characterized. Simulation will be an important part of the hardware designbecause simulated operation of the PIC can be a powerful tool for debugging.4.1.1.1. Hardware Simulation: Sensors and PICThe basic tool for programming and simulating operation of the PIC used in this project will be MPLAB,which is available from http://www.microchip.com. This free software package offers an integrateddevelopment environment (IDE) for programming PICs and will allow the operation of the digitalcomponents (essentially the PIC) to be simulated prior to testing the actual circuit.PSpice, a software package that includes powerful tools for circuit simulation, will be used to simulate thecircuit that surrounds the PIC. This will include the power supply and any circuit elements used toconnect the sensors to the PIC.4.1.1.2. Software Simulation: FirmwareThe firmware will be tested on a desktop or laptop computer with a similar hardware configuration to thefinal device. This will offer an easier development environment and will allow issues involve theoperation of the software to be completely segregated from hardware compatibility or connection issues.The camera and microphone will be connected to the system, but the presence (or absence) of the sensorswill be simulated with a function that generates reasonable values. 4.1.2. HardwareThe hardware consists of two separate components: the recording device and the sensor package. Properoperation of each must be verified through testing. The hardware testing of the recording device willaddress noise level, size, and connections with peripherals. The testing of the sensor package willconcentrate on matching the actual operation of the PIC to the simulations and verifying proper operationwhen sensors are removed or when the module is unable to communicate with the recorder.4.1.2.1. Noise LevelThe noise level of the device will be monitored during normal operation to determine if the level of soundgenerated will affect the microphone reading. A sound level meter will be used to measure the noise levelspectrum (noise level versus frequency). The Canadian Centre for Occupational Health and Safety(CCOHS)[1] recommends a distance between 1 and 3 meters for measuring noise emissions from adevice; consequently, the noise level will be measured at both 1 and 3 meters. The peak noise level ateach distance will be compared to the desired threshold of 20 dB(A).4.1.2.2. Sensor ModuleThe sensor module will be connected to a computer to test its operation. The following steps will beconducted:1. The communication between the PIC and the computer will be verified. The PIC will beconnected to a serial port and the response of the PIC will be noted.2. Data will be recorded from the PIC. The data will be examined for proper formatting.3. The sensors will each be tested:a. The temperature sensors will be placed in both hot and cold locations, and readings fromthe PIC will be examined.b. The motion sensors will be triggered, and the output of the PIC will be studied to verifythe response.c. The output of the PIC will be recorded when the EMF sensor is both close to and far froma magnetic field (power lines or electronics). The data will be checked for a response.4.1.2.3. Hardware Design ConstraintsThe tests that will be performed to certify that the prototype and packaged device meet the designconstraints are summarized in Table 4. This table summarizes the information given above and includesthe additional hardware constraints, such as the size requirement, that will be verified with trivial tests.Name Constraint Type TestCamera connectionWill connect to IEEE-1394 IIDC-compatible cameraTechnical IIDC-compatible amera will be connected to recording device and connection will be verified by running a video viewing program. Noise Level The device will have a noise level less than 20 dBTechnical Sound level meter will be used to probe device.Power The device will use no more than 72 W of powerPractical Current and voltage from power supply will be measured, and the power will be calculated.Size The device will be 11.75” long, 7.5” wide, and 6.75” highPractical Size will be measured with a ruler.Table 4. Hardware Design Constraints and Test Specifications.4.1.3. SoftwareThe software designed in this project will contain two separate, cooperating components: the firmwarethat runs on the recording unit and the Windows software that will download and manage data. Thestability of the firmware is crucial; consequently, extensive testing will be needed to ensure properoperation in a variety of circumstances.4.1.3.1. FirmwareA primary component of the software developed in this project will be the firmware on the recordingsystem that will read from the camera, microphone, and sensors, and will record the data to disk whenappropriate (i.e., when the sensors have detected activity). The firmware must be stable under thefollowing circumstances:- The camera, microphone, or sensor assembly is unplugged from the unit during operation. Twomodes of operation are recognized:o Data is being recorded to memory because nothing has been sensed.o Data is being recorded to memory because a sensor has been triggered.- The camera,