MCC Product Line Development Metrics Nancy Eickelmann Ph D Microelectronics and Computer Technology Corporation MCC 3500 West Balcones Center Drive Austin Texas 78759 ike mcc com MCC Nancy Eickelmann Product Line Development Metrics GSAW 98 MCC New View A Dual Lifecycle Domain Engineering Arch Maint Enterprise Wide Technology Strategy Specification Domain Analysis Arch Design Arch Use Arch Generation Arch Test Arch Deploy Arch Archive MCC Nancy Eickelmann Develop Generate Integrate Product Line Development Metrics Application Engineering Application App Analysis Maint Module Application Develop App Analysis App Maint Module Use Integrate Application Develop App Analysis App Use Maint AppModule Integrate Test Deploy Develop Package App App Test Use Integrate Deploy Package App Test Deploy Package GSAW 98 MCC Key Issues Organizational Operational strategy linking business goals to technical approach Designated architecture group Strong CM group Reuse team Requirements arbitration method with targeted productline reuse goals Managerial Success criteria for profitability domain definitions business discriminators Decision criteria for PL prioritization Negotiation acceptance criteria Metrics definition collection and analysis to control and inform product and process decisions Technical MCC Nancy Eickelmann Product Line Development Metrics Domain selection criteria Systems and software architectures Reuse strategies Domain modeling Architecture specification Product line asset analysis Product line process definition Rationale capture and technical negotiation support Domain analysis Product line reuse analysis Validation and verification of artifact consistency Metrics collection analysis and dissemination Product line process enactment and analysis Process fragment reuse GSAW 98 Product Process Resource Metrics MCC Product Metrics The typical focus has been on product size a measured by source lines of code SLOC This applies well to application engineering but does not provide a basis for measurement of domain asset usage such as architectures Process Metrics The typical focus has been on events occurring over time This is typically a measure of duration of activities or event sequencing based on a traditional approach to software development The dual life cycle perspective with enterprise level strategic planning is not captured For instance a proposed benefit of product line practice is cycle time reduction thus the collapsing of sequences of tasks to concurrent processes must be measured as well Resource Allocation Metrics The typical focus has been on number of labor units expended This approach is based on labor comprising the single input of resources to the development project The efficacy of this assumption must be evaluated in context of the domain assets developed and reused across product lines MCC Nancy Eickelmann Product Line Development Metrics GSAW 98 MCC Old Metrics Application Level Resource Labor Person Months PM Re Use SLOC Productivity SLOC PM Product Size SLOC FP OP Defect density defects 1000 SLOC Process Event sequences cycle times duration in time Progress tracking configuration items completed number of STRs total open MCC Nancy Eickelmann Product Line Development Metrics GSAW 98 MCC Architecture based Lifecycle Compression Architecture based Product Development Architecture Generation Application Application Application Lifecycle Testing Information Management Lifecycle Test Process Lifecycle and Process Integration Rationale Capture Understanding Technology Elements MCC Nancy Eickelmann Product Line Development Metrics GSAW 98 MCC Product Line Metrics Architecture Resource Number of times the asset is re used in the PL Product Domain variability Economies of Scope Defect Propagation Potential Process Legacy mining cycle Asset retrieval and integration cycle defect identification resolution cycle MCC Nancy Eickelmann Application Resource Labor Reuse Ratio Productivity Reuse PM DeMarco Product Number of products buildable from the PL assets Process Project cycle time Build and synch cycle time Product Line Development Metrics GSAW 98 MCC Critical Product Line Metrics economies of scope are the savings or profit from building a greater diversity of products with the same or less inputs and is measured by quantity of effort cost per unit of effort number of assets in portfolio number of planned products degree of domain variability implementation diversity for a core set of services MCC Nancy Eickelmann Product Line Development Metrics GSAW 98 MCC How to Apply the Metrics Determine the Span of system covered by the asset Determine the Scope of potential products using asset Determine the Impact of total software effort replaced by asset Determine the Robustness covariance of product attributes to product flexibility flexibility is the number of product arttributes an asset can accommodate for a given product family MCC Nancy Eickelmann Product Line Development Metrics GSAW 98 MCC Beyond Systematic Reuse The rigorous definition and quantification of these metrics for product lines would support the objective evaluation of domain suitability for a product line development approach It would also enable the quantification of the amount of architectural drift introduced through evolutionary substitutions Evaluation of the trends in economies of scope for the domains of the product line should provide rich characterizations of domain assets in the context of architecture based reuse MCC Nancy Eickelmann Product Line Development Metrics GSAW 98 MCC You may contact the author Nancy Eickelmann Ph D at Microelectronics and Computer Technology Corporation MCC 3500 West Balcones Center Drive Austin Texas 78759 ike mcc com MCC Nancy Eickelmann Product Line Development Metrics GSAW 98