Database Systems Performance EvaluationTechniquesSubharthi Paul [email protected] (A project report written underthe guidance of Prof. Raj Jain)DownloadAbstractThe last few decades has seen a huge transformation in the way businesses are conducted. There has been aparadigm shift from product portfolio based marketing strategies to customer focused marketing strategies.The growth and diversity of the market has greatly profited consumers through higher availability, betterquality and lower prices. The same factors however has made it more difficult for businesses to maintain theircompetitive edge over one another and hence has forced them to think beyond their product portfolio andlook at other means to gain higher visibility and customer satisfaction, maintaining all the while their coreadvantages on pricing and product through improved and more efficient methods of manufacturing anddistribution. The advent and spread of computers and networking has been one of the single largest factorsthat has spurred and aided this enormous movement. More specifically, database management systems nowform the core of almost all enterprise logic and business intelligence solutions. This survey tries to emphasizethe importance of database systems in enterprise setups and looks at the methods and metrics that are used toevaluate the performance of these database systems.KeywordsDatabase Systems, Transaction Processing, Performance Evaluation Techniques, Database BenchmarkingTable of Contents1. Introduction2. Database Management Systems: Formal Definition and Classification2.1 Classification based on Data Modeling2.1.1 Hierarchical Model2.1.2 Relational Model2.1.3 Network Model2.1.4 Object-Relational Model3. A General Approach to Database Performance Evaluation4. Database Performance Evaluation Techniques for specialized Databases5. Database Systems: Performance Evaluation Benchmarks5.1 TPC Benchmarks5.1.1 TPC-C Benchmark5.1.2 TPC-E Benchmark5.1.3 TPC-H Benchmark5.2 Other BenchmarksDatabase Systems Performance Evaluation Techniques1 of 125.2.1 Bristlecone5.2.2 Benchmark Factory5.2.3 CIS Benchmark5.2.4 SPEC Benchmark5.2.5 PolePosition5.2.6 Open Source Development Labs Database Test Suite6. SummaryReferences1. IntroductionThe last few decades has seen a huge transformation in the way businesses are conducted. There has been aparadigm shift from product portfolio based marketing strategies to customer focused marketing strategies.The growth and diversity of the market has greatly profited consumers through higher availability, betterquality and lower prices. The same factors however has made it more difficult for businesses to maintain theircompetitive edge over one another and hence has forced them to think beyond their product portfolio andlook at other means to gain higher visibility and customer satisfaction, maintaining all the while their coreadvantages on pricing and product through improved and more efficient methods of manufacturing anddistribution. The advent and spread of computers and networking has been one of the single largest factorsthat has spurred and aided this enormous movement. More specifically, database management systems nowform the core of almost all enterprise logic and business intelligence solutions.Database Systems are one of the key enabling forces behind business transformations. Apart from supportingenterprise logic they also enable business intelligence. Information is the key to success in today's businesses.However, maintaining information in logically consistent and feasibly retrievable format is a daunting task.More so with the added complications of transaction consistency management, synchronization acrossmultiple repositories spread geographically across the globe, failover management and redundancymanagement, today's database systems are truly state-of-the-art high performance software systems.Apart from managing a plethora of complicated tasks, database management systems also need to be efficientin terms of storage and speed. Businesses have a tendency to store un-required historical data often as a resultof poor data planning or less frequently owing to federal obligations or consumer law. Dynamic addition anddeletion of data from the database also pose a challenge to maintaining an efficient data retrieval mechanism.Though, limited in speed by some sense due to hardware limitations, database systems nonetheless need toachieve full throttle through efficient storage and retrieval techniques. Another factor that often hurt databaseperformance is ill-written computationally expensive queries. Often, such situations are beyond control of thedatabase system and require external performance tuning by experts.As is true for most systems, reliability, availability and fault-tolerance is a huge concern for database systems.Reliability of a system is generally improved through redundancy. Modern businesses cannot afford to loosedata or present wrong data. Modern business activities are highly centered around and dependant onelectronic data. Modern database systems thus need to build in high reliability mechanisms in their designs.Availability is another issue that concerns a lot of businesses. As an example, "Netflix" an online DVD rentalbusiness receives online requests for 1.9 million DVD's everyday. An outage for 10 minutes cost huge lossesto these businesses. Similar is the case for a lot of other businesses. Amazon.com stands to looseapproximately $31000 per minute for a global outage [1]. Clearly, availability is a key metric for measuringthe performance of database systems.Another metric, which is more qualitative in nature, but extremely important is security. It is generallydifficult to measure the level of security of any system unless its security vulnerabilities are exposed.Database Systems Performance Evaluation Techniques2 of 12Database systems often store sensitive enterprise and customer data that if inappropriately used may causehuge monetary and business losses for the organization. Hence, though difficult to quantify through standardtesting procedures, database systems strive for continual upgrade of their security features.Performance evaluation of database systems is thus an important concern. However, easier said than done,performance evaluation of database system is a non-trivial activity, made more complicated by the existenceof different flavors of database systems fine tuned for serving specific requirements. However
View Full Document
Unlocking...