Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
We Will Cover
Introduction Trends effecting performance issues Purpose of Performance Monitoring Evaluation Phases Performance measures Performance Evaluation Techniques
Timing Mixes Kernels Models Benchmarks Synthetic Programs Simulation Monitor(Hardware & Software)
Introduction
Description
Because an operating system is primarily a resource manager, it is important for operating systems designers to be able to determine how effectively a particular system manages its resources. In the early years performance evaluation was focused only on hardware because it was the dominant factor with respect to price but today hardware is less expensive then software. Some software often causes poor performance, even on systems with very powerful hardware. Therefor it is important to monitor their performance.
Selection Evaluation:
Here the evaluator must decide if obtaining a computer system from a particular vendor is appropriate.
Performance Projection:
Here the goal of the evaluator is to estimate the performance of a system that does not exist. It may be a complete new computer hardware of software.
Performance Monitoring:
The evaluator accumulates the performance data on an existing system or component to be sure that the system is meeting its performance goals.
In Development Phase:
Determine the best hardware organization. Resource management strategies. Determine whether the evolving system meets its objectives.
Performance Measures
By performance we mean the manner in which or the efficiency with which a computer system meets its goals.
Absolute Measures:
Ease of use
Performance Measures
Turnaround Time:
The time from which a job is submitted until the job is returned to the user. waiting to get into memory, waiting in the memory queue, executing on the CPU and doing I/O
Response Time:
The time from which a user presses an ENTER key until the system begins typing a response. The time from which a user presses an ENTER key until the first time slice of service is given to that users request.
Performance Measures
VRT is a measure of dispersion. A small variance indicates that the various response time experienced by users are relatively close to the mean. Work per unit time performance. The measure of amount of work that has been submitted to the system and which the system normally must process in order to function acceptably. This is the measure of maximum throughput a system may have. This is the fraction of time that a resource is in use. Even though a high percentage utilization seems desirable, but it may be the result of inefficient usage.
Throughput:
Workload:
Capacity:
Utilization:
Timings:
Timings are useful to perform quick comparisons of hardware. The number of additions per second has often been used for timing comparisons.
Instruction Mixes:
Instruction mixes use a weighted average of various instruction timings more suited to a particular application.
Kernel Programs:
A typical program that might run at installation. Using manufacturers instruction timing estimates, the kernel program is timed for a given machine. Comparisons are then possible.
New hardware
New Software
Reconfigur e hardware
Change software
Timings Mixes Kernels Modes Bebchmarks Synthetic program Simulation Monitor (hardware and software)
1 1 2 2 3 3 3 2
--1 1 3 3 3 2
---2 2 2 3 3
----2 2 3 3
Analytic Models:
Analytic models are mathematical representation of computer systems or component of computer systems. i.e.: the model of queuing theory and markov processes are some examples.
Benchmarks:
A benchmark is a real program that the evaluator actually submits for execution on the system being evaluated. The evaluator knows the characteristics of the benchmark on existing systems so when it runs on new system, evaluator may draw meaningful conclusions.
Synthetic Programs:
These are the real programs that have been custom designed to exercise specific features of a computer system. They are particularly useful when benchmarks exercising those features dont already exist.
Simulation:
Simulation is a technique in which the evaluator develops a computerized model of the system being evaluated. The model is then run on a computer system that reflects the behavior of the system being evaluated.
Performance Monitoring:
Performance monitoring is the collection and analysis of information regarding system performance for existing systems. It is useful in determining how a system is performing in terms of throughput, response time, predictability etc. Performance monitoring can locate bottleneck very easily and can help management decide how to improve performance.
References
http://en.wikipedia.org/wiki/Performance_measu rement http://www.bucknell.edu/Documents/Engineerin g/JoshShaffer-thesis.pdf http://www.cse.wustl.edu/~jain/cse56708/ftp/db/index.html www4.cs.fau.de/TR/pdf/TR-I4-94-14 http://en.wikipedia.org/w/index.php?search=Perf ormance+measurement+monitoring&title=Speci al%3ASearch
Questions?