Teaching Assistant: Michael Hall, Bryan 405G, mhall24@wustl.edu
Office Hours: Thursday/Friday 2PM-3PM
All question about the homeworks and mid-term exams 1 and 2 grading should be directed to TA.
Course Description (Revised):
Formerly CS 557M.
Comparing systems using measurement, simulation, and queueing models. Common mistakes and how to avoid them, selection of techniques and metrics, art of data presentation, summarizing measured data, comparing systems using sample data, introduction to experimental design, fractional factorial designs, introduction to simulation, common mistakes in simulations, analysis of simulation results, random number generation, random variate generation, commonly used distributions, introduction to queueing theory, single queues, and queueing networks. The techniques of the course can be used to analyze and compare any type of systems including algorithms, protocols, network, or database systems.
Students do a project involving application of these techniques to a problem of their interest.
Prerequisites:CSE 131 or CSE 126 or their respective equivalents. CSE 280 is not required. If you have any questions about the prerequisites, please feel free to see the instructor or discuss in the first session. Some knowledge of probability theory is helpful.
Credits:3 Units.
Time:Monday-Wednesday 1:00PM-2:30PM, Lopata 101
Text Book:Raj Jain, "
The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling," Wiley-Interscience, New York, NY, April 1991, ISBN:0471503363
Please download the errata for the book.
Audio/Video recordings of the previous offerings of this course are available at 2008 and 2006.
For Audio/Video recordings of individual lectures, click the class lecture below.
Tentative Schedule:
Class 1 | Wednesday | 1/19/2011 | Course Introduction | |
Student Questionaire | ||||
Class 2 | Monday | 1/24/2011 | Common Mistakes | Chapter 2 |
Selection of Techniques and Metrics | Chapter 3 | |||
Class 3 | Wednesday | 1/26/2011 | Selection of Techniques and Metrics (Continued) | Chapter 3 |
Types of Workloads | Chapter 4 | |||
Workload Selection | Chapter 5 | |||
Class 4 | Monday | 1/31/2011 | Workload Selection (Cont) | Chapter 5 |
Data Presentation | Chapter 10 | |||
Ratio Games | Chapter 11 | |||
Class 5 | Wednesday | 2/2/2011 | Summarizing Measured Data | Chapter 12 |
Class 6 | Monday | 2/07/2011 | Summarizing Measured Data (Cont) | Chapter 12 |
Exercise 12.15 data (right click and save) | Chapter 12 | |||
Comparing Systems Using Random Data | Chapter 13 | |||
Class 7 | Wednesday | 2/09/2011 | Comparing Systems Using Random Data (Cont) | Chapter 13 |
Exercise 13.2 Data (right click and save) | Chapter 13 | |||
Exercise 13.3 Data (right click and save) | Chapter 13 | |||
Simple Linear Regression Models | Chapter 14 | |||
Exercise 14.7 Data (Right click and save) | Chapter 14 | |||
Class 8 | Monday | 2/14/2011 | Simple Linear Regression Models (Cont) | Chapter 14 |
Other Regression Models | Chapter 15 | |||
Class 9 | Wednesday | 2/16/2011 | Other Regression Models (Cont) | Chapter 15 |
Class 10 | Monday | 2/21/2011 | Mid-Term Exam 1 | |
Class 11 | Wednesday | 2/23/2011 | Other Regression Models (Cont) | Chapter 15 |
Project Guidelines | ||||
Class 12 | Monday | 2/28/2011 | Experimental Designs | Chapter 16 |
2k Experimental Designs | Chapter 17 | |||
Class 13 | Wednesday | 3/2/2011 | Factorial Designs with Replication | Chapter 18 |
Class 14 | Monday | 3/7/2011 | Factorial Designs with Replication | Chapter 18 |
Fractional Factorial Designs | Chapter 19 | |||
Class 15 | Wednesday | 3/09/2011 | One Factor Experiments | Chapter 20 |
Two Factor Full Factorial Design w/o Replications | Chapter 21 | |||
Monday | 3/14/2011 | WUSTL Spring Break (No Classes) | ||
Wednesday | 3/16/2011 | WUSTL Spring Break (No Classes) | ||
Class 16 | Monday | 3/21/2011 | Two Factor Full Factorial Designs with Replications | Chapter 22 |
General Full Factorial Designs | Chapter 23 | |||
Introduction to Queueing Theory | Chapter 30 | |||
Class 17 | Wednesday | 3/23/2011 | Introduction to Queueing Theory (Cont) | Chapter 30 |
Analysis of Single Queue | Chapter 31 | |||
Class 18 | Monday | 3/28/2011 | Mid-Term Exam 2 | |
Class 19 | Wednesday | 3/30/2011 | Queueing Networks | Chapter 32 |
Class 20 | Monday | 4/04/2011 | Operational Laws | Chapter 33 |
Mean-Value Analysis | Chapter 34 | |||
Class 21 | Wednesday | 4/06/2011 | Mean-Value Analysis (Cont) | Chapter 34 |
Project Report Review Form (right click and save) | ||||
Class 22 | Monday | 4/11/2011 | Introduction to Simulation | Chapter 24 |
Class 23 | Wednesday | 4/13/2011 | Introduction to Simulation (Cont) | Chapter 24 |
Analysis of Simulation Results | Chapter 25 | |||
Class 24 | Monday | 4/18/2011 | Analysis of Simulation Results (Cont) | Chapter 25 |
Class 25 | Wednesday | 4/20/2011 | Random Number Generation | Chapter 26 |
Class 26 | Monday | 4/25/2011 | Random Number Generation (Cont) | Chapter 26 |
Random Variate Generation | Chapter 28 | |||
Class 27 | Wednesday | 4/27/2011 | Random Variate Generation | Chapter 28 |
Testing Random Number Generators | Chapter 27 | |||
Class 28 | Monday | 5/02/2011 | Final Exam |
Student Project Reports:
Performance Analysis based on two Leading Cloud Computing Platforms Google App Engine and Amazon Web Service
Availability and Sensitivity Analysis of Smart Grid Components
A Survey of Performance Modeling and Analysis Issues in Resource Management Across x86-based Hypervisors in Enterprise Cloud Computing Deployments
Fundamentals of Image Sensor Performance
Performance of Alternative Topologies for Solving Laplace's Equation using Auto-Pipe
Overview of Performance Measurement and Analytical Modeling Techniques for Multi-core Processors
Performance Measurement of Content Distribution in Named Data Networking
A Measurement Study of Packet Reception using Linux
A Survey of Robotics Systems and Performance Analysis
A Survey of Latest Performance, Development and Measurement Issues of Smart Phones Design
An Overview of the Analysis of Online Social Networks
A Measurement Study on the BitTorrent File Distribution System
A Survey of Wireless Sensor Network Simulation Tools
Grading:
Exams: 60%
Homeworks: 15%
Project: 20%
Class participation: 5%