Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Lecture 1
TTH 03:30AM-04:45PM
Dr. Jianjun Hu
http://mleg.cse.sc.edu/edu/csce569/
4 Homework
Use CSE turn-in system to submit your Homework
(https://dropbox.cse.sc.edu)
Deadline policy
1 Midterm Exam (conceptual understanding)
1 Final Project (deliverable to your future employer!)
Teamwork
Implementation project/research project
TA: No TA.
CSCE569 Course Information
Textbook and references
Parallel Programming: for Multicore and Cluster Systems
By:Thomas Rauber (Author), Gudula Rünger (Author)
Publisher: Springer; 1st Edition. edition (March 10, 2010)
Good reference book: Parallel Programming in C with
MPI and OpenMP
by Michael J. Quinn
Most important information sources: Slides.
Grading policy
4 homeworks, 1 midterm, 1 final project, in-class participation
About Your Instructor
Dr. Jianjun Hu (jianjunh@cse.sc.edu)
Office hours: TTH 2:30-3:20PM or Drop by any time
Office Phone#: 803-7777304 3A66 SWNG
Background:
Mechanical Engineering/CAD
Machine learning/Computational intelligence/Genetic
Algorithms/Genetic Programming (PhD)
Bioinformatics and Genomics (Postdoc)
Multi-disciplinary just as parallel computing app.
Outline
Motivation
Modern scientific method
Evolution of supercomputing
Modern parallel computers
Seeking concurrency
Data clustering case study
Programming parallel computers
Why You are Here?
Use Supercomputers
Engineering
Science
Business
Game
Cloud-computing
What This course can do for You?
Understanding of parallel computer architectures
Developing parallel programs for both clusters and shared
memory multi-core system MPI/OpenMP
Know basics of CUDA programming
Learn to do performance analysis of parallel programs
Definitions
Parallel computing
Using parallel computer to solve single problems faster
Parallel computer
Multiple-processor/core system supporting parallel
programming
Parallel programming
Programming in a language that supports concurrency
explicitly
Classical Science
Nature
Observation
Physical
Theory
Experimentation
Modern Scientific Method
Nature
Observation
Numerical Physical
Theory
Simulation Experimentation
Evolution of Supercomputing
World War II
Hand-computed artillery tables
Need to speed computations
ENIAC
Cold War
Nuclear weapon design
Intelligence gathering
Code-breaking
Supercomputer
General-purpose computer
Solves individual problems at high speeds, compared with
contemporary systems
Typically costs $10 million or more
Traditionally found in government labs
Commercial Supercomputing
Started in capital-intensive industries
Petroleum exploration
Automobile manufacturing
Other companies followed suit
Pharmaceutical design
Consumer products
CPUs 1 Million Times Faster
Faster clock speeds
Greater system concurrency
Multiple functional units
Concurrent instruction execution
Speculative instruction execution
Systems 1 Billion Times Faster
Processors are 1 million times faster
Combine thousands of processors
Parallel computer
Multiple processors
Supports parallel programming
Parallel computing = Using a parallel computer to execute a
program faster
Beowulf Concept
NASA (Sterling and Becker)
Commodity processors
Commodity interconnect
Linux operating system
Message Passing Interface (MPI) library
High performance/$ for certain applications
Computing speed of supercomputers
Projected Computing speed of
supercomputers
Top 10 Supercomputers 2010.11
GPU
What you can use
Hardware
Multicore chips (2011: mostly 2 cores and 4 cores, but
doubling) (cores=processors)
Servers (often 2 or 4 multicores sharing memory)
Clusters (often several, to tens, and many more servers not
sharing memory)
Supercomputer at USC CEC
Supercomputers at USC CEC