Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Advantages of Multiprocessors
Able to create powerful computers by
simply connecting multiple processors performance single processor
4 Decades of Computing
IBM System/360 mainframe dominated the corporate computer centers (10 MB disk, 1 MB magnetic core memory) Typical batch processing machine No connection beyond the computer room
Specialists Text, numbers Access Kbd & CRT Edit Peripheral cable Divisional IS shops
Current Trends
The substitution of expensive and specialized parallel machines by the more cost-effective clusters of workstations
A pervasiveness of the Internet created interest in network computing and more recently in grid computing
Grids are geographically distributed platforms of computation - dependable, consistent, pervasive, and less expensive access to HPC facilities
instruction data
CPU
fetch
Memory
execute
(manipulate data as programmed)
Single Instruction
Multiple Instruction
Single Data
SISD
MISD
Multiple Data
SIMD
MIMD
SIMD Architecture
time
P1
P2
Pn
MIMD Architecture
Instruction Stream Control Unit-1 Instruction Stream P1 Data Stream M1
Data Stream Mn
time
P1
P2
Pn
each element in the processor array is identical to one another and performs operation on different data in sync front-end can access PEs memory via the bus
SIMD Congurations
Control Unit P1 P2 P3 Pn-1 Pn
M1
M2
M3
Mn-1
Mn
Interconnection Network
Control Unit
P1
P2
P3
Pn-1
Pn
Interconnection Network
M1
M2
M3
Mn-1
Mn
ILLIAC IV
Control Unit
P1
P2
P3
Pn-1
Pn
M1
M2
M3
Mn-1
Mn
Interconnection Network
MIMD Architecture
M M M M Interconnection Network P P P P
Interconnection Network
Interconnection Network P P P P P P P P
Interconnection Network
Commercial examples of SMPs are Sequent Computers Balance and Symmetry, Sun Microsystems multiprocessor servers, and Silicon Graphics Inc. multiprocessor servers. P P P P A message passing system (also referred to as distributed memory) typically combines the local memory and processor at each node of the interconnection network. M M M M There is no global memory, so it is necessary to move data from one local memory to another by means of message passing. This is typically done by a Send/Receive pair Message Passing MIMD Architecture of commands, which must be written into the application software by a programmer. Figure 1.6 Shared memory versus message passing architecture. Thus, programmers must learn the message-passing paradigm, which involves data copying and dealing with consistency issues. Commercial examples of message passing architectures c. 1990 were the nCUBE, iPSC/2, and various Transputer-based systems. These systems eventually gave way to Internet connected systems whereby Commercial examples of SMPs are Sequent Computers Balance and Symmetry, the processor/memory nodes were either Internet servers or clients on individuals Sun Microsystems multiprocessor servers, and Silicon Graphics Inc. multiprocessor
MIMD Architecture
P
Interconnection Network
Interconnection Network
MIMD Architecture
Interconnection Network
also known as distributed memory no global memory using message passing to move data from one to another (Send/Recieve Figure 1.6 pair of commands)
Interconnection Network
this architecture give Commercial examples of SMPs are Sequent Computers Balance and Symm Sun Microsystems multiprocessor servers, and Silicon Graphics Inc. multiproc way to Internet servers. A message passing system (also referred to as distributed memory) typically connected systems bines the local memory and processor at each node of the interconnection net
There is no global memory, so it is necessary to move data from one local mem
MIMD Architecture
M M M M Interconnection Network P P P P
Interconnection Network
Interconnection Network P P P P P P P P
Interconnection Network
Commercial examples of SMPs are Sequent Computers Balance and Symmetry, Sun Microsystems multiprocessor servers, and Silicon Graphics Inc. multiprocessor servers. P P P P A message passing system (also referred to as distributed memory) typically combines the local memory and processor at each node of the interconnection network. M M M M There is no global memory, so it is necessary to move data from one local memory to another by means of message passing. This is typically done by a Send/Receive pair Message Passing MIMD Architecture of commands, which must be written into the application software by a programmer. Figure 1.6 Shared memory versus message passing architecture. Thus, programmers must learn the message-passing paradigm, which involves data copying and dealing with consistency issues. Commercial examples of message passing architectures c. 1990 were the nCUBE, iPSC/2, and various Transputer-based systems. These systems eventually gave way to Internet connected systems whereby Commercial examples of SMPs are Sequent Computers Balance and Symmetry, the processor/memory nodes were either Internet servers or clients on individuals Sun Microsystems multiprocessor servers, and Silicon Graphics Inc. multiprocessor
programming is easier
provided scalability
DSM
memory is physically distributed [message
passing]
and behaves like a shared memory machine, but a message passing architecture lives underneath the software
SGI Origin2000
SIMD
Control Unit
Control Unit
P1
P2
P3
Pn-1
Pn
P1
P2
P3
Pn-1
Pn
M1
M2
M3
Mn-1
Mn
Interconnection Network
Interconnection Network
M1
M2
M3
Mn-1
Mn
SIMD
Control Unit
Control Unit
P1
P2
P3
Pn-1
Pn
P1
P2
P3
Pn-1
Pn
M1
M2
M3
Mn-1
Mn
Interconnection Network
Interconnection Network
M1
M2
M3
Mn-1
Mn
Interconnection Network
MIMD
P
Interconnection Network P P P P P P P
scalable - the number of processors can be increased without signicant decrease in efciency of operation
Interconnection Networks
Mode of Operation
Synchronous
Asynchronous does not require a global clock handshaking signals are used
Sync tends to be slower than async, sync is race and hazard-free, however.
Control Strategy
Control Strategy
The function and reliability of the central
the multistage interconnection networks are decentralized control unit can become the bottleneck in a centralized control system
Switching Techniques
circuit switching
a complete path has to be established and remain existence during the whole communication
packet switching communication takes place via messages that are divided into smaller entities (packets) packets travel in a store-and-forward manner
While packet s/w tends to use resources more efciently, it suffers from variable packet delays
Topology
Topology describes how to connect
processors and memories to other processors and memories
switch-based
C
Global Memory
P P C C
C P
C P
C
P C
P
M M M M
Static INs
Linear Array
Ring
Mesh
Tree
Hypercube
Dynamic INs
Establish a connection between two or
more nodes on the y as messages are routed along the links
to destination node is equal to the number of point-to-point links a message must traverse to reach its destination
Single-stage
Multiple-stage
Crossbar switch