4
Chapter 10 - Introduction to Parallel processing Fundamental of Computer Architecture High performance computer  Large computing capacity  Required to compute large amount of data in a reasonable amount of time  Often called Supercomputer

11
Chapter 10 - Introduction to Parallel processing Fundamental of Computer Architecture Multiprocessor  Use large number of processor design for workstation or PC market  Has an efficient high bandwidth medium for communication among  the processor  memory  I/O  Provide High performance but cheaper than vector processing

12
Chapter 10 - Introduction to Parallel processing Fundamental of Computer Architecture Distributed computer system  Using many workstation connected by Local area network  Provide large computing capabilities at a reasonable cost

13
Chapter 10 - Introduction to Parallel processing Fundamental of Computer Architecture Multiprocessing performance  Many computation can proceed in parallel  Difficulty:  the application must be broken down into small task that can be assigned to individual processor  Processors must communicate with each other to exchange data

16
Chapter 10 - Introduction to Parallel processing Fundamental of Computer Architecture SIMD  Single Instruction stream, Multiple Data stream  Single stream of instruction is broadcast to a number of processor  Each processor operates on its own data  Each processor has its own memories  All processors executes the same program but operate on different data

18
Chapter 10 - Introduction to Parallel processing Fundamental of Computer Architecture MISD  Multiple Instruction stream, Single Data stream  Common data structure is manipulated by separate processor  Each processor executes a different program  This form does not occur often in practice

19
Chapter 10 - Introduction to Parallel processing Fundamental of Computer Architecture Array processing  Is the SIMD form of parallel processing  Instruction is broadcast from a central processor

20
Chapter 10 - Introduction to Parallel processing Fundamental of Computer Architecture 2 types of Array processing  Use small number of powerful processor  ILLIAC-IV: 64 processors, each processor is 64-bit  Use large number of very simple processor  CM2: processors, each processor is 1-bit  MP-1216: processors, each processor is 4-bit  Gamma II plus: 4096 processors, each processor is 8- bit

21
Chapter 10 - Introduction to Parallel processing Fundamental of Computer Architecture Array processing  Well suited to numerical problem that can be expressed in matrix or vector format

41
Chapter 10 - Introduction to Parallel processing Fundamental of Computer Architecture Parallel programming  Task must be broken down into small task that can be assigned to individual processors at program level  Need operating system support  Different architecture, different programming method