Introduction to parallel algorithm. Parallel processing terminology:- contrasting pipelining & data
parallelism. Control parallelism, scalability, sieve of eratosthens control:- parallel approach , data
parallel approach, data parallel approach with I/o.
PRAM algorithms:- a model of serial computation . PRAM model of parallel computation , PRAM
Processors arrays, Multiprocessors & Multi-computers:- processors organization, processor arrays,
multiprocessors, multi-computers. Flynn’s taxonomy, speedup, scaled speedup and parallelizability.
Parallel programming languages:- programming parallel processors. FORTRAN 90. C* SEQUENT
C, Ncube C, OCCAM, C-LINDA. Notation for expressing parallel algorithms. Mapping &
scheduling:- mapping data to processors on processors arrays &multi-computers. Dynamic load
balancing on multi computers static scheduling on UMA multiprocessors.
Elementary parallel algorithms:- classifying MIMD algorithm, reduction :- hypercube SIMD model,
shuffle exchange SIMD model, 2-d mesh SIMD model, UMA multiprocessor model.
Matrix multiplication:- sequential matrix multiplication, algorithm for processors arrays:- algorithm
for multiprocessors, algorithm for multi-computers.
Introduction to fast Fourier transform, discrete Fourier transform:- inverse discrete Fourier
transform, sample application.
Parallel processing, Parallel Computers structures,
Designing of parallel algorithms, analyzing algorithm, general principles of parallel computing,
parallel sorting algorithms Batcher’s bitonic sort. Bitonic sort using the perfect shuffle, parallel
bubble sort, add-even transport, Tree sort, quick sort, sorting on the CRCW, CREW, EREW models.
Searching a sorted sequence, CREW, CRCW & EREW searching, searching on a random sequence
EREW, ERCW, CREW & CRCW searching on SIMD computers, searching on a tree, mesh, A
Network for merging, merging on the CREW, ERFW models, Computing Fourier Transforms,
computing the DFT in parallel, a parallel FFT algorithm.
1. Design & analysis of parallel algorithm by Salim & Akl, PIII(International Editions)
2. Design Efficient Algorithm for parallel computers by Michel J. Quinn, Mc GRAW-Hill,