Skip to main content
Skip header
Terminated in academic year 2003/2004

Parallel algorithms

Type of study Master
Language of instruction Czech
Code 456-0089/01
Abbreviation PAL
Course title Parallel algorithms
Credits 4
Coordinating department Department of Computer Science
Course coordinator RNDr. Ondřej Jakl, CSc.

Subject syllabus

Lectures:


Introduction. Motivation and historical remarks. Basic concepts. Assumed knowledge.

Parallel computer systems. Flynn's classification. Interconnection subsystems.
Examples of state-of-the-art (super-)computers.

Loosely coupled multiprocessors. Computer networks and massively parallel systems. IBM
RS/6000 Scalable Powerparallel System (SP). Introduction to the AIX operating system.

Parallel programming models. The message passing model. Design of a parallel algorithm: decomposition
(functional, domain), communication analysis, agglomeration, mapping to processors. Examples.

Evaluation of parallel algorithms. Speedup, efficiency, cost. Amdahl's law. Scalability.

Parallel Virtual Machine (PVM). Basic characteristics. Application programming interface. Example.

PVM (continued). Overview of library routines: process control, information retrieval, message passing,
etc.

PVM (continued). Collective communication. Debugging issues. Visualization of a parallel execution
(XPVM).


Parallel Environment for AIX (PE). Parallel Operating Environment (POE). Another SP tools.

Selected parallel algorithms. Graph algorithms, sorting and other applications.

Introduction to the Message Passing Interface (MPI). Comparison with PVM, advanced features.

Alternatives to the message passing. Programming of symmetric multiprocessors.
Support of parallelism in programming languages. High Performance Fortran.

Parallelization of sequential algorithms. Examples from the field of numerical computations.

Review. Future trends.

Literature

I. Foster: Designing and building of parallel programs. Addison-Wesley, 1995
Standardization documentation related to MPI, OpenMP, etc.

Advised literature

No advised literature has been specified for this subject.