Parallel Computing: Lecture 4

Learning objectives

After this class, you should be able to:

1. Explain parallel reduction, allgather, and gather/scatter, using the four-step procedure discussed in class.
2. Analyze the parallel time complexity of reduction, allgather, and gather/scatter in the task/channel model.
3. Given a simple problem, parallelize it using the four-step procedure, and derive its time complexity.

Reading assignment

1. Chapter 3, sections 3.4-3.9.
2. None.

Exercises and review questions

• Questions on current lecture's material
  1. Exercise 3.9 a. Also give the time complexity.
  2. Exercise 3.15.
  3. (Post your solution on the discussion board) Exercise 3.6. Give an example with n = 7.

• Questions on next lecture's material
  1. None.