CIS5930 Advanced Topics in Parallel and Distributed Systems, Spring 2014


This course is supported in part by the Nividia CUDA Teaching center program (See Nvidia press release in May 11, 2011).


Syllabus, Example Programs


Lecture 1

Lecture 2 Lecture 3 Lecture 4 Lecture 5 Lecture 6 Lecture 7

Programming assignment: MPI and CUDA implementation of jacobi, jacobi.c, input.jacobi.. Due date: Feb 14.

Lecture 8

Lecture 9

Lecture 10

Lecture 11: Recent topology and routing proposal for extreme scale systems (Peyman Faizian), slides

Lecture 12: Recent topology and routing proposal for extreme scale systems (Atiqul Mollah and Gaurish Nayak)

Homework 2: Comments on jellyfish topology and routing (summary, advantages, and drawbacks, 1 page max). Due Feb 25.

Lecture 13

Lecture 14: Ethernet development (Jordan Nowlin): 10-Gigabit Ethernet (10GE), 40GE, 100GE, 400GE, RDMA over Converged Ethernet

Lecture 15: SDN and Openflow

Lecture 16: Interconnect Simulation

Lecture 17: Interconnect Modeling

Homework 3: An flow-level event driven network simulator, Software package, due date: April 3.

Term Project Information

Lecture 18 (03/18): Implementation and Optimization of MPI collective communications

Lecture 19 (03/21): Implementation and Optimization of MPI point-to-point communications

Lecture 20 (03/25): A New method for evaluating interconnect design

Lecture 21 (03/27, Nkem Dockery): Challenges in large-scale graph processing on HPC platforms and the Graph500 benchmark

Lecture 22 (04/01, Carlos Sanchez and Soheila): HPC and Cloud Computing, presentation 1, presentation 2

Lecture 23 (04/03, Shafayat and Zach): Architecture-aware communication optimizations, presentation 1, presentation 2

Lecture 24 (04/08, Caitlin): Power, Resilience, and exascale computing 1

Lecture 25 (04/10, Ryan): Power, Resilience, and exascale computing 2

Lecture 26 (04/15, Tong and Abdullah): Power, Resilience, and exascale computing 3

Lecture 27 (04/17) Term project presentation

Lecture 28 (04/22) Term project presentation

Lecture 29 (04/24) Term project presentation

Final exam (take home, open everything, no discussion), Due April 30, 11:59am. Place hardcopy in my office by the due time.

Final Demo Schedule, May 1, Majors lab