HPC-II: Advanced Topics in HPC
ISC5319 / CIS5930-1

Introduction

This course is a series of lectures on advanced topics in high-performance parallel computing. High-performance computing refers to the use of (parallel) supercomputers and computer clusters, and everything from software to hardware to speed up computations. In this course you will learn how to use advanced computing hardware and software. Topics include vector (SSE and GPU) programming, parallel I/O, graph partitioning methods, grid and internet computing, parallel programming models, parallel algorithm complexity analysis, and advanced programming tools.

Syllabus

Synopsis
ISC5919/CSI5930-1, Spring 2009, 3 hr, letter grade, TR 2:00-3:15 PM, 152DSL
Course Web Site
http://www.cs.fsu.edu/~engelen/courses/HPC-adv
Instructor
Professor Robert van Engelen
engelen at cs dot fsu dot edu
160LOV
645-0309.
When and Where?
Tuesday and Thursday from 2:00 AM to 3:15 AM in room 152DSL.
Office Hours
Tuesday 11:00 AM and upon request.
Intended Audience
Graduate students.
Prerequisites
High-Performance Computing (HPC) ISC5918. A parallel programming course is allowed as a substitute.
Material
Class handouts.
Ealuation and Grading
There will be two exams (one midterm exam and one final exam), a set of laboratory projects, and homework exercises. More details on the grading policy, grade breakdown, and exam material can be found on the exam page. Exam dates are scheduled in advance. A grade of zero will be recorded for missed exams unless prior arrangements have been made.
Assignments
Homework and programming projects will be assigned on a regular basis. All assignments are mandatory and part of the final grade. The assignments, when turned in before or at the due date before midnight will be graded. When turned in late, 5% will be deducted from the homework grade per day until the homework has been received, with a maximum extension of five days.
Attendance policy
Partial credit will be given for attendence. For excused absences, see here.
Cheating
All exams and assignments must be completed individually, unless stated otherwise. Copying solutions is considered cheating. Submitted source code listings will be compared. Keep a copy of the listings to provide evidence of creative work. Students are expected to uphold the Honor Code. Any student involved in cheating is in violation of the Honor code. Consult the "Student Handbook" for more details on the Honor code.

Computer Accounts

You will need an account to log on to the SC department's (formerly SCS) machines. If you don’t have one then please contact the instructor to request access.

You will also need an ACNS account (i.e., @garnet.fsu.edu) for receiving class emails. If you want, you can forward your garnet email to other accounts (visit https://cars.acns.fsu.edu for more details).

Schedule

The tentative schedule is shown below (refresh this page if necessary).

Date Lectures Resources Assignments due
1/6 Welcome and Introduction - -
1/8 Parallel I/O [PDF] [SRC] Ch.11 -
1/13 -
1/15 Graph Partitioning for High-Performance Scientific Simulations [PDF] [SRC] Ch.18 -
1/20 -
1/22 -
1/27 Advanced Restructuring Compilers [PDF] [Wolfe] Ch.5, 7-9 -
1/29 -
2/3 -
2/5 -
2/10 -
2/12 -
2/17 -
2/19 -
2/24 Floating Point Operations and Streaming SIMD Extensions [PDF] [Gerber]
[Bik]
[Goldberg]
[SSE reference]
-
2/26 -
3/3 -
3/5 Project 1
3/10 Spring Break no class -
3/12 -
3/17 Review - -
3/19 Midterm exam - exam [PDF]
3/24 SSE Programming SSE examples -
3/26 Special topic: Chains of Recurrences Algebra and Loop Optimizations - -
3/31 Special topic: SSE Vectorization of Chains of Recurrences for Math Function Acceleration - -
4/2 No class - -
4/7 Parallel Models and Algorithms: PRAM [PDF] [JaJa] HW1
4/9 -
4/14 -
4/16 Grid Computing and Services Computing Various -
4/21 HW2
4/23 Project 2
4/27 Final Exam 10:00 - 12:00 noon - -

Resources:

Attendance

Excused absences include documented illness, deaths in the immediate family and other documented crises, call to active military duty or jury duty, religious holy days, and official University activities. Accommodations for these excused absences will be made and will do so in a way that does not penalize students who have a valid excuse. Consideration will also be given to students whose dependent children experience serious illness.

Academic Honor Policy

The Florida State University Academic Honor Policy outlines the University’s expectations for the integrity of students’ academic work, the procedures for resolving alleged violations of those expectations, and the rights and responsibilities of students and faculty members throughout the process.  Students are responsible for reading the Academic Honor Policy and for living up to their pledge to “. . . be honest and truthful and . . . [to] strive for personal and institutional integrity at Florida State University.”  (Florida State University Academic Honor Policy, found at http://dof.fsu.edu/honorpolicy.htm.)

ADA

Students with disabilities needing academic accommodation should:
(1) register with and provide documentation to the Student Disability Resource Center; and
(2) bring a letter to the instructor indicating the need for accommodation and what type. This should be done during the first week of class.

This syllabus and other class materials are available in alternative format upon request.

For more information about services available to FSU students with disabilities, contact the:

Student Disability Resource Center
97 Woodward Avenue, South
108 Student Services Building
Florida State University
Tallahassee, FL 32306-4167
(850) 644-9566 (voice)
(850) 644-8504 (TDD)
sdrc@admin.fsu.edu
http://www.disabilitycenter.fsu.edu/


Copyright: Robert van Engelen, Florida State University, 2008-2009.
Last modified: Saturday, April 11, 2009