21-March-2022 |
1.5 hours |
Distributed systems and types |
|
|
|
1.5 hours |
Parallel computing in distributed systems |
|
|
28-March-2022 |
1.5 hours |
Asynchronous communication/computation |
|
|
|
1.5 hours |
Synchronous communication/computation |
|
|
4-April-2022 |
1.5 hours |
Transactions in distributed data stores and types |
Quiz # 1 |
|
|
1.5 hours |
Writeahead Log and serializability in transactions |
Class practice |
|
11-April-2022 |
1.5 hours |
Fault Tolerance and dependable systems |
|
|
|
1.5 hours |
Faults, errors, and failures in distributed systems |
Assignment # 1 |
|
18-April-2022 |
1.5 hours |
Load Balancing and Application Delivery Controller |
|
|
|
1.5 hours |
Flynn's Taxonomy and Computation Models |
|
|
25-April-2022 |
1.5 hours |
Modern CPU and GPU architectures |
|
|
|
1.5 hours |
General Purpose GPUs, Special Purpose GPUs, and IBM Cell Broadband Engine |
|
|
2-May-2022 |
1.5 hours |
AMD and NVIDIA General Purpose GPUs, AMD 7000-series HD7970 and NVIDIA GTX 480 |
|
|
|
1.5 hours |
GPUs development libraries |
|
|
9-May-2022 |
1 Hour |
Mid Term |
|
|
16-May-2022 |
1.5 hours |
Heterogeneity, Goals, and Forms of Hetrogeneity |
|
|
|
1.5 hours |
Parallel Virtual Machine PVM, Fault Tolerance scheme of PVM |
Quiz # 2 |
|
23-May-2022 |
1.5 hours |
Interconnection Topologies, 3D Hypercubes |
|
|
|
1.5 hours |
2D Mesh with 16-Nodes and Direct Memory Access, Diminishing role of topology |
|
|
30-May-2022 |
1.5 hours |
Multicore Programming, Concurrency vs. Parallelism, Types of Parallelism |
|
|
|
1.5 hours |
Parallel Systems, Performance metrics of Parallel systems, Runtime, Speedup, Efficiency, & Cost |
|
|
6-June-2022 |
1.5 hours |
Scalability of Parallel Systems, Amdahl's Law (1967), Gustafson's Law (1988) |
|
|
|
1.5 hours |
Iso-efficiency metrics of Scalability, Sources of Parallel Overhead |
|
|
13-June-2022 |
1.5 hours |
Memory Models, Shared and Distributed, The Message Passing Interface MPI, Sockets interface, primitives |
|
|
|
1.5 hours |
Programming interface, C/C++ MPI program |
|
|
20-June-2022 |
1.5 hours |
MPI C# programming, Communicator namespace, Properties: Size & Rank, Types: World & Self |
Assignment # 2 |
|
|
1.5 hours |
MPI C# Communication between processes, Point-to-point & Collective. |
Quiz # 3 |
|
27-June-2022 |
1.5 hours |
OpenMP models UMA, NUMA, Goals, Essentials |
|
|
|
1.5 hours |
Parallel Programming Models, Data parallel model, Task graph |
|
|
4-July-2022 |
1.5 hours |
Parallel programming model, Work pool, Master slave, producer consumer model, hybrid |
|
|
|
1.5 hours |
Brainstorming scenarios |
|
|
11-July-2022 |
2 Hour |
Final Term |
|
|