IIT Bombay · Mathematics & Statistics

High Performance Scientific Computing

Prof. Shivasubramanian Gopalakrishnan · 77 free video lectures

77 video lectures. Topics: Week 0: Lec 0: Introduction to High Performance Scientific Computing; Week 1: Lecture 1: Introduction to Operating System.; Week 1: Lecture 2: Linux Kernel Explained; Week 1: Lecture 3: Mastering Linux Directory and File Management; Week 1: Lecture 4: Understanding File…

▶ Play on Open Lecture HallCourse page ↗

Lectures

  1. Week 0: Lec 0: Introduction to High Performance Scientific Computing
  2. Week 1: Lecture 1: Introduction to Operating System.
  3. Week 1: Lecture 2: Linux Kernel Explained
  4. Week 1: Lecture 3: Mastering Linux Directory and File Management
  5. Week 1: Lecture 4: Understanding File Permissions and Ownership in Linux
  6. Week 1: Lecture 5: Mastering Linux Text Processing and File Management
  7. Week 1: Lecture 6: Linux Memory and Networking Commands
  8. Week 2: Lecture 1: Understanding Shell Scripting: Parent-Child Processes and User Input Handling
  9. Week 2: Lecture 2: Shell Scripting Tutorial for Beginners
  10. Week 2: Lecture 3: Introduction to High-Performance Computing (HPC) and Its Key Components
  11. Week 2: Lecture 4: Exploring Computing Platform Architecture and CPU Optimization Techniques
  12. Week 2: Lecture 5: Hierarchical Memory Systems and Scalable Architectures in Large-Scale Computing
  13. Week 2: Lecture 6: Concurrency and Synchronization in Parallel Programming:Techniques and Frameworks
  14. Week 3: Lecture 1: Need for Parallel Computing
  15. Week 3: Lecture 2: Role of Numerical Models in Solving complex problems on Computers
  16. Week 3: Lecture 3: Common Challenges with Memory in Computer Architecture
  17. Week 3: Lecture 4: Organization of hardware in Large HPC systems
  18. Week 3: Lecture 5: Architecture of Nvidias Grace Hopper Superchip
  19. Week 3: Lecture 6: Introduction to Shared Memory Programming using OpenMP
  20. Week 4: Lecture 1: Distribution of work using multiple OpenMP Threads
  21. Week 4: Lecture 2: Synchronization and Parallel Loops in OpenMP
  22. Week 4: Lecture 3: Storage attributes of different variables in OpenMP
  23. Week 4: Lecture 4: OpenMP Memory Model, Irregular Parallelism, and Tasks
  24. Week 4: Lecture 5: Parallelization of example codes using OpenMP - Part 1
  25. Week 4: Lecture 6: Parallelization of example codes using OpenMP - Part 2
  26. Week 5: Lecture 1: Introduction to Message Passing Interface (MPI)
  27. Week 5: Lecture 2: Sending and Receiving the messages using MPI
  28. Week 5: Lecture 3: Collective Communication in MPI
  29. Week 5: Lecture 4: Domain Decomposition
  30. Week 5: Lecture 5: Parallelization of example code using MPI
  31. Week 5: Lecture 6: Performance Analysis Frameworks for Parallel Programming
  32. Week 6: Lecture 1: Examples of Collective Communication in MPI: Part 1
  33. Week 6: Lecture 2: Examples of Collective Communication in MPI: Part 2
  34. Week 6: Lecture 3: Introduction to GPU Computing
  35. Week 6: Lecture 4: A Dive into Software Stack and Nvidia Architecture
  36. Week 6: Lecture 5: Comparative Analysis of NVIDIA and Intel GPU Architectures
  37. Week 6: Lecture 6: Understanding FLOPS and Memory Bandwidth Calculations for NVIDIA GPUs
  38. Week 7: Lecture 1: SIMD vs. SIMT: Thread Mapping, Scheduling, and Pipelining in NVIDIA GPUs
  39. Week 7: Lecture 2: Understanding 1D, 2D, and 3D Grid Arrangements Part 1
  40. Week 7: Lecture 3: Understanding 1D, 2D, and 3D Grid Arrangements Part 2
  41. Week 7: Lecture 4: Thread Block Mapping and Warp Scheduling in GPU
  42. Week 7: Lecture 5: Exploring Warp Scheduling and Latency Management in NVIDIA GPUs
  43. Week 8: Lecture 1: An Introduction to GPU Programming: Tools, Techniques, and CUDA Part - 1
  44. Week 8: Lecture 2: An Introduction to GPU Programming: Tools, Techniques, and CUDA Part - 2
  45. Week 8: Lecture 3: Understanding NVIDIA GPU Memory Types and Efficient Memory Management Part 1
  46. Week 8: Lecture 4: Understanding NVIDIA GPU Memory Types and Efficient Memory Management Part 2
  47. Week 8: Lecture 5: Understanding Third Divergence in Parallel Computing and Its Impact on GPU Perf..
  48. Week 8: Lecture 6: Memory Layouts and Their Role in Optimizing Computing Performance
  49. Week 9: Lecture 1: CUDA Program Compilation and Execution: A Step-by-Step Guide Part 1
  50. Week 9: Lecture 2: CUDA Program Compilation and Execution: A Step-by-Step Guide Part 2
  51. Week 9: Lecture 3: Introduction to OpenACC
  52. Week 9: Lecture 4: Parallelization of loops using OpenACC
  53. Week 9: Lecture 5: OpenACC Data Management
  54. Week 9: Lecture 6: OpenACC Loop Optimizations
  55. Week 9: Lecture 7: Implementing Asynchronous behavior in OpenACC
  56. Week 9: Lecture 8: Programming for multiple-device architecture using OpenACC
  57. Week 10: Lecture 1: Profiling and Parallelizing the serial code using OpenACC
  58. Week 10: Lecture 2: Programming for multiple-device architecture using MPI and CUDA
  59. Week 10: Lecture 3: Programming for multiple-device architecture using MPI and OpenACC
  60. Week 10: Lecture 4: Profiling Serial codes using GNU gprof
  61. Week 10: Lecture 5: Profiling and Debugging of the codes using Valgrind
  62. Week 10: Lecture 6: Code Debugging using GDB
  63. Week 11: Lecture 1: Performance Analysis of MPI codes
  64. Week 11: Lecture 2: Parallel Debugging of MPI Programs using Open Source Tools
  65. Week 11: Lecture 3: Role of Numerical Methods in High Performance Scientific Computing
  66. Week 11: Lecture 4: Libraries used in High Performance Scientific Computing
  67. Week 11: Lecture 5: Introduction to HPC Schedulers using SLURM and PBS
  68. Week 11: Lecture 6: Scientific Visualization
  69. Week 12: Lecture 1: Revision and challenges in the future
  70. Week 12: Lecture 2: OpenMP Revision
  71. Week 12: Lecture 3: CUDA Revision
  72. Week 12: Lecture 4: MPI Revision
  73. Week 12: Lecture 5: OpenACC Revision
  74. Week 12: Lecture 6: Heterogeneous Computing
  75. Week 12: Lecture 7: Trends in Microprocessor Architectures
  76. Live Session 28-01-2025
  77. Live Session 07-03-2025

From NPTEL (IITs and IISc) · CC BY-NC-SA. More from IIT Bombay.

Open Lecture Hall is free, with no ads and no sign-up. It is not run by or connected to any university; the lectures are the universities' own free recordings, played from where they host them. About & rights