Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 28 hours
Course Outline
Introduction
- What is CUDA?
- Comparing CUDA, OpenCL, and SYCL
- Overview of CUDA features and architecture
- Setting up the Development Environment
Getting Started
- Creating a new CUDA project using Visual Studio Code
- Exploring the project structure and files
- Compiling and running the program
- Displaying output using printf and fprintf
CUDA API
- Understanding the role of the CUDA API in host programs
- Using the CUDA API to query device information and capabilities
- Using the CUDA API to allocate and deallocate device memory
- Using the CUDA API to copy data between host and device
- Using the CUDA API to launch kernels and synchronize threads
- Using the CUDA API to handle errors and exceptions
CUDA C/C++
- Understanding the role of CUDA C/C++ in device programs
- Writing kernels in CUDA C/C++ that execute on the GPU and manipulate data
- Using CUDA C/C++ data types, qualifiers, operators, and expressions
- Using CUDA C/C++ built-in functions, such as math, atomic, and warp operations
- Using CUDA C/C++ built-in variables, such as threadIdx, blockIdx, and blockDim
- Using CUDA C/C++ libraries, such as cuBLAS, cuFFT, and cuRAND
CUDA Memory Model
- Understanding the differences between host and device memory models
- Using CUDA memory spaces, including global, shared, constant, and local
- Using CUDA memory objects, such as pointers, arrays, textures, and surfaces
- Using CUDA memory access modes, such as read-only, write-only, and read-write
- Using the CUDA memory consistency model and synchronization mechanisms
CUDA Execution Model
- Understanding the differences between host and device execution models
- Using CUDA threads, blocks, and grids to define parallelism
- Using CUDA thread functions, such as threadIdx, blockIdx, and blockDim
- Using CUDA block functions, such as __syncthreads and __threadfence_block
- Using CUDA grid functions, such as gridDim, gridSync, and cooperative groups
Debugging
- Identifying common errors and bugs in CUDA programs
- Using the Visual Studio Code debugger to inspect variables, set breakpoints, and view the call stack
- Debugging CUDA programs on Linux using CUDA-GDB
- Detecting memory errors and leaks using CUDA-MEMCHECK
- Debugging and analyzing CUDA programs on Windows using NVIDIA Nsight
Optimization
- Understanding factors that impact CUDA program performance
- Applying CUDA coalescing techniques to enhance memory throughput
- Using CUDA caching and prefetching techniques to minimize memory latency
- Optimizing memory access and bandwidth using CUDA shared and local memory techniques
- Measuring and improving execution time and resource utilization through CUDA profiling and associated tools
Requirements
- Proficiency in C/C++ and an understanding of parallel programming concepts
- Foundational knowledge of computer architecture and memory hierarchy
- Familiarity with command-line tools and code editors
Audience
- Developers seeking to learn how to program NVIDIA GPUs with CUDA and leverage their parallelism
- Developers aiming to write high-performance, scalable code that runs across various CUDA devices
- Programmers interested in exploring the low-level aspects of GPU programming to optimize code performance