Core concept
cudaDeviceEnablePeerAccess. Then normal pointers work across GPUs.
Advertisement
How it works
Requires topology support. Not all GPUs peer-connected. Check via cudaDeviceCanAccessPeer.
Advertisement
Trade-offs + gotchas
Multi-GPU algorithms. Model parallelism. Communication-heavy patterns.