View Single Post
Old 2021-09-17, 14:56   #41
frmky
 
frmky's Avatar
 
Jul 2003
So Cal

1000101100102 Posts
Default

Quote:
Originally Posted by Xyzzy View Post
Our system has a single GPU. When we are doing compute work on the GPU the display lags.
CUDA doesn't allow display updates while a kernel is running. The only way to improve responsiveness without using a second GPU is to shorten the kernel run times. The longest kernel is the SpMV, and you can shorten that by lowering block_nnz. Use the lowest value that still allows everything to fit in GPU memory.

Edit: Lowering VBITS will also reduce kernel runtimes, but don't go below 128. See the benchmark a few posts above. Also, you can't change VBITS in the middle of a run. You would need to start over from the beginning. You can change block_nnz during a restart.

Last fiddled with by frmky on 2021-09-17 at 15:40
frmky is offline   Reply With Quote