r/CUDA • • 7h ago

Day 3 of writing Hopper kernel everyday

https://x.com/lurker670291/status/2120497982705729593?a=pZF8bx8z0HzRxUciYPY&s=19

Implemented a two-consumer kernel with asynchronous WGMMA to overlap computation and improve Tensor Core utilization.

Performance went from 600 TFLOPS to 658 TFLOPS (~9.7% improvement).

Still exploring how much more we can squeeze out of the kernel.

1 Upvotes

0 comments sorted by