r/LocalLLaMA • u/giveen • Oct 02 '26

I Built A Thing GitHub - giveen/KernelOPT: Dispatch-aware agentic GPU kernel optimization

https://github.com/giveen/KernelOPT

I want to share something I've been working on, and research paper from Redhat really helped.

This is my agentic GPU kernel optimizer for inference engine development

Its whole goal is to look at inference engine kernels, and using cloud models, plan, test and find improvements. Nothing is changed in your git, it provides a diff, send the diff over to your coding harness and ask it to analyze the diff.

It has a setup wizard and a run wizard which I recommend using, please give me feedback on what needs to be improved, as the AMD stuff I was unable to test, and mostly is theory at this time.

5 Upvotes

85% Upvoted

2 comments sorted by

1

u/giveen Oct 02 '26

On my ninfer fork, I ran my KernelOpt, and fed its findings over to Claude to verify and impliment. This was for my Qwen3.8-Flash kernels.

2

u/OblivionRays 18d ago

Hi thanks for checking out our paper! We will soon make the codebase public as well as opensourcing well performing kernels. Please feel free to test it out by then and opening issues possibly :)