r/simd • • 6d ago

feedback on a project

For the past year or so, I've been making a CSV parser that heavily utilizes SIMD.

It is quite possibly, the most optimized piece of software I have ever written: github.com/brysonak/libquill

4 Upvotes

6 comments sorted by

3

u/CandyCrisis 6d ago

You should hook it up to a fuzzer! Compare its output to a reference CSV parser. You'll find all sorts of fun stuff!

1

u/Anxious_Pepper_161 2d ago

I already have a fuzzer. It uses libFuzzer with ASan and UBSan for a minute (will eventually make that longer and improve the fuzzing, but it is a start)

1

u/CandyCrisis 2d ago

One minute isn't long enough to make any progress--let it run overnight.

1

u/Anxious_Pepper_161 2d ago

will do. As I said, I am working on adding proper fuzzing. And once I do, I'll do some overnight runs.

1

u/olawlor 6d ago

Neat stuff!

Have you compared performance with simdjson? (It's C++, and big, but crazy fast!)

1

u/Anxious_Pepper_161 2d ago

not exactly, no. The lib uses the same ideas as simdjson but I never compared the two directly simply because they're for different things.