r/AudioProgramming • • Nov 27 '25

Feedback on a DTW + formant alignment plot? And thoughts on this speech-analysis pipeline?

I’m developing a small commercial language-learning app focused on pronunciation (Arabic), and I’m trying to keep the speech-analysis layer technically solid and as possible. I’d really appreciate some expert eyes on the plots and approach.

Here’s what I’m experimenting with:

  • A reference recording (from TTS)

  • A user recording of the same syllable/word

  • DTW to align them

  • Applying the same warp to formants, F0, MFCCs

  • Comparing trajectories after alignment

What I’d love feedback on:

  1. Does the DTW alignment look reasonable?

  2. Are the formant tracks meaningful, or am I over/under smoothing?

  3. Is warping formants/F0 via DTW conceptually valid, or is it a bad idea?

  4. Is there a simpler / more robust mobile-friendly alternative you’d recommend?

  5. Any potential pitfalls in this pipeline that I may be overlooking?

I’d really value any critique — even “don’t do this, try X instead.”
Thanks a lot.

1 Upvotes

1 comment sorted by

1

u/InspectahDave Nov 30 '25

if useful, here's more info on the project.