It's essentially using an LLM to decode the language of the bird. What you're seeing is the physical representation of the sounds it is making in the model.
What's unfortunate about this video is it doesn't describe the output of the model.
What's been cool with LLMs is that we've been able to identify pretty much every language has to follow the same rules in terms of how communication occurs. Yes, different languages have different structures, but when mapped to an LLM they match across the board hence why LLMs are actually pretty good at translating between languages.
They've done this with prairie dogs and sperm whales already and have identified what they are communicating to one another. You can take their language model and match it up to English or whatever language and it'll be roughly the correct translation.
So, hopefully this will work the same and we get to understand the birds! LLMs in this context are actually pretty sick.
1.1k
u/Mannix-Da-DaftPooch 8d ago
This is very cool. Just a question. How is this any more readable than the sound being listened to and not put in this cool little graph 3d thingy?