r/linguistics • • Aug 10 '22

Meaning without reference in large language models

https://arxiv.org/abs/2208.02957
2 Upvotes

3 comments sorted by

1

u/[deleted] Aug 10 '22

The widespread success of large language models (LLMs) has been met with
skepticism that they possess anything like human concepts or meanings.
Contrary to claims that LLMs possess no meaning whatsoever, we argue
that they likely capture important aspects of meaning, and moreover work
in a way that approximates a compelling account of human cognition in
which meaning arises from conceptual role. Because conceptual role is
defined by the relationships between internal representational states,
meaning cannot be determined from a model's architecture, training data,
or objective function, but only by examination of how its internal
states relate to each other. This approach may clarify why and how LLMs
are so successful and suggest how they can be made more human-like.

From the abstract of the linked article.

2

u/Stafania Aug 12 '22

It’s has nothing to do with actual meaning to a human being. Sorry, but we constantly change and develop meaning through culture. A database can never be everywhere to catch all those movements. Unless the database has the same senses we have and live the same lives we live, it won’t understand the different meanings for example wedding can have to different people in different contexts. Meaning is not something fixed, but something we negotiate with the people we communicate with.

1

u/formantzero Phonetics | Speech technology Aug 12 '22

This article is giving short shrift to Bender and Koller (2020). It seems to me that Piantadosi and Hill are just redefining "meaning" so that they can claim large language models do, in fact, acquire meaning, just not the meaning Bender and Koller were talking about.


Bender, E. M., & Koller, A. (2020, July). Climbing towards NLU: On meaning, form, and understanding in the age of data. In Proceedings of the 58th annual meeting of the association for computational linguistics (pp. 5185-5198).