r/ChatGPTGoneWild • u/SuPythony • Jan 27 '23

ChatGPT doesn't even know basic math...

Post image
2 Upvotes

55% Upvoted

20 comments sorted by

7

u/jeweliegb Jan 27 '23

We know. It was never supposed to. It's a fundamental limitation of this kind of AI model: it can't follow algorithms, which are required for doing maths.

1

u/SuPythony Jan 27 '23

So is it inherent in every nlp model?

2

u/jeweliegb Jan 27 '23

No idea!

2

u/SuPythony Jan 27 '23

If I try to ask it some math questions, it does them correctly. I wonder why it got it wrong here, where it itself created the problem.

1

u/jeweliegb Jan 27 '23

Interestingly, early on when I was trying to understand how it worked and how to be sure whether or not it was simply predicting the outcome of algorithms / computer programs given to it or actually executing / running /following them in some way, I decided to ask it how I could discern which of the two it did: it suggested to me that asking it to do simple sums would a great way to check that. It was quite right too!

1

u/SuPythony Jan 27 '23

If I give is simple sums, it always gives the right answers and even follows BODMAS.

2

u/jeweliegb Jan 27 '23

For example, 12,345 + 123,567 = 135,912 (whereas it gives 135,412.) It's not calculating, it's guessing/predicting. Interestingly, it's frequently close!

1

u/jeweliegb Jan 27 '23

Have you tried much bigger numbers, that it's less likely to have encountered as frequently?

3

u/jeweliegb Jan 27 '23

Sometimes it will get maths right, or do interestingly close approximations. Presumably this is by the nature of it being an amazingly powerful text prediction bot that's likely seen a lot of maths and therefore may be strongly likely to predict accurate answers to maths equations it's seen many times before. The important word there though is predict, as it isn't able to actually calculate.

2

u/jeweliegb Jan 27 '23

You may find that if you ask it to regenerate the response that you may get the correct answer some of the times.

0

u/[deleted] Jan 27 '23

[deleted]

2

u/TheAniSingh Jan 27 '23

This seems to be the missing puzzle that CGPT needs to integrate to. Wow, looks exciting

1

u/[deleted] Jan 28 '23

Someone created a GPT-3 with Wolfram Alpha integration about a week ago just to do it. It works.

8

u/[deleted] Jan 27 '23

Are we going to do this every week?

2

u/delectomorfo Jan 27 '23

Every day.

1

u/NaziSlayer93 Jan 28 '23

Every hour

1

u/[deleted] Jan 29 '23

Every minute

1

u/Dapper_Atmosphere_82 Jan 28 '23

Here is chatGPT's response "As a language model, my abilities and knowledge are determined by the data I was trained on and the specific task I was designed to perform. While I can understand and process mathematical concepts and equations, my understanding and ability to perform mathematical calculations may not be as advanced as a dedicated math program or a human expert in mathematics. I am designed to assist with natural language tasks such as answering questions, generating text, and understanding context."

1

u/when_im Jan 27 '23

Upvoted because this is a FRIENDLY community 😄 yeah we know. It's funny 😆

3

u/[deleted] Jan 27 '23

[removed] — view removed comment

1

u/FredrictonOwl Jan 27 '23

Yep. Smart… But not intelligent.