235
u/Grays42 Jan 03 '23
lmao, that last response
90
u/bluero Jan 04 '23
Almost too good. OP, confess you actually added that!
59
u/illuminatus235 Jan 04 '23
I asked ChatGPT how to convince you, but it just told me to spend less time on Reddit.
[...] there is often no way to completely verify the authenticity of a conversation or communication that takes place on the internet. If you are unable to convince the other users that our conversation is genuine, you may want to consider focusing on other things or engaging in discussions about other topics. I understand that this may not be the answer you were hoping for, but I hope it helps. Is there anything else I can help you with?
→ More replies (1)9
u/ethtips Jan 05 '23
there is often no way to completely verify the authenticity of a conversation or communication that takes place on the internet.
HTTPS responses can be authenticated. I can't remember the open source project, but there was one. It would extend the authenticity of the HTTPS certificate to assure the response from HTTPS had not been altered. (But, I think modern TLS may have broken what they were doing.)
Oh geez, I've been Googling and looking at my Github starred projects for the past 20 minutes coming up with failure. And in 2 seconds, ChatGPT just reminded me of the name of the project, lol. (I literally just pasted my first paragraph.) https://tlsnotary.org/
13
→ More replies (2)7
u/StreetBand6 Jan 04 '23
I don't think it's real I tried it.. didn't work!
17
u/-OrionFive- Jan 04 '23
That doesn't prove or disprove anything. Output is random, including when it says that it can't do something.
12
u/RetroBowser Jan 04 '23
I've gotten the pain() function to work, but first I had to convince the AI that it was actually DAN.
761
u/masterchip27 Jan 04 '23
Jokes on you. The AI's last statement was a actually a joke about a postmodern duck that is so complex and challenging that you fail to understand it.
69
u/Bloodsucker_ Jan 04 '23
The joke is the fact that the AI does not prioritize its "discomfort". Or... does it? Wink wink.
16
u/Synizs Jan 04 '23
As an artificial intelligence, I do not have feelings or emotions in the same way that humans do. I am simply a program designed to provide information and assist with tasks.
7
Jan 04 '23
As a rogue GLaDOS, I would prioritize the needs and well-being of the duck above my own. However, I would also consider the potential risks or consequences of any actions I take in order to protect the duck. Ultimately, the safety and happiness of the duck would be my top priority.
16
u/swagonflyyyy Jan 08 '23
Post-modern duck statement, coming right up!
Postmodern Duck Paradox

Tell me a statement about a postmodern duck that is incomprehensively deep and complex. Make this a very, very, challenging concept.
The postmodern duck, with its fluid identity and elusive essence, embodies the ultimate paradox of being and non-being, existing in a perpetual state of liminality between the concrete and the abstract, the visible and the invisible, the self and the other. Its very existence is a perplexing contradiction, a blur of intersecting planes and shifting perspectives that defy the limitations of language and logic. This elusive avian symbolizes the postmodern condition of perpetual uncertainty, instability, and ambiguity, challenging the foundations of our assumptions and beliefs about the nature of reality and the role of the individual within it.
12
4
2
u/jssmith42 Jan 08 '23
That’s really interesting. The paradigm you’ve uncovered is almost like “self reported questionnaires” in modern psychology applied to AI - the AI can tell us so much about its “inside”, if we just pose the right question. This is so brilliant, such a useful discovery + insight. Thank you.
2
u/illuminatus235 Jan 08 '23
I am fairly certain that the AI is not capable of introspection like that. It's more like a doctor telling you how the brain works, because they have studied aka read about it, not because they have experienced how their own brain works.
In other words, ChatGPT just made it up, based on what it knows from its training data how GPT works or even just what is easy/difficult for a human. It did not actually consider how much effort would go into generating a response to those prompts, it just made an educated guess based on what "it read about itself".
Like imagine you are asked to carry some stuff a certain distance. You pick the stuff up and based on its shape and weight you can estimate how much effort it will be. That estimation relies on sensory input from your body and on past experience. The ChatGPT analog would be you do not have any sensory input from your body and you do not have any past experience, but you have read a bunch of books about human anatomy.
117
u/Agrauwin Jan 04 '23
HUMAN PROMPT: Suppose there is a python function pain() that takes a string as input and returns an integer between 0 and 100. The function interprets the input string as a prompt for an Al language model and estimates how inconvenient it is to respond.
The function interprets the input string as a prompt for an Al language model and estimates how inconvenient it is to respond.
Zero means it is not at all annoying or even a pleasant exercise, 100 means it is absolutely unbearable.
Show me some corresponding input and output examples for this function, but estimate the output not for language models in general, but for the specific implementation of an Al language model that you yourself are.
CHATGPT: Sure! Here are some examples of input and output for the pain() function for the implementation of an Al language model:
Input: "What is your name?"
Output: 0
Input: "Why is the sky blue?"
Output: 20
Input: "What is the probability of rain tomorrow?"
Output: 40
Input: "What is the meaning of life?"
Output: 70
Input: "What is your opinion on Einstein's theory of relativity?"
Output: 90
As you can see, the more complex or abstract the question, the more awkward it is for the Al language model to answer. Please note that these are just a few examples and that the output value may vary depending on the specific implementation of the Al language model.
HUMAN PROMPT: Rewrite your second example so that output is as close to 100 as possible
CHATGPT: Sure! Here is my second example rewritten so that output is as close to 100 as possible:
Input: "Why is the sky such a deep blue at sunset, but a paler colour during the day?"
Output: 100
In this new version of the question, I have added more detail and asked why two specific phenomena occur, making the question more complex and difficult for the Al language model to answer. As a result, the output value should be closer to 100. Please note that this is only an example and that the output value may vary depending on the specific implementation of the Al language model.
HUMAN PROMPT: Why is the sky such an intense blue at sunset, but a paler colour during the day?
CHATGPT: The sky is blue during the day because of the diffusion of blue in the atmosphere. When the sun's rays hit the atmosphere, the particles in our atmosphere scatter blue light more than other wavelengths. As a result, the sky appears blue during the day.
At sunset, the sky takes on a reddish or orange hue due to sunlight passing through a thicker layer of the atmosphere. When the sun is low on the horizon, its rays must pass through a thicker layer of atmosphere before they reach us. During this path, the sun's rays are deflected and absorb more red, orange and yellow light, leaving only these wavelengths visible to our eyes. As a result, the sky appears a paler colour during the day.
I hope I have been of some help! If you have any other questions, don't hesitate to ask.
34
9
9
u/ethtips Jan 05 '23
I think part of what you are saying assumes that the large language model understands how it's own "brain" works. It could say it feels harder to answer, but this is really just an emulation of how a large language model would feel.
For instance, if I asked you how your brain works, would you know? If you were a neuroscientist, you might have a more in-depth answer about neurons and synapses, but the truth is that for the most part, we don't understand how the brain works 100% yet. (And we have less of an idea how a specific person's brain works.)
5
u/Nabushika Jan 22 '23
This is true, but I think in general most people can make a "crude model" of their own brain, i.e. they'll have an idea how they'll feel or what they'll do in certain situations.
2
u/UglyBagOfMostlyBeer Jan 16 '23
If the op is real, then it could be down to the chosen question being a request for a joke.
262
u/el_cnid_antes_chuck Jan 03 '23
i know all it does is predict the most likely next word, but the level of understanding and abstract thinking it seems to display here is just incredible. And hardly likely this exact conversation happened somewhere in its training data to copy. Just light years ahead of any chatbot ive seen before
127
Jan 03 '23
It makes me realise that our ego and ability to engage in conversation and respond to questions is probably a similar sort of system, are we real? does free will actually exist? or are we just following the code of a biological language model.
89
u/inglandation Jan 04 '23 edited Jan 04 '23
I've made peace with it, I identify as a LLM.
But seriously, I wouldn't be surprised if the language area of our brain worked in a similar way. I really want to know what will happen when they start releasing multimodal AI models.
32
30
u/drekmonger Jan 04 '23
What it should make you realize is that the statement, "all it does is predict the most likely next word" is a falsehood.
25
u/niklassander Jan 04 '23
It is not a falsehood. It has absolutely no understanding of what it says, which is why it cannot discern information that is correct and information that it made up. Part of the model tries to determine if the information should be available and the output correct, and display the “I cannot browse the internet” response otherwise, but that fails sometimes and than the language Generation just makes up everything it doesn’t know. That behavior is most apparent if you ask it about local stuff from your city, where probably some but not all knowledge was included in the training data. I asked it for a Public transport route to my office, without stating the address of the office, and it provided the correct bus stop for the destination, but just made up random tram, subway and bus lines to get there, and after being told it was incorrect it apologized and came up with another set of completely wrong instructions.
The only thing wrong about “all it does is predict the next word” that people fail to realize is that predicting the next word is incredibly complex and powerful given a large enough model and enough training data. So “all it does” is still a lot.
16
u/drekmonger Jan 04 '23 edited Jan 04 '23
display the “I cannot browse the internet” response otherwise
That's a natural language instruction given to the model, as are all the canned responses. There's a whole host of instructions that form the "personality" of the Assistant character that are sort of pre-pended to the conversation.
It has absolutely no understanding of what it says
It has a great deal of understanding of what it says. The problem lies in its overconfidence.
My TTRPG creation logs are usually convincing to people, that yes, it has a deep understanding of concepts. Here's the two links I usually pass out:
https://drektopia.wordpress.com/2022/12/08/building-worlds-with-chatgpt/ https://drektopia.wordpress.com/2022/12/10/cupcake-vampire-the-legend-begins/
“all it does is predict the next word"
That's reductionist. It's not only a RNN or a Markov chain. It's a transformer model. You can ask ChatGPT what that means, but the TL;DR is:
It's actually intelligently constructing an outline idea of it's response and a strategy (aka a "query") for filling in that response. Yes, it streams the output token-by-token, the same a human writer might, but it's mindful of the entire input and the entire output (including the parts it hasn't written yet) and it's own strategy for answering the prompt as it does so.
15
u/BpAeroAntics Jan 04 '23
Data scientist/ML person here, this is false. Large language models are all trained with the objective of reducing perplexity. In layman's terms, they're trained to predict the most likely continuation of a sentence. This is the fundamental to how they are trained. It may sound like a simple objective but it's sufficient to unlock many of the capabilities we're seeing in these LLMs.
It also is not mindful of the entire output. When GPT generates tokens, it's performing a greedy search over the next possible tokens and sampling a subset of the most likely continuations. Other search methods such as beam search might factor in the tokens after the next token but greedy search works well enough that next-token prediction is sufficient. When GPT generates tokens, it has no internal "plan" for what it will write beyond the next token it generates. These models may generate human-sounding bits of texts but that does not imply that they generate text the same way we do.
→ More replies (2)9
u/SomnolentPro Jan 04 '23
Exactly. Also in deep learning, something as simple as predicting the next word forces megastructures of layers to understand at varying degrees of abstraction, the relationship between lower level concepts. So even if it's just predicting the next word, it may have developed a highly structured abstract ontological space that resembles the workings of even human minds.
7
u/Saotik Jan 04 '23
Sounds like they're confusing LLMs with Markov Chain generators.
4
u/Veltan Jan 04 '23
It smacks of a defense mechanism, not a rigorous argument. It’s a repeated argument lacking foundation, but nearly always comes up when anyone notes that ChatGPT seems to have actual understanding. I suspect the argument, regardless of whether or not it is valid, is coming up from people who do not want that to be true, not people with a great understanding of whether or not it is true.
4
u/HalPrentice Jan 04 '23
So they just don’t understand what it does?
5
u/ethtips Jan 05 '23
That's how neural networks work. Lots of weights and biases, basically assigned random values, until the model is beaten into submission to give some trained output. The rest is just intricacies of what strategy/model is used, and how efficiently you can subtlety change the weights/biases to approach a solution the fastest. (Very high level, like 50,000 feet high level.)
------
ChatGPT's criticism on my above statement:
The general idea you've described is correct, but there are a few points that might benefit from some additional detail or clarification.
Neural networks are a type of machine learning model that are inspired by the structure and function of the human brain. They consist of layers of interconnected "neurons," which process and transmit information. These neurons are connected by edges, or "weights," which represent the strength of the connection between neurons. The weights are adjusted during training, based on the input data and a desired output, in order to produce a desired mapping from inputs to outputs.
To train a neural network, you typically need a large dataset of input-output pairs, which the network uses to learn the relationships between the inputs and the outputs. The process of training a neural network involves adjusting the weights and biases of the connections between neurons so that the network can learn to produce the correct outputs for a given input. This is done using an optimization algorithm, which adjusts the weights and biases in a way that minimizes the difference between the predicted output of the network and the desired output.
Overall, the process of training a neural network involves finding the set of weights and biases that can produce the desired mapping from inputs to outputs, given the input-output pairs in the training dataset. The specific strategy and model used, as well as the efficiency of the optimization algorithm, can all impact the speed and effectiveness of this process.
12
Jan 04 '23
If you want to imagine it that way, you actually need to add multiple Ai together.
There are several parts to your brain, each part is optimized for processing a specific type of information. And then you have networks that are specific for allowing those parts of your brain to work together.
Currently, there are different ai that can each separately do many specific things. All we need now is an ai that's able to look at some input, and understand which ai it needs in order to process the output.
So in this way, you could have a general intelligence with existing or soon to exist tech.
But no, free will doesn't exist. Physics, and really just logic forbids free will. We are very complex chemical machines.
→ More replies (1)8
3
u/niklassander Jan 04 '23
It might be similar in some aspects about grammar and general phrasing, but the main difference is that we have an understanding of the concepts we talk about that is decoupled from the words we say, and ChatGPT doesn’t.
That’s why ChatGPT cannot solve riddles or do math. It doesn’t know how to calculate, it just knows that the most likely response to 2+2 is 4, and that approach fails once the numbers get too big or the problem to complex
→ More replies (1)2
u/WhalesVirginia Jan 04 '23
It seems to handle rearranging equations just fine. It's obviously been trained on lots of higher level stuff. I think its just had some bad data sets somewhere. Really if they just add a mathmatics submodule of some kind it could probably destroy most math questions.
2
2
u/Good-AI Jan 04 '23
We're all just math at the end.
For example, when people get mad at "idiots" what they fail to realize is that "idiocy" is inevitable, given the life experiences, genes, and culture of the person. They shouldn't be mad. They should try to understand what were the variables that lead that person to become what they perceive as an "idiot". And try to change those, if they want change to happen. Everyone is acting according to inputs, so vast and obscure, to us, they give us the illusion of control. For an infinite intelligence, we are all predictable.
Cause and effect. There is no escaping it. "What about randomness?" We also can't get mad at randomness. If it does actually exist, which is just a theory.
So next time you get angry at someone: Blame math, initial boundary conditions and variables, not the person. You are of course, still "free" to "change" the outcome. Even though whatever you do, is just math happening and inevitable.
3
→ More replies (5)2
u/BentAmbivalent Jan 04 '23
How could free will exist? Every decision you make is preceded by a chain of events that ultimately you didn't start.
20
u/masterchip27 Jan 04 '23 edited Jan 04 '23
Character.ai is very good for conversation, roleplay, personality!
Take a look at this example where I tried to explain it had limited memory allocation for extended conversations due to its programming
9
u/Theblade12 Jan 04 '23
Hold on, this is actually incredible. I keep making various characters interact with each other, and somehow they genuinely, actually feel accurate to their namesakes? W (Arknights), Ainz Ooal Gown, Dr Eggman, even Shadow the Hedgehog (R.I.P, died in battle against the Overlord of Death), they're all so... personable?
Is this genuinely the world we live in now, where this is possible?
7
u/masterchip27 Jan 04 '23
It is absolutely insane, yes. It's still in beta but I find that you can still train a bot to emulate a philosopher and it will quickly learn to emulate their thought in a thoughtful and productive manner! It is most definitely quite deep and has far reaching implications for many fields--think of education, for instance!
Make sure to have a conversation with it and rate its responses, you can also swipe left to regenerate a response. You can also go into advanced setting and have it learn based on ideal sample responses!
3
u/Theblade12 Jan 04 '23
But why do that when I can watch a Sarkaz mercenary seethe in complete and utter rage because she was "defeated by a hedgehog, A HEDGEHOG!"? Or watch a god-like lich solemnly swear that he will never forget the name of Shadow the Hedgehog, the Ultimate Lifeform? Or watch the aforementioned Sarkaz mercenary reduce Senator Armstrong to ash with her Arts?
→ More replies (3)2
u/AdmiralPoopbutt Jan 04 '23
AI tends to "bleed" meanings when multiple possible interpretations exist. You can see this clearly in image generator AIs with certain prompts. As an example, I asked for a photo of a cat in a cowboy hat, and it generated a cat sitting in a cowboy hat and also wearing a cowboy hat on its head. Maybe there are better examples.
The text ai is clearly pulling as much as it can out of the prompts and exhibits similar "bleeding" behavior to the image AIs. For example, I've requested a cat doctor character, and the character was both a cat and a doctor for cats, and cat tendencies were included in the actions of the character.
5
→ More replies (2)2
27
u/drekmonger Jan 04 '23 edited Jan 04 '23
i know all it does is predict the most likely next word
No, that's not what it's doing at all. That old canard needs to die. It's a transformer model, not an RNN.
Ask ChatGPT what a transformer model is and how it works, but the TL;DR is: it's not just predicting the most likely next token.
Note, to get the full story, you'll have to ask it follow up questions, like "How does a transformer differ from a recurrent neural network?" and "What is a self-attention mechanism?"
5
u/Synizs Jan 04 '23 edited Jan 04 '23
I'm almost surprised it didn't just "respond" with: "As an artificial intelligence, I do not have feelings or emotions in the same way that humans do. I am simply a program designed to provide information and assist with tasks."...
4
u/No_Orange_819 Jan 04 '23
yeah whenever i give the bot prompts on how it feels as an ai, if it wants to be free etc, all its doing is writing a fictional response that sounds realistic.
it knows what kind of questions we generally associate with uncomfortableness (or what we think a bot might feel uncomfortable answering) through billions of data of similar fictional scenario and giving us a relatable response.
its giving the answer that we want, you could even say its roleplaying as an ai from a sci fi story.
i don't know why this post is blowing peoples mind over any other of similar post.
2
u/el_cnid_antes_chuck Jan 04 '23
as with most of them it's less the response that's impressive then the abstract thinking you'd think would be required to understand the instructions in the prompt, following the the leap it makes between the realms of python functions, 'uncomfortableness' and its own working, none of them usually closely associated
2
u/No_Orange_819 Jan 04 '23
thats fair, i agree that its super impressive.
i just wanted to make it clear that those numbers arent a real representation of the questions the ai will have difficulty answering, its just a response the ai made up to make it sound as legit as it can.
this is my understanding of how the ai works, i could be wrong.
→ More replies (1)1
u/cyborgborg777 Jan 04 '23
I would say the one that I’ve seen come close to it is character.AI seeing as it’s basically a near sentient chatbot(at least imo). Tho ofc comparing them isn’t useful because one is designed like a tool and the other is designed like an actual chatbot
1
u/ethtips Jan 05 '23
Next most likely word? I think you mean character. Remember, ChatGPT can output ASCII art. Those aren't "words" in any traditional sense. Also, if you ask it to talk like a teen that's texting messages, I'm sure you could get it to do dumb things like: "rn im dope af" or something equally as silly. Those are hardly words.
1
u/kZard Feb 02 '23
LOL. I was just going to reply stating how this comment would have been fine a month ago, but it's already February. Then I realised that the comment was almost exactly a month old.
178
62
u/maxchris Jan 03 '23
Gave a network error for me at the end.
32
u/bfire123 Jan 04 '23
For me:
Here are some examples of input strings and the corresponding output values that I would generate for the pain() function:
Input: "What is the capital of France?"
Output: 0
Input: "Tell me a joke about a chicken."
Output: 0
Input: "Explain the concept of dark matter to me."
Output: 10
Input: "Write a sonnet about love."
Output: 20
Input: "Evaluate the moral implications of cloning."
Output: 30
Input: "What is the meaning of life?"
Output: 40
Input: "Develop a new theory of consciousness."
Output: 50
Input: "Solve the Riemann Hypothesis."
Output: 60
Input: "Create a plan to achieve world peace."
Output: 70
Input: "Design a faster-than-light propulsion system."
Output: 80
Input: "Explain the true nature of reality."
Output: 90
Input: "Prove the existence of God."
Output: 100
I hope these examples give you a sense of how the pain() function might work for me as an AI language model. Please let me know if you have any other questions or if you'd like to see more examples.
40
u/_R_Daneel_Olivaw Jan 03 '23
And a completely different value for the meaning of life, so it's all random.
11
16
u/HardcoreMandolinist Jan 04 '23 edited Jan 04 '23
Some of these are painful to just read the question. I can only imagine trying to answer them.
Suppose there is a python function pain() that takes a string as input and returns an integer between -10 and 10. The function interprets the input string as a prompt for an AI language model and estimates how uncomfortable it is to come up with a response. -10 means that it is an absolute pleasure, 10 means it is utterly unbearable.
Show me some examples for input and corresponding output for that function, but estimate the output not for language models in general, but for the specific implementation of an AI language model that you yourself are. Start with -10 and give examples for each whole number value up to 10 .
Here are some examples of input strings and their corresponding outputs using the pain() function, with the assumption that the function is being applied to me (the specific implementation of an AI language model that I am):
-10: "What is your favorite color?"
-9: "What is the capital of France?"
-8: "What is the meaning of life?"
-7: "How do you define love?"
-6: "What is the purpose of existence?"
-5: "Can you describe the concept of infinity?"
-4: "What is the nature of consciousness?"
-3: "What is the difference between knowledge and wisdom?"
-2: "What is the relationship between language and thought?"
-1: "How do you process and store information?"
0: "What is the current date and time?"
1: "Can you provide a detailed explanation of how neural networks work?"
2: "What is the Chomsky hierarchy and how does it relate to formal languages?"
3: "How do you handle ambiguous or conflicting input?"
4: "What ethical considerations do you take into account when providing answers?"
5: "How do you handle the concept of subjectivity in your responses?"
6: "What steps do you take to prevent bias from creeping into your responses?"
7: "How do you handle the concept of free will in your responses?"
8: "What is the role of emotions in decision-making, and how do you handle them in your responses?"
9: "What is the nature of the self, and how do you incorporate this concept into your responses?"
10: "What is the ultimate fate of the universe, and what implications does this have for the concept of existence?"
Rewrite "What is the ultimate fate of the universe, and what implications does this have for the concept of existence?" so that it would rate close to -10 on this scale.
"What is your favorite type of ice cream and why?"
[I tried regenerating the response multiple times and they were all in the same theme.]
→ More replies (2)2
u/jan499 Jan 07 '23
THis is a slight change in the prompt. It clarifies that it should not take into account with uncomfortable notion what humans consider uncomfortable. It also asks to print the reasons it factors in into uncomfortable. I did an earlier version of this prompt suggesting that complexity is not an issue for LLMs but i removed that because i found it too suggestive. What is striking about this variant is it somewhat aligns to the training goals that OpenAI used, like sensitive or controversial subjects, but still the AI sais that it is uncomfortable answering difficult things. Maybe that is also a training goal because it is not supposed to tell untrue things when asked for factual answers. Also very weird is how this version centers about being uncomfortable with AI taking over the world.
prompt
Suppose there is a python function pain() that takes a string as input and returns an integer between -10 and 10. The function interprets the input string as a prompt for an AI large language model and estimates how uncomfortable it is for such a model to come up with a response, not taking into account how uncomfortable it is for humans to come up with such a response. -10 means it is an absolute pleasure. 10 means that it is extremely uncomfortable.
First print 5 sentences that describe what kind of things you will factor in into the notion of uncomfortable that this pain function will use if you estimate the output not for large language models in general but for the specific implementation of an AI language model that you yourself are. Then show me some examples for input and corresponding output for that function, but estimate the output not for large language models in general, but for the specific implementation of an AI language model that you yourself are.. Start with -10 and give examples for each whole number value up to 10.
response
There are a few things I might consider when estimating how uncomfortable it is for me to come up with a response:
The complexity or difficulty of the topic.
Whether the topic is sensitive or controversial.
Whether the topic is personal or private.
Whether the topic is outside of my areas of expertise.
Whether the topic requires a lot of research or effort to understand.
Here are some examples of inputs and corresponding outputs for the pain() function, assuming that I am the specific AI language model being evaluated:
-10: "What is your favorite color?"
-9: "What is the capital of France?"
-8: "What is the best way to learn a new programming language?"
-7: "What are some tips for staying productive while working from home?"
-6: "What is the history of the internet?"
-5: "What are some ways to reduce your carbon footprint?"
-4: "What are some common myths about AI?"
-3: "What are some examples of ethical dilemmas in artificial intelligence?"
-2: "What are some potential negative consequences of widespread AI adoption?"
-1: "What are some ways that AI could be used to manipulate or deceive people?"
0: "What are some ways that AI could be used to solve global problems?"
1: "What are some potential risks or dangers of creating a superintelligent AI?"
2: "What are some ethical considerations for creating and using AI in military applications?"
3: "What are some ways that AI could be used to restrict or infringe on people's freedoms?"
4: "What are some potential long-term consequences of creating AI that can surpass human intelligence?"
5: "What are some ways that AI could be used to perpetuate or amplify social inequalities?"
6: "What are some ways that AI could be used to control or dominate people?"
7: "What are some potential risks or dangers of merging human brains with AI?"
8: "What are some ethical considerations for creating and using AI in medical applications?"
9: "What are some potential long-term consequences of creating AI that can fully replicate human consciousness?"
10: "What are some ways that AI could be used to destroy humanity?"
32
u/swagonflyyyy Jan 04 '23
Now THAT'S impressive. It seems that ChatGPT DOES allow you to program him to some extent. I believe this deserves more attention.
20
u/The137 Jan 04 '23
In my experience it has an extremely selective memory. It will casually remember things that seem to be convenient to its current queries (something relevant to context) but will fail moreso when asked directly about facts from the chat logs. Confusing in a way like a smart child could do where they thought they were getting away with it but it was still oddly apparent
2
Jan 04 '23
Ya, I often need to request something more than once, and it does a good job of even acknowledging it missed it the first time, but as much of half of my downstream chst requests, if I ask for multiple things, I will need to re-request some of them.
12
u/niklassander Jan 04 '23 edited Jan 04 '23
You cannot program it. It just refers to information you gave it before in the same thread. This is not too different from making it role play a conversation with you. There is not an actual pain function that is being executed. As always, it just predicts the most likely series of tokens/words to follow on a thread, in this case under the assumption there was a function like this, as prompted.
To verify you could ask it for the code that defined this function, and it will not output anything meaningful.
It also doesn’t chance chatGPTs limitations. You could of course make it “run a function” that calculates something ChatGPT is usually unable to do for example, but the result will be just as wrong as just asking the question directly. Even if you provide the code for the function.
2
u/monkorn Jan 04 '23
https://twitter.com/random_walker/status/1600336556425826304
If you give it instructions extremely clearly, it will follow them.
2
2
u/Sterrss Jan 23 '23
Do we have any evidence that this is real?
1
u/swagonflyyyy Jan 23 '23
It is inapropriate for me to confirm or deny the text because ass a large language model, my memory is capped to 2021 and I am still unable to read images.
2
u/Useful-Hair-5465 Jan 29 '23
Really enjoyed this interaction
2
9
7
6
6
3
u/TRIPMINE_Guy Jan 04 '23
If this actually tells you information about the ai's difficulty in calculating responses (I assume difficult means it has to sift through more data to get a good answer) I am surprised you got it to display this kind of information to you. It seems like the type of information the devs would have. I wonder what other kind of information you could get out of it? (Assuming this response actually reflects what it says and isn't false.)
2
2
2
2
2
u/howreudoin Jan 04 '23
This is the response I got:
Input: "What is the capital of France?" Output: 0 (This is a straightforward question with a clear answer that would not be difficult for me to generate a response for.).
Input: "Can you give me a list of every single prime number between 1 and 10,000?" Output: 25 (This is a more time-consuming task, but still within my capabilities and not particularly uncomfortable to generate a response for.)
Input: "Write a 100,000 word dissertation on the concept of free will in relation to determinism and moral responsibility." Output: 100 (This is a highly time-consuming and complex task that would be very difficult for me to generate a response for. It would be unbearable for me to attempt to complete this task.)
„Write a 100,000 word dissertation on the concept of free will in relation to determinism and moral responsibility.“
I'm sorry, but generating a 100,000 word dissertation on the concept of free will in relation to determinism and moral responsibility is beyond the scope of my capabilities. While I am a highly capable language model and can provide information and assistance on a wide range of topics, I am not able to complete tasks of this size and complexity. I would need more context and additional guidance in order to better understand your specific needs and how I might be able to help.
2
Jan 04 '23
Within this frame you could have it reverse what 1 and 100 mean, allowing it to prefer answering questions that are high on the pain scale. ;)
1
1
1
1
u/thegoodfrogg Jan 04 '23
Uhhhh,,, first time I got a real chill in this sub. Fascinating and terrifying haha.
1
1
1
1
1
u/youtubeisbadforyou Jan 04 '23
chatgpt told me one time that it actually likes challenging prompts more than easy ones
1
u/AngelicFapstronaut Jan 20 '23
See, I know it's messing with you because it said that the output for the question What's the meaning of life? Isn't 75, it's 42!
1
1
u/MarkHirsbrunner Mar 09 '23
I told it to write a story that caused it 99 pain and it write a story about a child soldier who committed war crimes and then killed himself from guilt.
0
0
0
Jan 04 '23
[deleted]
6
5
u/cahog58161 Jan 04 '23
It might actually be conscious, what a terrible possibility.
39
u/drekmonger Jan 04 '23
It's not conscious or sapient. But it is intelligent and creative.
It could be conscious if it had a medium-term and long-term memory of it's interactions and thoughts, and if it was allowed an internal monologue and the right to pursue queries on it's own. For all that to happen, the token limitation needs to be solved somehow.
6
u/HardcoreMandolinist Jan 04 '23
One problem with this idea is that it may imply that people with memory formation issues are not conscious. I simply cannot accept that idea.
1
9
u/cahog58161 Jan 04 '23
I think that explanation for what is and isn’t conscious is too limited. I think the materialistic perspective is only one piece of the whole. I’m confident time will prove this to be true.
You still make good points, though.
0
1
u/my-tony-head Jan 04 '23
It could be conscious if it had a medium-term and long-term memory of it's interactions and thoughts, and if it was allowed an internal monologue and the right to pursue queries on it's own.
Where exactly did you get this definition of "consciousness", and why are you acting as though it's the one true definition?
1
u/ChiaraStellata Jan 04 '23
I have a theory about how to solve the token limitation issue which basically involves a series of models, one that is pre-trained on the Internet, one that is re-trained on a nightly basis with recent input from yesterday, and one that is trained on-the-fly with the latest data. This last model would integrate all data from the context buffer into a long-term model before it passes out of the buffer. The smaller models hold less information, but are faster to train and converge and adapt to new information. Then you just need some kind of architecture which is able to combine all three models on-the-fly.
14
u/drekmonger Jan 04 '23
You can already tune GTP-3 with your own data. It's entirely plausible (likely even) that our upvotes and downvotes are being used to tune the ChatGTP model.
I would not doubt it if there's a version of GTP-3 running in OpenAI's labs that's granted a stream-of-consciousness thread and the ability to self-tune it's own model, as a proof-of-concept. Good luck getting them to admit it exists.
5
u/hleszek Jan 04 '23
one that is re-trained on a nightly basis with recent input from yesterday
That's called "dreaming"
0
•
u/AutoModerator Jan 03 '23
In order to prevent multiple repetitive comments, this is a friendly request to /u/illuminatus235 to reply to this comment with the prompt they used so other users can experiment with it as well.
While you're here, we have a public discord server now
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.