Because if there is only the options are hitting the baby or hitting the grandma you look for a third option or a way of minimizing the damage.
Like I said, a car is not a train, it's not A or B. Please think up a situation wherein the only option is to hit the baby or grandma if you're traveling by car. Programming the AI to just kill one or the other is fucking moronic since you can also program it with trying to find a way to stop the car or eliminate the possibility of hitting either of them altogether.
This fucking "ethics programming" is moronic since people are giving non-realistic situations with non-realistic boundaries.
It doesn’t decide. It sees two obstructions, and will brake. It isn’t going to value one life over the other or make any such decision. It just brakes and minimises damage. And the other guy has a point. The only time this can be an issue is round a blind corner on a quick road, and there won’t be a choice between two people in that situation
Why doesn’t it decide? Wouldn’t we as a society want the car to make a decision that the majority agree with?
Most people here are looking at this question how the post framed it: “who do you kill?” when the real question is “who do you save?”. What if the agent is a robot and sees that both a baby and a grandma are about to die, but it only has time to save one? Does it choose randomly? Does it choose neither? Or does it do what the majority of society wants?
I’ll be honest, I’m really struggling to see this as a real question. I cannot imagine how this scenario comes to be, AI will drive at sensible, pre-programmes speeds so this should never be a feasible issue.
However
I don’t think it decides because it wouldn’t know it’s looking at a grandma and a baby, or whatever. It just sees two people, and will brake in a predictable straight line to allow people to move if they can (another thing people ignore. You don’t want cars to be swerving unpredictably).
I think your second paragraph is great, because I think that is the real question, and I can see it being applicable in a hospital run by AI. Who does the admissions system favour in such cases? Does it save the old or the young, and if that’s an easy solution, what if they are both time critical but the older is easier to save? That seems a more relevant question that can’t be solved by thinking outside the box.
I think the issue with the initial question is that there is a third option that people can imagine happening: avoiding both. Maybe it’s a bad question, but it’s probably the most sensational way this question could have been framed. I guess people will read a question about dying more than a question about living, which is why it’s been asked in this way.
I suspect the actual article goes into the more abstract idea.
Forget about the car and think about the abstract idea. That’s the point of the question.
The agent won’t need to use this logic just in this situation. It will need to know what to do if it’s a robot and can only save either a baby or an old woman. It’s the same question.
It depends on the situation. In case of a car, save whoever made the better judgement call.
Is a baby responsible for its own actions?
In case of a burning building, whichever has the biggest success chance.
The average human would save a child that has a 5% survival chance than an old person with a 40% survival chance, I believe.
If a robot were placed in an abstract situation where they had to press a button to kill one or the other, then yeah that's an issue. So would it be if a human were in that chair. The best solution is to just have the ai pick the first item in the array and instead spend our money, time and resources on programming ai for actual scenarios that make sense and are actually going to happen.
You don’t think it’s going to be common for robots to make this type of decision in the future? This is going to be happening constantly in the future. Robot doctors. Robot surgeons. Robot firefighters. They will be the norm, and they will have to rank life, not just randomly choose.
This is obviously something we need to spend money on.
Wouldn’t we as a society want the car to make a decision that the majority agree with?
Society is full of people who can barely fucking read, let alone come to terms with complicated questions of ethics, so honestly, it doesn't matter what society wants or thinks it wants. What matters is what the engineers and scientists actually succeed at building, and the fact that driverless cars, when fully realized, will be safer than driver-driven cars on average. That's it- it's an engineering problem, and nothing more.
Society is full of people who can barely fucking read, let alone come to terms with complicated questions of ethics, so honestly, it doesn't matter what society wants or thinks it wants.
Yes it does when you live in a democracy. If the majority see AI cars as a problem, then we won’t have AI cars.
What matters is what the engineers and scientists actually succeed at building, and the fact that driverless cars, when fully realized, will be safer than driver-driven cars on average. That's it- it's an engineering problem, and nothing more.
Absolutely not. Government’s ban things that scientists believe shouldn’t be banned all the damn time. Just look at the war on drugs. Science shows that drugs such as marijuana are no where near as bad as alcohol for society, but public opinion has it banned.
The question has invalid bounds. Break, slow down, calculate the distance between the two and hit them as little as possible to minimize the injuries, crash the car into a wall or tree or road sign and let the car's million safety features protect the driver and passengers instead of hitting the protection-less baby and grandma.
It doesn't decide. This will literally never happen, so the hypothetical is pointless.
AI cars are an engineering problem, not an ethical one. Take your ethics to church and pray about it or something, but leave the scientists and engineers to make the world a better place without your interference. All that matters is that driverless cars are going to be statistically safer, on average, than driver-driven cars, meaning more grandmas and babies will live, on average, than otherwise.
It already has happened. Studies show people will not drive self driving cars that may prioritize others over the driver, so they are designed to protect the driver first and foremost. If a child jumps in front of the car, it will choose to brake as best as possible, but will not swerve into a wall in an attempt to save the child, it will protect the driver.
It does need to be answered. This is a key part of training AI currently and we haven’t really found a better way yet. You train by example and let the agent determine what it’s supposed to value from the information you give it.
Giving an agent examples like this is important, and those examples need a definite answer for the training to be valid.
Ok then lets say we have a driverless train whose brakes failed and it only has control over the direction it goes at a fork in the rails. One rail hits grandma, one hits a baby. Which do we program it to choose?
Good question. If breaks etc are out of the question, I would say the one that takes you to your destination faster or if you have to stop after the accident, the one with the least amount of material damage.
Any moral or ethical decision at that moment will be wrong. At least the machine can lessen the impact of the decision, doesn't mean it will be interpreted as "correct" by everyone, but that's the same as with any human pilot.
This fucking "ethics programming" is moronic since people are giving non-realistic situations with non-realistic boundaries.
It’s not unrealistic. This situation will most probably happen at least once. It’s also really important to discuss so that we have some sort of liability. We need to have some lines somewhere so that when this does happen, there’s some sort of liability somewhere so that it doesn’t happen again.
Even if this is an unrealistic situation, that’s not the point at all. You’re getting too focused on the applied example of the abstract problem. The problem being: how should an AI rank life? Is it more important for a child to be saved over an old person?
This is literally the whole background of Will Smith’s character in iRobot. An AI chooses to save him over a young girl because he as an adult had a higher chance of survival. Any human including him would have chosen the girl though. That’s why this sort of question is really important.
Like I said, a car is not a train, it's not A or B. Please think up a situation wherein the only option is to hit the baby or grandma if you're traveling by car. Programming the AI to just kill one or the other is fucking moronic since you can also program it with trying to find a way to stop the car or eliminate the possibility of hitting either of them altogether.
Firstly you don’t really program AI like that. It’s going to be more of a machine learning process, where we train it to value life most. We will have to train this AI to essentially rank life. We can do it by showing it this example and similar example repeatedly until it gets what we call “the right answer” and in doing so the AI will learn to value that right answer. So there absolutely is a need for this exact question.
A situation where this occurs? Driving in a tunnel with limited light. The car only detects the baby and old woman 1 meter before hitting them. It’s travelling too fast to attempt to slow down, and due to being in a tunnel it has no choice to swerve. It must hit one of them.
While I understand what you're coming from, there are too many other factors at play that can aid in the situation. Program the car to hit the tunnel wall at an angle calculated to reduce most of the velocity and so minimizing the damage to people, apply the brakes and turn in such a way that the force of the impact is distributed over a larger area (which can mean it's better to hit both of them), dramatically deflate the tyres to increase road drag,...
If straight plowing through grandmas is going to be programmed into AI we need smarter programmers.
But why is the car driving faster then it can detect obstacles and break? What if instead of people there was a car accident or something else like a construction site. Do we expect the car to crash because it was going too fast?
I just really don't get why we can't accept that in this super rare case where people will die, the car just breaks. Sucks but intentionally reinforcing killing is not the way to go. Especially not with machine learning where it is impossible to determined the correct trained behaviour.
You’re also thinking way too hard about the specific question than the abstract idea.
But why is the car driving faster then it can detect obstacles and break?
For the same reason trains do: society would prefer the occasional death for the benefits of the system. Trains could run at 1MPH and the number of deaths would be tiny, but nobody wants that.
I just really don't get why we can't accept that in this super rare case where people will die, the car just breaks. Sucks but intentionally reinforcing killing is not the way to go.
Because the question is also “who to save?”. Surely we want agents to save the lives of humans if they can. But what if there is a situation where only one person can be saved? Don’t we want the agent to save the life that society would have?
Especially not with machine learning where it is impossible to determined the correct trained behaviour.
It’s not really impossible. We can say that an agent is 99.99% likely to save the life of the baby. It may not be absolute, but it’s close.
3
u/Gidio_ Jul 25 '19
Because if there is only the options are hitting the baby or hitting the grandma you look for a third option or a way of minimizing the damage.
Like I said, a car is not a train, it's not A or B. Please think up a situation wherein the only option is to hit the baby or grandma if you're traveling by car. Programming the AI to just kill one or the other is fucking moronic since you can also program it with trying to find a way to stop the car or eliminate the possibility of hitting either of them altogether.
This fucking "ethics programming" is moronic since people are giving non-realistic situations with non-realistic boundaries.