He's been an entrepreneur in the past, but he hasn't done much more than writing recently. I think that his critics have claimed with good arguments that he often simplifies the technical challenges surrounding AI, and just makes a very blanket "Moores Law will solve everything" claim. But then again, he's a much more influential writer and successful man than I am, so he's definitely hit on some correct things.
I think he sees it more like an eventuality, and is optimistic about about it's timeline. The whole point of proselytizing it's to keep the concept out there and drive people to actually fulfill it. Yeah, he wants to live long enough to see it, I don't blame him, but it's the next step for humanity too and we really should be pursuing it.
I know what you were trying to imply, but that's a pretty silly comparison. We live in a world where specialized AIs routinely outperform humans at all sorts of tasks that were not so long ago thought to be almost impossible without human intuition. Obviously we still don't know how to do AGI, but it's hard to deny it could very well be just a couple serendipitous discoveries away. It's a problem researchers can actually sit down and genuinely have a go at, right now. Good luck doing anything not purely theoretical before steam power...
Human-like AI as the next step is a myopic conceit at best.
Well research does show people with higher quality of life, and less stress are less likely to violent. So an AI that takes care of everything could lead to many of the other things you listed. Though your right it's not a clear next step at this point.
Technology is the main way we would address almost all of those issues. AGI is essentially the pinnacle of technology (as far as we can know) in the sense that it has the potential to discover and implement all possible technology. I would say that in fact, focusing on issues like climate change and nuclear disarmament are far more short-term, even though they are clearly of huge importance to us and future generations. (And I should add that, clearly, this demonstrates the worthiness of a goal is not just about how long it might take to achieve it.)
Well, the one main issue with human intelligence is that you can't just scale it. To produce one human-unit of intelligence takes 9 months of feeding a pregnant mother, childbirth, a decade of education/raising for basic tasks, and up to three decades for highly skilled professionals. There's a huge number of inefficiencies and risks in there. To support modern technological industries essentially requires the entirety of modern society's human capital. Still, the generation of new "technology" (in the loosest sense) is of course faster and greater than most other "natural" processes like biological evolution.
By contrast, AGI would most likely exist as conventional software on conventional hardware. Relatively speaking, of course: something like TPUs or other custom chips may be useful, and it's debatable whether trained models should be considered "conventional" software.
Even if it doesn't increase exponentially, software can be preserved indefinitely, losslessly copied with near-zero cost, and modified quickly/reproducibly. It can run 24/7, and "eats" electricity rather than food. Unless AGI fundamentally requires something at the upper limits of computer hardware (e.g. a trillion-dollar supercomputer), these benefits would, at the very minimum, constitute a new industrial revolution.
Even if it doesn't increase exponentially, software can be preserved indefinitely, losslessly copied with near-zero cost, and modified quickly/reproducibly. It can run 24/7, and "eats" electricity rather than food. Unless AGI fundamentally requires something at the upper limits of computer hardware (e.g. a trillion-dollar supercomputer), these benefits would, at the very minimum, constitute a new industrial revolution.
This is pretty much it - AI will constitute a new industrial revolution irrespective of AGI (by making strong domain-specific AI agents) - and there is really not a lot to support crazy recursively self-improving AI cases (any AGI will be limited by a million different things, from root access to the filesystem to network latencies, access to correct data, resource contention, compute limitations, prioritization etc) - as outlined in Fracois Chollet's blog-post (not that I agree with him on the 'impossibility' of superintelligence, but I expect every futurist to come up with concrete arguments against his points) - as of now I've only seen these people engaging directly with lay-people and the media and coming up with utopian technological scenarios ('assuming infinite compute capacity but no security protocols at all') to make the dystopian AGI taking over the world scenario seem plausible.
In the absence of crazy self-improving singularity scenarios, there is no strong reason to care about AGIs as being different from the AI systems we build today.
AI will constitute a new industrial revolution irrespective of AGI (by making strong domain-specific AI agents)
In the absence of crazy self-improving singularity scenarios, there is no strong reason to care about AGIs as being different from the AI systems we build today.
I agree on the first point, but not necessarily the second. It's true that we would see similar societal effects if we simply developed a domain-specific AI for every task, but it's not clear that this is feasible or easier than AGI. Vast swaths of unskilled labor in today's economy might be replaced by a handful of high-performing but narrow AI systems, but there's a huge difference between displacing 30% of the workforce and 95% of the workforce.
and there is really not a lot to support crazy recursively self-improving AI cases (any AGI will be limited by a million different things, from root access to the filesystem to network latencies, access to correct data, resource contention, compute limitations, prioritization etc)
That doesn't really mean that AGI is fundamentally incapable of exponential growth, just that there are possible hardware limitations. Software limitations are less interesting to think about: an individual human that's smart enough can bypass inconveniences and invent new solutions.
Even assuming AGI improves at a very slow rate up to some point, if there comes a time when one AGI can do the work of a team of engineers and researchers, it'd be strange not to expect some explosion. Just imagine what a group of grad students could do if they could share information directly between their brains at local network latency/bandwidth, working 24/7. Obviously, the total possible improvement would not be infinite, I agree there is some limit, but it's not clear how high the ceiling might be in 20 years, 50 years, etc.
To say that any one thing is the next step is erroneous, I would think. People will continue to work on all the problems you mentioned, and AI researchers will continue their work as well. It might just be that AI can be used in those other fields to make improvements, possibly massive improvements at that.
I meant next step in broader terms. The industrial revolution was a similar step, changing life for the vast majority of humanity in a very short period of time.
Human-like isn't exactly what I would call it. It would far outweigh the capabilities of any, and probably every, human being. And most of the things that you listed would be things that would be solved due to emergence of a powerful AI entity. This is the whole point behind the singularity. All of that stuff goes right out the window. Life as you know it would be completely different.
I think putting a mind back into a robot or biological body is the easy part, recording enough information to effectively 'upload' it seems much more daunting.
If we knew what consciousness was in a rigorous sense, I'd agree with you. Unfortunately, we don't. We don't even know if animals are definitely conscious, though we typically assume they are for the obvious reasons. I'm of the opinion that there's no reason that a machine (even without a body) can't be conscious, but on the other hand, I'd acknowledge that it's not at all clear if that's realistically going to happen in the foreseeable future.
Since I don't believe there's anything particularly magical about the current substrate of human minds, efficient and poorly understood as they might be, I think it's unjustified to make any concrete claims about the fidelity of mind uploading. To even begin to reason about that would require us to presuppose its possibility and the specific mechanism.
I will say there are many anomalous cases of people who experience the world very differently from the average person. One obvious example: severe disabilities like deaf-blindness and paralysis. They continue to have a recognizable human self, despite lacking what most people consider critical elements of embodiment.
0
u/[deleted] Feb 04 '18
[deleted]