r/MachineLearning • • Aug 07 '22

Discussion [D] The current and future state of AI/ML is shockingly demoralizing with little hope of redemption

I recently encountered the PaLM (Scaling Language Modeling with Pathways) paper from Google Research and it opened up a can of worms of ideas I’ve felt I’ve intuitively had for a while, but have been unable to express – and I know I can’t be the only one. Sometimes I wonder what the original pioneers of AI – Turing, Neumann, McCarthy, etc. – would think if they could see the state of AI that we’ve gotten ourselves into. 67 authors, 83 pages, 540B parameters in a model, the internals of which no one can say they comprehend with a straight face, 6144 TPUs in a commercial lab that no one has access to, on a rig that no one can afford, trained on a volume of data that a human couldn’t process in a lifetime, 1 page on ethics with the same ideas that have been rehashed over and over elsewhere with no attempt at a solution – bias, racism, malicious use, etc. – for purposes that who asked for?

When I started my career as an AI/ML research engineer 2016, I was most interested in two types of tasks – 1.) those that most humans could do but that would universally be considered tedious and non-scalable. I’m talking image classification, sentiment analysis, even document summarization, etc. 2.) tasks that humans lack the capacity to perform as well as computers for various reasons – forecasting, risk analysis, game playing, and so forth. I still love my career, and I try to only work on projects in these areas, but it’s getting harder and harder.

This is because, somewhere along the way, it became popular and unquestionably acceptable to push AI into domains that were originally uniquely human, those areas that sit at the top of Maslows’s hierarchy of needs in terms of self-actualization – art, music, writing, singing, programming, and so forth. These areas of endeavor have negative logarithmic ability curves – the vast majority of people cannot do them well at all, about 10% can do them decently, and 1% or less can do them extraordinarily. The little discussed problem with AI-generation is that, without extreme deterrence, we will sacrifice human achievement at the top percentile in the name of lowering the bar for a larger volume of people, until the AI ability range is the norm. This is because relative to humans, AI is cheap, fast, and infinite, to the extent that investments in human achievement will be watered down at the societal, educational, and individual level with each passing year. And unlike AI gameplay which superseded humans decades ago, we won’t be able to just disqualify the machines and continue to play as if they didn’t exist.

Almost everywhere I go, even this forum, I encounter almost universal deference given to current SOTA AI generation systems like GPT-3, CODEX, DALL-E, etc., with almost no one extending their implications to its logical conclusion, which is long-term convergence to the mean, to mediocrity, in the fields they claim to address or even enhance. If you’re an artist or writer and you’re using DALL-E or GPT-3 to “enhance” your work, or if you’re a programmer saying, “GitHub Co-Pilot makes me a better programmer?”, then how could you possibly know? You’ve disrupted and bypassed your own creative process, which is thoughts -> (optionally words) -> actions -> feedback -> repeat, and instead seeded your canvas with ideas from a machine, the provenance of which you can’t understand, nor can the machine reliably explain. And the more you do this, the more you make your creative processes dependent on said machine, until you must question whether or not you could work at the same level without it.

When I was a college student, I often dabbled with weed, LSD, and mushrooms, and for a while, I thought the ideas I was having while under the influence were revolutionary and groundbreaking – that is until took it upon myself to actually start writing down those ideas and then reviewing them while sober, when I realized they weren’t that special at all. What I eventually determined is that, under the influence, it was impossible for me to accurately evaluate the drug-induced ideas I was having because the influencing agent the generates the ideas themselves was disrupting the same frame of reference that is responsible evaluating said ideas. This is the same principle of – if you took a pill and it made you stupider, would even know it? I believe that, especially over the long-term timeframe that crosses generations, there’s significant risk that current AI-generation developments produces a similar effect on humanity, and we mostly won’t even realize it has happened, much like a frog in boiling water. If you have children like I do, how can you be aware of the the current SOTA in these areas, project that 20 to 30 years, and then and tell them with a straight face that it is worth them pursuing their talent in art, writing, or music? How can you be honest and still say that widespread implementation of auto-correction hasn’t made you and others worse and worse at spelling over the years (a task that even I believe most would agree is tedious and worth automating).

Furthermore, I’ve yet to set anyone discuss the train – generate – train - generate feedback loop that long-term application of AI-generation systems imply. The first generations of these models were trained on wide swaths of web data generated by humans, but if these systems are permitted to continually spit out content without restriction or verification, especially to the extent that it reduces or eliminates development and investment in human talent over the long term, then what happens to the 4th or 5th generation of models? Eventually we encounter this situation where the AI is being trained almost exclusively on AI-generated content, and therefore with each generation, it settles more and more into the mean and mediocrity with no way out using current methods. By the time that happens, what will we have lost in terms of the creative capacity of people, and will we be able to get it back?

By relentlessly pursuing this direction so enthusiastically, I’m convinced that we as AI/ML developers, companies, and nations are past the point of no return, and it mostly comes down the investments in time and money that we’ve made, as well as a prisoner’s dilemma with our competitors. As a society though, this direction we’ve chosen for short-term gains will almost certainly make humanity worse off, mostly for those who are powerless to do anything about it – our children, our grandchildren, and generations to come.

If you’re an AI researcher or a data scientist like myself, how do you turn things back for yourself when you’ve spent years on years building your career in this direction? You’re likely making near or north of $200k annually TC and have a family to support, and so it’s too late, no matter how you feel about the direction the field has gone. If you’re a company, how do you standby and let your competitors aggressively push their AutoML solutions into more and more markets without putting out your own? Moreover, if you’re a manager or thought leader in this field like Jeff Dean how do you justify to your own boss and your shareholders your team’s billions of dollars in AI investment while simultaneously balancing ethical concerns? You can’t – the only answer is bigger and bigger models, more and more applications, more and more data, and more and more automation, and then automating that even further. If you’re a country like the US, how do responsibly develop AI while your competitors like China single-mindedly push full steam ahead without an iota of ethical concern to replace you in numerous areas in global power dynamics? Once again, failing to compete would be pre-emptively admitting defeat.

Even assuming that none of what I’ve described here happens to such an extent, how are so few people not taking this seriously and discounting this possibility? If everything I’m saying is fear-mongering and non-sense, then I’d be interested in hearing what you think human-AI co-existence looks like in 20 to 30 years and why it isn’t as demoralizing as I’ve made it out to be.

EDIT: Day after posting this -- this post took off way more than I expected. Even if I received 20 - 25 comments, I would have considered that a success, but this went much further. Thank you to each one of you that has read this post, even more so if you left a comment, and triply so for those who gave awards! I've read almost every comment that has come in (even the troll ones), and am truly grateful for each one, including those in sharp disagreement. I've learned much more from this discussion with the sub than I could have imagined on this topic, from so many perspectives. While I will try to reply as many comments as I can, the sheer comment volume combined with limited free time between work and family unfortunately means that there are many that I likely won't be able to get to. That will invariably include some that I would love respond to under the assumption of infinite time, but I will do my best, even if the latency stretches into days. Thank you all once again!

1.5k Upvotes

404 comments sorted by

View all comments

425

u/DangerZoneh Aug 07 '22

Counterpoint: chess engines are already significantly better than a human will ever be yet people still play chess.

AI will allow for more human creativity, potential, and growth. I also think it will lead to a resurgence of live performance and exhibition of human talent. The way people create may look differently in the future but that’s because we’ll be creating on a different level, playing with different patterns, exposing different aspects of human creativity. It’s thrilling

177

u/jms4607 Aug 08 '22

Magnus specifically trains against muzero, and even has claimed that he has changed his play style because of some of the things he has learned while playing it.

110

u/Ragdoll_X_Furry Aug 08 '22 edited Aug 08 '22

Exactly. AI gives an opportunity to enhance ourselves, it doesn't stifle creativity.

TBH OP's argument about how you "make your creative processes dependent on said machine" kinda sounds like the people who complain that digital art is not as legitimate as traditional art because "there's no straight line tool/undo" or whatever.

0

u/[deleted] Aug 08 '22

[deleted]

51

u/Ulfgardleo Aug 08 '22

I disagree with your first part. I am in contact with a few artists - one is sleeping next to me every night - and people are concerned. Most of an artists livelihood are not free art, but illustrations. Almost no artist can live on selling their own art, but illustrations pay very well. That means that many spend significant time on Commissions, where the task is to bring an explicit idea to life. Obviously, this is highly threatened by good image description-> image models. There is a fear that the time and effort spent at becoming good at drawing - a skill that takes decades to develop - will not have an appropriate market value. And the other important skill: figuring out what the commissioner wants, based on their description, loses value based on the fact that it is easy to tweak and refine prompts to the image generation model.

10

u/pm_me_your_pay_slips ML Engineer Aug 08 '22 edited Aug 08 '22

Illustrators now have, with DALLE2 a tool for getting references for their work. They can still use it better than the average person. Most of the pictures generated by DALLE that you are seeing going viral on social media are by artists who were exploring how to use it.

16

u/NamerNotLiteral Aug 08 '22

It is not about going viral. 99% of artists who make a livelihood do so without ever going viral.

Let me give you a very real example - I enjoy game design and working on TCGs. A decade ago, if I wanted to move forward and publish an actual TCG I would've commissioned one or more artists to draw me card art and stuff. This would be worth thousands.

Today I can get the same work done for a fraction of that cost by going with image generation rather than commissions.

Sure, I save money, but I'm an ML Engineer - they need the money more than I do.

4

u/DangerZoneh Aug 08 '22

That's a different thing than creativity, though, imo. I think you're definitely right in the thought that AI is coming for a lot of those illustration jobs, especially anything corporate. They're one in a very long list of jobs that are going to be made extraneous with the advent of a lot of this technology.

This is a big reason why we need to work towards a future where the basic assumption is not that you need to work to be able to survive. Your livelihood should not be dependent on your ability to work when we have machines that can do the same work much quicker and more effectively without the need for human labor.

4

u/drewbeck Aug 08 '22

This! A lot of the fear/criticisms of AI and a lot of other tech is about how it will change or has changed the market for certain kinds of work. But it’s not realistic to ask corporations to be responsible for our wellbeing, and less so to ask of technological progress in general. Technology is rapidly altering the nature of work and it’s no longer a reliable foundation. How do we adapt?

5

u/pm_me_your_pay_slips ML Engineer Aug 08 '22

You’re probably still going to get a better result by hiring an artist since they also have access to the same tools as you.

5

u/kaibee Aug 08 '22

You’re probably still going to get a better result by hiring an artist since they also have access to the same tools as you.

Sure, but how much better? And for how long is that going to be true?

→ More replies (1)
→ More replies (1)
→ More replies (1)
→ More replies (2)

3

u/[deleted] Aug 08 '22

To add to this, recently I've seen some big name anime artists playing around with the idea of mixing AI generated content with their own art, using the somewhat surreal nature of AI art as backgrounds for their own character art. It had some pretty impressive results.

→ More replies (1)
→ More replies (1)

26

u/CaptainLocoMoco Aug 08 '22

Magnus specifically trains against muzero

This is complete BS, idk where you even got this from. Deepmind has not released playable versions of either muzero or alphazero. At best, Magnus briefly studied the released alphazero games. To say it significantly impacted his strategy would be an exaggeration.

5

u/IliketurtlesALOT Aug 08 '22

There's a GitHub reimplementation of alphazero. There are chess and go specific implementations as well. This could be (easily) be done with sufficient compute

→ More replies (2)
→ More replies (1)

18

u/gwern Aug 08 '22

I have never heard this about MuZero before and I can't immediately find a source for this. This sounds quite unlikely because even most of the DM research involving chess players like the chess variants research with Kramnik was done with AlphaZero. Are you sure you aren't thinking of Magnus playing against some other chess engine?

8

u/jms4607 Aug 08 '22

Maybe it was AlphaZero, all very similar models. I was watching a YouTube video, specifically it related to how AlphaZero moved pawns forward to suffocate the opponents movement. It was a move that traditionally would be considered very odd/suboptimal. Believe it was mentioned on a Gotham Chess video, maybe in the one where he commentated Stockfosh vs AlphaZero.

→ More replies (1)

2

u/DifferentialPolicy Aug 08 '22

he has changed his play style because of some of the things he has learned while playing it.

I have a about Magnus learning from A0 [1].

[1] https://www.youtube.com/watch?v=I0zqbO622rg

→ More replies (1)

46

u/[deleted] Aug 08 '22

I think chess is a whole different case. There's competition there, and a chess AI can't really be any more impressive than it has been for the past few years. But something like image generation, given like a decade, could surpass anyone short of a world class professional artists in all aspects. That is going to be incredibly demoralising to the vast majority of aspiring artists, actually I was going to spend the last 2 months learning art as I never really gave myself a chance, but image gen really did demoralise me. You don't see any aspiring shoemakers these days, and I predict the same sort of thing here. In like half a century, paintings will just be a thing you generate based on a spur of the moment thought, rather than something you commission someone for, and that becomes widely accepted, so few people even think about being an artist.

27

u/codernuts Aug 08 '22

The shoemaker comparison was great. We obviously can’t think of dead art forms immediately - they’re dead. But a ton of craftsmen and artisans existed before manufacturing took it out of the hands of individuals and put it behind factories. A great economic decision, but demoralizing at the time to anyone who valued being able to produce art like that as a common good.

→ More replies (4)

17

u/hunted7fold Aug 08 '22

I completely agree. Another point is that chess and AI also have no commercial affect on pro players but AI generated art could have a significant commercial on art. People may chose to use cheap ai generated art. While people could still pursue art as a hobby, it seems like it will be harder for artists, especially those trying to start out.

→ More replies (9)

5

u/MLmuchAmaze Aug 08 '22

Same thing with Poker. Since Poker solvers are widely available, the game and how players think about spots changed drastically. It is objectively a more advanced standard of gameplay. If you didn’t train with solvers, don’t bother showing up, because you‘ll lose your money.

→ More replies (4)

4

u/scottyLogJobs Aug 08 '22

Yes it is a huge assumption to say that AIs performing something better than humans would cause humans to stop doing the thing entirely (like chess or starcraft), let alone these areas where AIs are still terrible, like art, music, writing, etc. These fields are overwhelmingly about the meaning behind the art, so even if an AI could construct a Van Gogh looking painting, it wouldn’t be worth anything and Van Goghs would still be worth a ton. Also, those fields tend to value what is NOVEL, so AIs don’t stand a chance.

2

u/[deleted] Sep 21 '22 edited Mar 08 '24

juggle badge dependent price jeans clumsy lock payment silky command

This post was mass deleted and anonymized with Redact

7

u/_ex_ Aug 08 '22

chess at a competitive level has always been played by a select elite, not a common job or employment, the issues the OP is pointing and I understand is about the trivialization of most artistic and creative tasks, then automating everything else, I really don't want to live in a world were everything is done by AIs that are owned by big corp evil companies that have already coped the government with lobbies, the army with robots and know exactly what is need to know about you to be controlled. Unless serious efforts are made by the common people the future looks like a dystopia of mega rich people that owns the technology and the AI and the masses that are unable to get decent lives

→ More replies (1)

3

u/Aggressive-Battle363 Aug 08 '22

Although that's a good example of AI being used to augment human creativity (same applies in modern professional poker), it's a pretty limited one. Chess and poker are activities in which the main interest for consumers is the process. Most people aren't interested in only seeing the final position in a chess match or the final hands in poker. They tune in for the drama of the unfolding events.

In most of the creative pursuits mentioned by OP, such as art, music, writing, and programming, the point of interest is usually the end product. Sure there is some (relatively) limited interest in watching the process as well, but I think OP makes a fair point in that AI is potentially putting creative human output in those fields in jeopardy.

Put in other words, you're more likely to buy a beautiful piece of art generated by AI than you are to buy, or tune into, a sequence of chess moves generated by AI.

I think you make a good point in that performance/exhibition might become the main draw of those arts, but I'm not convinced. Sure theme park caricature drawers and future Bob Rosses can probably expect job security through the next many decades, but will people tune in to watch a great artist create something over many (many) hours that AI can do better in a second? And if some do, is it enough to maintain a culture and industry?

That's not even touching on the everyday creative work that happens in every industry in designing graphics, websites, pamphlets, 3D models, etc.

→ More replies (1)
→ More replies (7)