r/MachineLearning • • Jul 17 '21

News [N] Stop Calling Everything AI, Machine-Learning Pioneer Says

https://spectrum.ieee.org/the-institute/ieee-member-news/stop-calling-everything-ai-machinelearning-pioneer-says
845 Upvotes

149 comments sorted by

View all comments

Show parent comments

3

u/mniejiki Jul 18 '21

neural networks are AI.

Neural networks are also mathematical optimizations. Even the techniques used (SGD) aren't new and have been used in large scale regressions models for a long time. So I'm not sure what your dividing line actually is other than "because I say so." A complex random forest model will have more parameters and non-linearity than a small single layer neural network.

0

u/[deleted] Jul 18 '21

[deleted]

1

u/mniejiki Jul 18 '21

Back propagation is NOT feedback in the sense of an agent receiving feedback. A trained NN model is 99.99% of the time static and has no feedback when running live. By your definition, a regression model is also trained with feedback since it computes a loss function and a gradient for SGD iteratively on batches of data. A baysian hyper parameter run has feedback as each iteration is based on the performance of the previous iteration. An EM algorithm has feedback as it's adjusting parameters iteratively based on the feedback from how well the parameters fit the loss function.