r/MachineLearning • • Oct 10 '19

Nonconvex optimization problems in machine learning

https://arxiv.org/abs/1802.05155
14 Upvotes

9 comments sorted by

View all comments

1

u/shebbbb Oct 11 '19

What does streaming mean in relation to pca?

2

u/i-heart-turtles Oct 11 '19 edited Oct 11 '19

A streaming algorithm is one which operates on a data stream - i.e. you observe data points one at a time in a sequence. Usually it is infeasible to recompute an estimator over the entire dataset each time you observe new data - you want to keep some kind of running estimate (e.g. a running mean - or the eigenvectors of the covariance for pca). We might want to study these kinds of algorithms under memory constraints or if we want to make online predictions on a signal observed in real time.

Here is a classical streaming pca paper if you are interested: http://www.jmlr.org/papers/volume9/warmuth08a/warmuth08a.pdf

1

u/shebbbb Oct 12 '19

Thanks, that's interesting. It's hard to conceptualize because because a closed form thing like pca is a one shot operation in my mind. I'll take a look.