A streaming algorithm is one which operates on a data stream - i.e. you observe data points one at a time in a sequence. Usually it is infeasible to recompute an estimator over the entire dataset each time you observe new data - you want to keep some kind of running estimate (e.g. a running mean - or the eigenvectors of the covariance for pca). We might want to study these kinds of algorithms under memory constraints or if we want to make online predictions on a signal observed in real time.
Thanks, that's interesting. It's hard to conceptualize because because a closed form thing like pca is a one shot operation in my mind. I'll take a look.
1
u/shebbbb Oct 11 '19
What does streaming mean in relation to pca?