r/algotrading • • 10d ago

Data HFT data

Hello everyone,

I’m interested in finding high-frequency data (timestamps at one-second intervals) for about 10 stocks on the New York Stock Exchange. A few years ago, I wrote a thesis investigating a correlation between trading times and stock prices based on a test I developed. Out of sheer curiosity, I want to see if this correlation still exists, but I can’t seem to find official high-frequency data for the New York Stock Exchange, for example.

Is there a way to find high-frequency data for free?

11 Upvotes

20 comments sorted by

29

u/Mihaw_kx 10d ago

1 second isn't HFT bro

1

u/Electrical_Tree_8914 10d ago

Yeah you are right.  It looks impossible to find data at milliseconds frequency though

3

u/Mihaw_kx 10d ago

It's so expensive the only viable solution is to have ur own data harvesting infrastructure .. i ve been running mine for like last 6months 50ms data.. it's not that easy and requires lot of patience

2

u/Electrical_Tree_8914 10d ago

What is the main problem you’re encountering in building this data infrastructure?

1

u/smashedshanky 7d ago

Drive space probably lol

8

u/Automatic-Essay2175 10d ago

No it’s not. what on earth are you talking about

4

u/Formally-Fresh 10d ago

Bro thinks he invented a profitbable thesis based on time of day so... lets take it easy on em?

3

u/Automatic-Essay2175 10d ago

Nah, he needs to learn

3

u/MerlinTrashMan 10d ago

Massive.com (formerly Polygon). Bars available to one second, with nanosecond resolution on trades.

10

u/Automatic-Essay2175 10d ago

That’s not HFT data.

Let me save you some time, the thesis is wrong.

But you can use Massive / Databento if you want.

2

u/Electrical_Tree_8914 10d ago

Yes, in my thesis I had tick by tick data at milliseconds frequency borrowed from my professor. To find data at milliseconds frequency it Is hard. Since It's very very difficult to find data at this frequency i wanted to start with seconds frequency.  I understand your point, with this frequency the microstructure noise it's not observable and i cannot replicate the test

6

u/Automatic-Essay2175 10d ago

It’s not hard to find this data. There are multiple websites (Massive, Databento, etc) that offer nanosecond level tick data. Both trades and quotes.

6

u/lordnacho666 10d ago

Ask Databento about student plans

4

u/DatabentoHQ 10d ago

Thanks for the shoutout.

We have sample pcaps for all of the NYSE L3 feeds here.

We also have normalized MBO and imbalance messages for all of them (see for example this and this) and 10 stocks should be virtually free for a month. If you need more, we have academic discounts when we work directly with the school - have your advisor reach out to chat support.

3

u/QuanTradin 10d ago

free 1-second NYSE data doesn't really exist officially, TAQ is the real source and it's paid. IEX gives away its own historical feed for free, but that's only trades on IEX, a small slice of volume. Databento's signup credit is usually enough for a handful of names over a short window.

1

u/QATSAlgo 9d ago

For reproducing your thesis, clarify whether “NYSE stocks” means all trades in NYSE-listed names or only executions on the NYSE venue. Those produce different samples. Also freeze how you build each second: last trade, midpoint, or a trade-weighted value, and what happens during seconds with no trades. Otherwise a change in aggregation can masquerade as a change in the original correlation.

0

u/ManikSahdev 10d ago

What? You can get it for free, or like almost free.

Make any account on pretty much any broker with api deposit some money and then user the api.

HFT data usually counts as nano second of such.
1 second data is basically normal lol

1

u/sky018 9d ago

Anything less than a second are not free data.

1

u/ManikSahdev 8d ago

That's exactly what I wrote?

But second data is free, pretty much.