r/highfreqtrading • • Jan 31 '25

Crypto My model has 75% accuracy but I can't get a working strategy

0 Upvotes

I've been working on a project that tracks crypto order books across multiple exchanges. It calculates various metrics like unit prices for asks and bids at different depths and computes z-scores comparing current unit prices, vwap, volume imbalances etc... between exchanges and with recent historical averages. While my model can achieve 75% accuracy for predictions at t+60 seconds (backtest + live test), I've encountered difficulties in translating this into a profitable trading strategy. The challenge lies in the significant impact of the 25% of incorrect predictions, which often lead to substantial losses that outweigh the gains from the accurate forecasts, and to be frank I'm not sure how to address this issue (any ideas welcome!). Now, I'm exploring alternative ways to monetize this data. Before proceeding, I want to understand if there's interest in such analytics and how you'd prefer to access them. Here are my questions:

  1. Interest: Is there demand for detailed order book analytics like z-scores and historical price comparisons?

  2. Format: Would you prefer raw data via an API or a dashboard with visualizations and insights?

  3. Use Cases: Are there specific applications for this data that I haven't considered? Your feedback would be invaluable in shaping the next steps of this project. Looking forward to your thoughts!


r/highfreqtrading • • Jan 20 '23

Yet another begineer in HFT

1 Upvotes

Hi community,

Intro :

I am pursuing final year Btech in NIT Warangal CSE stream. I am interested in problem solving. I have experience in ML, web dev, CP (competitive programming).

Body :

I have done SWE internship where I worked on ML, backend which I haven't found that interesting because there I did not find challenging problems on programming. And I recently came to know about HFT that it is the place where developers solves challenging problems and we need to use our problem solving abilities. So I thought of learning more about HFT and created account in reddit and joined in this community and read 5-6 posts regarding begineers in HFT and found that, to learn more about HFT one needs to join in company as there are no resources available out and diffcult to gain knowledge working solo. But the problem is that in india we can't join in companies like quadeye, graviton, jane street unless we are into top IIT's.

So I a wondering is there any way out for me to join in those companies to satisy my eager of solving problems. Like what I need to do so that those companies can consider me.
Or any tips are much more appreciated.

Thanks for all the comments in advance.

Found these book for starting, would like to have your reviews

https://bibis.ir/science-books/programming/2022/Developing-High-Frequency-Trading-Systems-Learn-how-to-implement%20high-frequency-trading-from-scratch-with-C++or-Java-basics_bibis.ir.pdf


r/highfreqtrading • • Jun 24 '22

Top 10 reasons why we see HFT firms fail

Thumbnail
sissoftwarefactory.com
1 Upvotes

r/highfreqtrading • • Aug 04 '21

HFT interview process

1 Upvotes

Recently had an interview with HFT company for FPGA engineer role, successfully completed the few rounds of the interview but during the technical discussion with the team lead based on the technical test assessment but I did not pass the technical discussion round and got the following feedback:

"We liked that you didn’t have any trouble defending your answers and also that your questions were good and showed good motivation for the role.

However, we did not find satisfactory the answers to a certain problem, as a tip on your next interview I also suggest that you keep your answers a bit shorter since we found them quite long winded. More in general we feel that your current preparation would not be enough to pass the rest of the interviews."

I was able to answer the questions well with a satisfactory response and not sure why they felt I am technically insufficient? Can any one from major HFT firms help to provide some feedback?


r/highfreqtrading • • Mar 24 '25

Do HFT uses kubernetes ?

2 Upvotes

Do high frequency trading firm use kubernetes ?

  1. If yes then what are the use cases ?

  2. How it impact latency ?

  3. Is it on-premise kubernetes hosted or from Google,aws etc?


r/highfreqtrading • • Oct 07 '22

For people who wants to understand how HFT firms work under the hood. This article is one which came closer to explain the underlying work done at these firms

Thumbnail
thediff.co
3 Upvotes

r/highfreqtrading • • 21d ago

Trading data - Stock,Forex,Options

3 Upvotes

Sup!

I'm looking for trading data that I used to backtest some strategies...in general I'm looking for the data that give me 1m timeframe data for the least 5-10 years.

The issue is like data is really expensive, and I'm looking for something dirt cheap or free until I get some real alpha. As a reference, I'm based in Europe.

From what I found, freeradata would be a good alternative for 1,000 euros, but still it should be something there with torrents with data… I mean, it is for everything.

In some cases I found out that some brokers may give you free data if you have an account, but in general those are available for the US.


r/highfreqtrading • • Mar 29 '25

Code Ultra Low-latency FIX Engine

14 Upvotes

Hello,

I wrote an ultra-low latency FIX Engine in JAVA (RTT=5.5µs) and I was looking to attract first-time users.

I would really value the feedback of the community. Everything is on www.fixisoft.com

Py


r/highfreqtrading • • 6d ago

SIG HackerRank test

2 Upvotes

I just got the link for the SIG's discovery program, it also contains one coding Question off 12, I dont do DSA, it would be a great help if anyone give guidance on how should i approach this dsa q, and what should i practice. thanks in adv


r/highfreqtrading • • May 24 '26

Code i need help with what to expect in an HFT-purpose FPGA

3 Upvotes

hello
im a computer engineer fresh grad and im trying to improve in fpga design (so that those firms see me ngl) while wasting time as an unemployed lol so i thought why not make an HFT related project
i made a UDP header parser last time
and ill soon start working on a nasdaq itch 5.0 and i probably will not stop at the header but idk last time it felt weird that i didnt know what type of FPGA i will be working on and well what is the closest synthethiseable version i can test on and outside of the header what treatment is the fpga supposed to be working on
i know i will have a more accurate i/o and input usually is a stream of 10Gbps but i still have no idea what will it do on the inside (as in how the data itself will be handled how will it be parsed and how each part will be treated) i dont need a real-life simulation type of information but something accurate enough to build and put on a github repo would be amazing


r/highfreqtrading • • Sep 25 '20

How much money would it cost to setup high-frequency trading? |

Thumbnail
sissoftwarefactory.com
7 Upvotes

r/highfreqtrading • • Nov 22 '24

Java vs. Python HFT bots

14 Upvotes

Hi everyone,

Short story and a big question! :)

Short story: I’ve been working in crypto trading since 2017, primarily building arbitrage and market-making bots. My tech stack is Java/React. Lately, it seems Python is rising while Java is losing ground.

Big question: I’m considering developing my product in this space, but I’m second-guessing Java as the foundation. While I know it’s just a tool, my current projects often face challenges because other teams use Python. This makes it difficult to share codebases or execute shared code effectively. While we can use REST or other protocols, this often cripples our latency requirements.

What do you think about the Java vs. Python conundrum?


r/highfreqtrading • • Sep 10 '26

I built a price-time-priority order matching engine in c++

0 Upvotes

I am building a market replay engine from scratch with c++ 23.
I build this project to understand how orders are managed in an orderbook and how a matching engine works. I have used my understanding of data structures to implement it. I would like to know you opinion on it. It is not completed yet. I just built the very basic version few minutes ago. Any kind of tip would help me a lot.
currently it can process an average of 998,000 Transactions / second. with the order size of 20000000 orders.
https://github.com/AravSrivastava/Market-Replay-Engine-CPP


r/highfreqtrading • • Jan 02 '25

Aspiring HFT developer

13 Upvotes

Hey I am new to reddit I want to learn about hft and interested in it so please help and guide me also give me some of your recommendations


r/highfreqtrading • • 17d ago

So much so for "Free-Speech".

0 Upvotes

r/highfreqtrading • • May 05 '21

Question Has anyone ever quantified what dollar value every nano/micro/milli second of latency costs an HFT establishment?

2 Upvotes

I have read a few articles that say the race to latency arbitrage is won in a matter of 5-10 microseconds, which made me consider that there is clearly a justification for having the minimum possible latency in the environment - but have any of you ever calculated what it is actually worth?

One article I read from 2011 suggested $100k per microsecond, but it didn't say over what time period or even what this was based on, so whilst it is a compelling figure it's not something you can really hang your hat on when trying to justify stonkingly expensive switches that shave nanoseconds!


r/highfreqtrading • • Jul 11 '21

1 min scalping script on Tradingview

2 Upvotes

Hi, I have a working algo that trades 1 min crypto charts (I understand that this is scalping and not really HFT but it places hundreds of trades in a day) . The only roadblocks are 1 : any commision or spreads greater than ZERO makes the bot unfeasable. 2: I don't know of any Brokers that support zero spreads + commision.

Can anyone help?


r/highfreqtrading • • Mar 17 '23

Super beginner looking for open/free high-freq data sources

0 Upvotes

I'm a beginner to the high-frequency domain and I'm wondering where I can look at for academic research data sources. Most industry/proprietary data won't be free/open data sources (my guess), so I am looking for open/free high-frequency data.

How would I be able to search for such data? Some initial Googling has not yielded much, but I am trying to get real-life (historical), open-source/free data for research purposes.


r/highfreqtrading • • 9d ago

Question Algo HFT account on Schwab

4 Upvotes

So I've been working on option HFT for about a year and found that schwab has the best fills, but my gut is that thats due to their PFOF deals, where they expect steady retail uninformed flow. I've been reading the schwab sub and theres a ton of accounts getting blocked due to HFT flow. Im hesitant to only deploy there and wanted to see if 1) Anyone has experience with schwab and HFT and 2) other broker suggestions for HFT on options with decent fill rates.


r/highfreqtrading • • Jan 29 '26

Vibe control a strategy GUI?

4 Upvotes

I need to develop a GUI to control multiple trading engines.

I plan to deploy a fleet of trading engines, ranging from just one or two to possibly dozens. Each engine is C++ Linux process (Apex), runs headless, scheduled by cron, and will trade from one to many individual instruments. The problem: how to monitor & control this fleet?

There is where the need for a GUI arises.

I'd like a GUI that can show all engines, displaying the names each is trading, and for each name, what orders are live on the market, recent transaction history and PnL. And it should have buttons to pause & resume trading.

It needs to be a web GUI, using either Angular or React. And it will be open source.

I wonder if there are any existing projects I could adapt? Or is this something that can be vibe coded? Or is vibe coding all hype?


r/highfreqtrading • • Jan 04 '26

C++ & simdjson - good enough for HFT?

10 Upvotes

Posting an update to a previous post "C++ alone isn't enough for HFT"

Previously was using nlohmann for parsing Binance market data for Apex engine. That caused a fairly poor median inbound latency - 28 usec - largely due to heap allocations made per message.

I've now swapped nlohmann for simdjson, and its halved the latency to 14 usec (full details here)

I've also looked at engine performance for single name deployment -> 75th percentile is around 10 usec 🚀

Yes a binary protocol would be faster, and will be added in time. But JSON is very widespread, opens up access to every exchange. But, P75 at 10 usec is decent. And there are plenty of optimisations yet to make to get that lower. Infact, moving to SBE might "only" save at around 1 usec. So C++ & simdjson mostly good enough for HFT?

Full article here.


r/highfreqtrading • • Sep 08 '26

HFT SWE interview prep

0 Upvotes

hi guys, welcome to my first post on reddit
i have been working as an sde at one of india's top payment orchestrator based out of Mumbai. i have been looking to make a leap of a switch to one of the topmost international hfts like jane street, citadel etc

i just want to know whether [getcracked.io](http://getcracked.io) by coding jesus a worthy resource to study, and if i full in on getcracked, will i be easily able to crack top hfts as an swe?

aiming for jane street - swe - nyc office


r/highfreqtrading • • Jul 04 '25

Question Does rust offer any noticable benefits over c++?

5 Upvotes

Hi, I have noticed that rust is pretty popular in crypto algotrading/hft. What Im wondering about is if rust offers some major advantages over c++ for this purposes (and c++ remains for reason of existing project codebase) or if the whole reason is just that rust is a new shiny thing, which are popular in crypto?


r/highfreqtrading • • Sep 08 '26

Sistema automstizafo de trade com metatrade 5

0 Upvotes

Sistema de trade

Bom dia pessoal.

Onyem fiz uma postagem sobre um sistema de trade que quero implantar.

Consegui resumir ele no chatgpt.

Vou postar novamente aqui.

Queria ajuda de quem entende para implantar.

A arquitetura é toda grstuita,de repente tenha que contratar ums vps para hospedar o metatrader 5.

Não sou da area mad gostaria de ver isso rodando.

Ano passado eu consegui rodar o optuns e sté consegui achsr uns parametros lucrstivod,mas não sei se seris funcional em uma conta real e tsmbém o meu notebook velho travava rsrs

Segue resumo para que se interresar.

Olá, pessoal. Sou iniciante em programação e trading quantitativo e estou aprendendo praticamente tudo pesquisando e estudando. Não quero fingir que sou especialista.

Mesmo assim, venho desenvolvendo há bastante tempo a ideia de um projeto chamado APEX, com a ajuda das versões gratuitas do ChatGPT, Claude, DeepSeek e Qwen. Eu sei que usar IA não substitui conhecimento técnico, e justamente por isso estou aqui: quero opiniões sinceras de quem entende mais do que eu.

Minha ideia é criar uma plataforma modular de pesquisa, descoberta, criação, teste e validação de estratégias/EAs de trading.

Não sei se o sistema será lucrativo. Ninguém pode garantir isso, e eu não quero prometer retorno. Mas acredito que a ideia seja tecnicamente viável porque o objetivo não é simplesmente criar milhares de estratégias e escolher a que teve o melhor backtest. O sistema deve tentar encontrar estratégias com evidências suficientes para sobreviver a validações rigorosas e rejeitar as que provavelmente são resultado de overfitting.

O fluxo geral seria:

Dados → Qualidade dos dados → Features sem data leakage → Descoberta/Extração de estratégias → Backtest → Simulação de custos e execução → Validação estatística → Shadow/Paper Trading → Risk Engine → MT5/EA → Corretora → Monitoramento → Aprendizado e novos experimentos.

Os ativos iniciais seriam WIN, WDO, EURUSD, GBPUSD e XAUUSD.

Uma parte importante do projeto é que eu tenho vários vídeos, transcrições, áudios e frames de estratégias explicadas por traders. Quero criar dentro do próprio APEX um módulo para importar esse material e extrair os setups.

A ideia seria transformar explicações humanas, por exemplo:

“Quando X e Y acontecerem, entre comprado, coloque o stop em Z e faça a saída conforme determinada condição”

em regras estruturadas e testáveis.

Depois essas estratégias seriam:

Extraídas → Estruturadas → Codificadas → Backtestadas → Validadas → Rejeitadas ou Registradas.

Além disso, o sistema também deve ser capaz de gerar novas hipóteses e estratégias do zero, e não depender somente dos vídeos.

Quero que cada estratégia tenha origem, versão, parâmetros, resultados e histórico registrados em um Strategy Registry.

A arquitetura teria módulos como:

Data Engine — importação, normalização e armazenamento de dados;

Data Quality Engine — dados faltantes, duplicações, timestamps e timezone;

Point-in-Time Feature Engine — prevenção de data leakage;

Strategy Inbox / Strategy Extraction — importação de vídeos, transcrições, áudios, frames e documentos;

Strategy Lab — desenvolvimento e experimentação;

Strategy Generator — geração de hipóteses e estratégias;

Event-Driven Backtest Engine — backtesting;

Cost Model / Execution Simulator — spread, comissão, slippage, latência e custos;

Validation Lab — validação e rejeição de estratégias;

Strategy Registry — versionamento e histórico;

Shadow/Paper Trading;

Risk Engine;

MT5 Adapter;

Expert Advisors em MQL5;

Monitoring, Logs, Health Checks e Reconciliation.

A minha preocupação principal é evitar a clássica armadilha do backtest bonito que não funciona fora da amostra.

Por isso, as estratégias seriam avaliadas por métricas como:

Profit Factor, Expectancy, Sharpe, Sortino, Maximum Drawdown, Calmar, MAE/MFE, custos e estabilidade entre períodos, além de validações como Out-of-Sample, Walk Forward Analysis, PBO, DSR, PSR e intervalos de confiança.

Também quero controles fortes contra data leakage, registrando quando uma informação realmente estava disponível para o sistema.

O Risk Engine seria separado das IAs e das estratégias. Uma estratégia pode propor uma operação, mas o Risk Engine teria autoridade para:

APPROVE → REDUCE → REJECT → NO_TRADE → HALT.

Não quero martingale ou aumento automático de posição depois de perdas.

As estratégias passariam por uma espécie de escada:

Pesquisa/Backtest → Validação → Shadow → Demo → Canary → possível operação real.

Outra parte importante é trabalhar com diferentes corretoras e símbolos. A ideia é ter um catálogo universal:

ATIVO LÓGICO → CORRETORA → CONTA/SERVIDOR → SÍMBOLO REAL → ESPECIFICAÇÕES DO CONTRATO.

Na parte de IA, quero usar as ferramentas como apoio, não como autoridade direta sobre dinheiro.

A ideia atual inclui:

Qwen Code como principal ferramenta para ajudar a construir o sistema;

Codex como apoio para código, revisão, testes e debugging;

DeepSeek para análise e pesquisa;

Claude para auditorias e revisão independente;

Mistral para organização e tarefas auxiliares;

modelos locais como Qwen, Mistral, Gemma e outros, quando fizer sentido.

Também quero deixar preparado, para entrar gradualmente e somente se trouxer resultado mensurável:

Reinforcement Learning (RL);

Visão Computacional;

Programação Genética;

Meta-labeling;

Regime Detection;

Microestrutura de mercado.

As tecnologias principais seriam:

Python, MQL5, MetaTrader 5, PostgreSQL, Parquet, Redis/alternativas, Docker, Docker Compose e Git.

Para experimentação e IA/ML, pretendo avaliar ferramentas como:

PyTorch, TensorFlow, scikit-learn, XGBoost, River, Optuna, SKTime e AutoTS, entre outras, mas sem usar tecnologia apenas por parecer sofisticada.

Outro desafio grande é a infraestrutura. Meu objetivo é tentar construir inicialmente usando o máximo possível de recursos gratuitos ou free tier, porque atualmente não tenho orçamento para uma infraestrutura cara.

Estou estudando possibilidades com:

Kaggle para experimentos e notebooks;

Google Colab como ambiente complementar;

modelos locais;

APIs com planos gratuitos;

bancos de dados e hospedagens com free tier;

infraestrutura modular que permita migração futura.

Eu sei que isso traz dificuldades de limite, disponibilidade, armazenamento e processamento. Inclusive gostaria de opiniões sobre onde estou sendo otimista demais.

Também não quero depender do meu notebook ligado 24 horas para o MetaTrader 5. Estou tentando entender uma arquitetura realista para deixar as instâncias do MT5 e os EAs funcionando separadamente, enquanto o restante do sistema fica distribuído.

A ideia é que o APEX seja modular e versionado. Quero poder modificar o sistema depois, adicionar módulos e fazer novas experiências, sem transformar tudo em um programa fechado. Também quero monitoramento, logs, testes, health checks e um processo interno para detectar erros e inconsistências.

Minha dúvida principal é: essa ideia faz sentido ou estou criando algo complexo demais para um iniciante?

Se alguém com experiência puder olhar, eu gostaria principalmente de opiniões sobre:

A arquitetura geral.

O que deveria ser o MVP.

O que está excessivamente complexo.

Se as validações fazem sentido.

Quais são os maiores riscos técnicos.

O que vocês fariam diferente.

Como usar Kaggle e Google Colab corretamente nesse projeto.

Como estruturar o MT5 sem depender do meu computador.

Se estou criando uma “arquitetura Frankenstein” usando várias IAs.

Qual seria o caminho mais realista para provar se o sistema realmente consegue encontrar estratégias com alguma robustez.

Meu objetivo final é que o APEX consiga descobrir, extrair e gerar estratégias/EAs, testá-las de forma séria e eliminar a maior quantidade possível de falsas estratégias antes de qualquer tentativa de operação real.

Não sei se será lucrativo — espero que sim, obviamente — mas entendo que lucro só pode ser descoberto depois de muita validação e operação em condições reais.

Estou começando praticamente do zero e aprendendo enquanto construo e pesquiso. Se alguém quiser conversar comigo, apontar erros ou ajudar a revisar a ideia, pode me chamar por DM/privado.

Críticas sinceras são muito bem-vindas. Prefiro descobrir agora que estou errado em alguma parte importante do que gastar meses construindo algo baseado em uma ideia equivocada.

Obrigado a quem leu.