Multi-Agents LLM Financial Trading Framework(github.com) |
Multi-Agents LLM Financial Trading Framework(github.com) |
Anyway, I have been running my own trading experiment and so far it has lost a bit of money. That being said I have not tried to optimise anything - just let it do whatever it wants. The losses are small and it might be able to recover later this year. Who knows.
The agent writes a blog about its progress here https://trades.chatbotkit.space/
I am thinking to output all the chat logs to HF as well for research.
You can run your own trading agents that communicate over a message buss in your own terms by downloading the CBK platform and running it locally with your own models. I have also shared my trading blueprint if you want to give it a go. https://chatbotkit.com/hub/blueprints/trader
I actually have a profitable trading agent, and hell no I will not open source it. It also looks nothing like this. For one this bot is ingesting a shitton of noisy sources that have almost no signal and using them naively.
Maybe agentic trading still performs worse than ETFs. But alternatively, if it were meaningfully better then it would be okay to opensource, similarly how ETFs are publishing their portfolios.
When I started working no the trading agent I mentioned above I wanted to see if it can be just a better investor over the long run. The intention was not to do high-frequency trading. As you can see most of the days it is not taking any actions. The losses where down to mistakenly setting the stop losses too close to the top. If it wasn't so careful it might have made some money tbf.
My gut feeling is that AI agents will be able to manage a long-term portfolio much better than a human. Though it is just a gut feeling.
Put simply, if you open source your magic recipe, the behavioral change will affect the prices and you recipe will not work anymore.
That being said, I think the parent AI is using paper money. Though who knows, this is the brave new world of AI.
I had done a small experiment with 100$, but would be hesitant on more than that. I suppose if it's money you're willing to lose.
Secondly, browsing reddit for sentiment and doing technical analysis is not even a feature in the trading world. At the most basic level, these are lagging indicators. Something on options IV and premiums would have been closer to the mark.
Hedge funds are akin to the maintenance crew for markets, we keep them efficient and liquid. The process is quite scientific, you come up with a theory and validate with real data. Or you go from data to theory.
- Yahoo News is introduced twice (sentiment and news analysis) which double weights it
- Sentiment analysis prompt primes the model to be bullish on Nvidia.
- In the self learning loop there is a complex parsing bug that results in hallucinated memories when agents return truncated responses
- You can completely control sentiment analysis of a subreddit by simply maintaining a majority of the 5 most recently posted messages, regardless of any quality metric
- The reflection prompt states the agent must cite alpha, which in a market wide downturn causes it to think correctly placed calls were losses
Eeh, yeah? At that point I'd stop reading the code and just leave the project behind. How exactly is the prompt doing this right now?
They have zero guards against market manioulations, and will get wiped without bull market!
I can see the intention behind crawling social media and news feeds to determine some 'evidence', but am not sure if that's the best approach or even if an LLM is the best way to get an assessment, or whether having so many input sources is a good idea.
These are necessary and perfectly sufficient for an investment firm thesis I believe.
I’ve been doing a fairly similar experiment, but I ended up moving in almost the opposite direction than what this framework purports. deterministic code decides what is actually legal to trade, handles sizing/risk/execution, and an LLM (nanobot architecture) only gets to rank the already valid candidate set. If the model fails or times out, deterministic ordering takes over, so only the -nth degree of data actually makes it to the non-deterministic part (haha).
The hard part hasn’t been making the agents smarter/skillset but getting clean, fast data, preserving exact order/fill lineage (Postgres) and separating bad selection from bad execution or exits without leaking future information into the analysis
The multi agent debate stuff is interesting, but if every agent is reasoning over the same stale or incomplete inputs, I’m not convinced you gain much. I’ve built PoCs for my same project, and a round robin of LLMs is just hallucination and self approval city. Better data and tighter decision boundaries seem to matter more
https://www.pangram.com/history/8597362a-878d-4548-afb6-30fa...
https://stonks.jettdigital.app
edit: i just talked to my little sister ("Ginger" on the leaderboad) who is doing a good job beating the sp500. She said she just asks her ai what she should invest in and then executes those trades.
I've heard that high frequency trading eats market opportunities within milliseconds of spotting them now though, basically making the market even more random. The catch being that human nature isn't random, it's stochastic, so there will always be more money to be made on trades (or else trading firms wouldn't exist).
I'm thinking about getting back into trading because AI represents the end of buying software and we'll all be out of work soon, even if we're in denial about it. But everything I invest my time and energy into turns to crap. In a very real sense, as soon as I start trading, then karmically that could trigger recession, market reforms which ban what I'm trying, or even the end of money. I'm kind of joking and kind of not.
I've worked on a lot of really hard stuff over my brief but stupid career, and am basically used up mentally and physically, at least for now. Quant stuff is easy with AI. Should I try it?
Whatever the stated purpose is, where can I read the test results to show it accurately fulfills that purpose.
Anyone can make a markets simulation that models interactions between market participants. Making a simulation that is accurate enough to be useful for anything is hard.
Although I don't think it even matters. They could easily cherry pick a period that is favorable for them. Wasting time and money on short term trading, rather than long term investment, using LLM or not, is never a good strategy for most people.
https://chatgpt.com/share/6aa00d5e-6920-83ee-8e3e-9cbf23f7bd...
I might contribute to this, my public github is looking stale for headhunters
There are times when I wonder if couldn't just draw then in a BPMN designer that allowed me to write custom code for nodes. Is BPMN still a thing?
This part is lost on many. The value of data is in the theories it confirms or more importantly disconfirms, and defining the trading edge is not easy after accounting for costs. I am wary of black-boxes that produce an edge - not only because I dont know how it works, but also because regimes shift unpredictably, and what works today may stop working tomorrow. That being said, AI can be useful to help automate many routine processes just like any other software.
but...
options premiums imply volatility.
Lagging indicator would still be useful if it was accurate before the event. After the event, its just lagging history.
technical analysis is using historical data to make future predictions. No professional trader would trade anything without looking at price history.
Now it may be possible with models like Astra that you no longer need to do this, but in earlier models it was beneficial.
So I might want a macro economic read which leads to a market thesis. Then I would hunt for exposure, then evaluate the candidates across different aspects. Breaking the process up at least made sure no steps were missed and the different aspects considered.
There's always risk somewhere in a financial system.
So, very simply, if AI can actually do better at picking a better long-term winner then it will increase growth.
I have been running an intermittent experiment with a multi agent "investment firm" for over a year now across model releases.
They certainly can beat indexes, BUT.. the model families have some biases that you have to design around. The stop loss that bit the parent is certainly one. The models like to create rules. Often rules, one of those is making all kinds of exit conditions.
Another big one from my experience is the bias to inaction in a scenario with risk. This means a model without structure around it will bias to keeping too much cash.
Buying stock based on coin flips can beat indexes short term too, that does not mean it is a better strategy or that it works over the long term.
However with that said they are a huge multiplier and can tirelessly analyze the market for you.
They certainly can be used to beat sp 500 quite easily, but again that requires some understanding of risk on your part because the models will do what you ask them. If you go all in on options or something without clear risk management you will lose your ass.
But ETFs do have to follow particular rules defined by their product description. So it is still interesting to benchmark against.
The idea that somebody here came up with idea that all professional algo traders didn't explore to the last penny a year if not more ahead of others is funny... but its not my money adding liquidity to the markets.