If I ask for X at Y. Someone else shouldn't have the facility to buy it based on my own trade signal and try sell it back to me.
It is mindblowingly simple theft. The arguments for liquidity do not hold. There is some fascinating cognitive dissonance when it comes to the HFT industry.
If you walk through a physical market where 8 apple carts are lined up, all selling apples for $1, buy every apple at cart #1, then buy every apple at cart #2, and so on, would you be surprised to find the price moving up or sellers stepping away as you approached carts #7 and #8?
The same thing happens when trading. Securities trade on multiple markets and multiple exchanges cannot match cross-market trades atomically. It's absurd to suggest that one side of the trade should be expected to close his eyes to what's happening in the world around him and sit tight while a huge trader runs his quote over. Why is one party more deserving of a good price than the other?
If you route to one exchange only there is no way for anyone to see or react to your marketable order before it executes, ever. If you route your orders intelligently, it can be very difficult or impossible for anyone to pull away before you get your fills. That's the executing broker's job. Instead of getting better at his job, this broker would rather complain to a very vocal conspiracy theorist who has been proven wrong many times in the past by people with actual experience and data: http://zacharydavid.com/bad-research/the-hunsader-follies/
If some guy had a business where his sole service was to sit in the apple cart market waiting to front run me and then immediately sell the apples right back to me, I'd be surprised and super pissed.
From the article:
>Also note how the cancellations rotate through many different exchanges. That's one sure way to throw off, confuse, stall a smart order router.
Or you know, because it's multiple market participants that are updating their prices.
>Someone else shouldn't have the facility to buy it based on my own trade signal and try sell it back to me.
What? If you're the owner of a bakery and you see a guy buying every single bread that your competitor is selling, wouldn't you increase the price of your own bread in case this guy comes to you?
You are selling stuff, someone or some people buys a big bunch of it, you think it sells good an rise the price later, now the someone has to buy the stuff for a higher price.
The only difference is the time between the first buy and the second buy for a higher price.
Even if you send your buy-orders at the same time to two different sellers, they don't have to arrive at the same time and if the second seller has "heard" about the first sell, he has enough time to rise the price.
One way to fix this is to delay your orders carefully so that A, B, and C will all get your order at almost the same time. Now there's not time for someone who sees your order on A to react and send a message to C that will beat your message to C.
I believe this is what IEX does: http://en.wikipedia.org/wiki/IEX
What A does do is delay the output. When it receives an order it doesn't immediately broadcast that information back out, it waits some small (but relevant) period of time.
So why don't exchanges do this? They make a ton of money in fees, it simply isn't in their interest to prevent HFT at the moment. Change their incentives (ie. regulate differently) and they might actually do something about it.
There are 2 major issues that no one brings up when they say "simply add discrete auctions". A) what happens when there are more participants on 1 side of a price than on the other, what is the tie breaker after price? B) How does this solve the distributed systems problem of multiple exchanges trading at the same time?
I don't fully understand the conditions under which you can cancel an order but it seems all the cancellations happened on exchanges where no orders had yet been fulfilled so I assume this means that the order had not yet arrived. This seems ethically just about OK to me but a sign that there is not one single stockmarket and that the system could be far better designed.
There is the single front-running trade which is suspicious but it seems plausible (unless it happens every time) that it was just a small random trade that happened to coincide with the timing of the big trade. It should be monitored though.
My conclusions:
1. There is not one single market with a number of available shares but a number of linked markets. Send your trade to a single exchange (first at least) with enough offered shares that it should execute before offers can be cancelled. Wait, repeat.
2. Much of the liquidity supposedly offered by HFT is illusory and disappears if you try to use it.
I think that the market could probably be improved if cancellation weren't free or at least weren't instant. If cancellations took a second (maybe 100ms or 10ms would be enough) to process and the offers could still be accepted in that period the offers made would be more serious and although the spread might be slightly larger it would more honestly reflect reality.
There are two exchanges, A and B, and a market maker Jill is quoting (say) 10,000 shares on each of those two exchanges for $17.
Big institutional trader Jack sees the 20,000 shares and decides that he wants to buy 15,000 of them, so he sends two orders for 7,500 shares each to A and B. Because of various effects (network latencies, routing switching delays, whatever) his order arrives at exchange A first, and is immediately filled at $17.
Jill, who has her computer co-located at exchange A, sees that she has sold 7,500 shares for $17, and realizes that there is demand for shares. Because of this demand, she decides to raise her prices. She immediately cancels her remaining 2500 shares on exchange A and replaces them with 10,000 shares at $17.05 and sends an instruction to do the same thing at exchange B.
Because Jill has fast computers and low-latency connections, her cancellation arrives at exchange B before Jack's buy order, so Jack is told that there are no longer shares available on exchange B at $17.
RESULT: Jack is filled for 7500 shares at $17 (half of what he requested) and the new market best offer is $17.05. Jack is welcome to submit another order for $17.05 if he wants to buy at that price. Jill is now short 7500 shares at $17, and will try to buy them back at a lower price (she may or may not succeed - until she does, she is exposed to the risk of further price rises).
Jill was able to use her speed advantage to detect that there was additional demand to buy this stock, and raise the price at which she was willing to sell it before Jack had finished buying all that he wanted to. This is exactly the way that an efficient market is supposed to work - it reacts to fluctuating demand (and other information) to set appropriate prices.
I think there are several things that get glossed over while people are working themselves up about this -
1. Jack is upset because he couldn't buy 15,000 shares at the price he wanted to buy them. But Jack has no god-given right to be able to buy shares at the price he likes best. He is subject to the laws of the market, just like everyone else.
2. The only reason that Jill has a speed advantage over Jack is because she has paid for it! She has paid to co-locate her server at the exchange, and she has paid to use high-speed connections between exchanges. Are we going to declare that paying for a competitive advantage is suddenly immoral?
3. If Jack doesn't like this state of affairs, he has several options. He can invest in high-speed infrastructure as well. He can use smarter order-routing logic (e.g. adding delays to his orders so that they arrive at the exchanges approximately simultaneously, or splitting his large order up into multiple smaller orders). Or he can use a broker who will do these things for him. If Jack doesn't want to pay for any of these things, then he has to put up with lower quality execution. As much as he might wish it, the ability to buy as many shares as he wants at the price he wants them is not a universal human right.
It's not clear to me that either of these are Bad Things, deontologically speaking. [I don't recall Jesus mentioning them.]
The key question is consequentialist: Are there regulatory changes which would improve the lot of the average investor, investing through, say, an index tracker or pension fund? For each potential change, one ought see how it fares w.r.t. this standard, considering, to the extent that it is possible, the induced second-order effects.
Talk of theft, rigging, fairness (you don't owe people like me anything), stolen goods and frontrunning is only useful to the extent that it helps us converge on an answer to this question. These words are tools that we have developed for analysing more familiar situations, where they correspond to actions which are clearly harmful.
Most changes proposed here either lose market efficiency directly (trade buffering / increased tick sizes) or just give us new games to play (if the market clears once a second, we will get our orders in last), potentially resulting in a less direct loss. The question remains.
The post is written as if the world should freeze once the client sends an order. He was 'stolen' shares. Really?
Were the 24k shares being offered by one seller/broker, as in "I have 24k shares to sell at 17" or was the 24k just an aggregation of the availability all the smaller offers?
If the former, it seem to me that the seller is cheating, if it is the latter then I can see how the HFT systems would raise the price in response to a sale, but I also see how frustrating that is to the buyer.
I wonder why these trades are not being performed in parallel across the various exchanges, partially preventing this kind of arbitrage?
The shares were being quoted on different exchanges, at the same ask price. 24k was the cumulative volume that the buyer wanted, but that couldn't be fulfilled by a single exchange (the quote was for a smaller volume at that price). Therefore, to buy 24k shares, the buyer needs to trade twice, once at each exchange.
> I wonder why these trades are not being performed in parallel across the various exchanges, partially preventing this kind of arbitrage?
As has been pointed out, this is what a good broker will do - they will compensate for latency to make sure that bids arrive at differing venues at the same time to prevent the market shifting underneath them. A naïve broker will simply send out the bids at the same, and latency means that they arrive at different exchanges at different times. This lets the sellers at the more distant exchange move the market in response to the information of the trade being executed at the closer exchange.
Why is one actor paying for an advantage that is available to anyone who should desire it, and have the means to pay for it, an issue?
That's what it is: People are seeing the orders pour through the various exchanges, and are reacting to it. If they were seeing the orders before they hit the exchanges, that would be front running, and it would be illegal. But Nanex appears to be showing people responding to orders after they hit the exchanges, and that would seem to be legal and moral.
The moral is that if you want to buy so much of a single stock that you can't even buy it all from a single exchange, you MAY end up paying a bit of a premium, unless you're quite good at hiding what you're doing. And in this example, the purchaser was not. It's a story as old as markets.
After all, the market is supposed to be useful for organizing long-term investments. The short-term stuff is pretty far removed from the progress of society.
It's legal, yes, but you can't make a jump to moral so easily.
I don't think it's necessarily immoral either, but morality depends on much more - what the end results are, who is affected, what kind of effect, etc. Morality doesn't exist in the vacuum of an isolated decision.
It seems there is only one clear winner here - the IT people making money off developing HFT systems.
http://www.ft.com/intl/cms/s/0/ff8c6486-cb37-11e3-ba95-00144...
Spreads used to be a quarter, and now they're a penny! That's a huge deal!
Would it be possible, legally and technically, to put a special additional fee/tax onto high-frequency trading while leaving normal high-volume traders alone?
tc qdisc change dev eth0 root netem delay 100ms 10ms
High Frequency Traders are selling a service (liquidity). A tax on them is mostly just a tax on their customers.
What's the difference between trades and quotes here in this chart? And how are the trader's order and purchases indicated?
A trade is an announcement that an offer was accepted and a contract was agreed on. "10g of gold have been sold at 40$ each". The identity of the traders is typically known only by the exchange, and each of the trader knows they are part of it, but don't know the counterparty.
This rotted apple should not hide the good part of HFT, which is to reduce spread and inconsistencies between markets and to generate profits from this (positive) action. HFT took the place of traders, who were paid a lot for doing that stupid task.
What do you mean that the cancellations aren't instant? If they can outrun a bid to accept them that is instant as far as I'm concerned.
You see an order come in for 5,000 of them on Amazon. You think "Hot dog, these books are popular. I must be selling them too cheaply!" You immediately raise the price of all the books by 25 cents to capitalize on this.
The books you sold on Amazon are sold, so they're gone. The remaining books on Amazon are slightly more expensive.
The guy who bought the books on Amazon also bought the same number of books on eBay, but the order hadn't arrived there yet, so between when he hit the buy button and the time the order arrived, the price had changed, so those orders aren't filled.
I can sort of see that but I don't quite understand why there are different exchanges. I can't see the benefit except to those for whom it is an arbitrage opportunity.
I would also expect there to be low cost systems by which you could place simultaneous orders on all exchanges (at the cost of a slight delay in the order starting to allow them all to be posted at the same time as the furthest one.
The HFT still seems to add little real liquidity. The spreads that are shown may be narrower but the real spread seems much higher.
I personally don't have a problem with this type of trading activity. A few guys are making easy money. So what?
Someone shouldn't need to use Thor or some other delaying mechanism to accept open offers. The latency between different exchanges (which was exploited in this example) does nothing to increase market efficiency.
You're right that I shouldn't care about this as a practical matter, as the impact on me is very small, but that doesn't mean it's right.
I really appreciate the clarity in your comments on this thread.
The job of a market maker is to supply liquidity at a price/risk tradeoff that is reasonable to them, subject to the information available to them. If there are multiple exchanges, and someone trades with them on one exchange, then the set of information available to them has changed (specifically, their knowledge of the supply/demand balance for a particular stock has changed). It's only natural that they will want to change their prices in response.
Now, we could change legislation to either (a) go back to having a single exchange or (b) restricting the ability of market makers to move their quotes on one exchange if they trade on another. But that won't necessarily result in a better deal for non-market makers, because instead of quoting 20,000 shares split across 4 exchanges, the market maker now quotes 5,000 shares on 1 exchange.
The benefit is that all market participants have a more accurate idea of the true liquidity available in the market. The disadvantage is that you have removed the element of competition between exchanges, so the exchange is no longer incentivized to offer low fees and keep improving its service.
I've heard a bunch of explanation about liquidity and how HFT allows for large orders to be fulfilled, but it seems like this is quite the opposite.
What purpose does this serve? Is society as a whole better off when Jill is able to make this .05 per share more? I wouldn't frame the debate as 'god given rights' and 'competitive advantage'. What I really want to know is why a society where trades and quotes happen on a millisecond scale is better off than one where they happen on a second scale.
It's an honest question. Someone please convince me.
Before 2001 the minimum tick size on any exchange was 1/16th of a dollar ($0.0625) and before 1997 it was 1/8th ($0.125), so the absolute minimum you would pay for a round trip (buying a stock and later selling it) was that much. Frequently, the bid-offer spread would be many ticks wide, so you could easily be paying $0.25 or $0.50 for each round trip.
The current minimum tick size is $0.01, and there are many stocks which trade at that level. Even if you suffer $0.05 of slippage on a round trip, you're still better off than you would have been under the old regime.
In the old regime, instead of high frequency traders, you had floor brokers who would work orders. Fortunately, floor brokers were paragons of virtue and morality, who would certainly never front run their clients orders, and would take any trade even if it worked to their disadvantage (NB in case you don't get it - this is sarcasm. In the 1987 crash, most brokers wouldn't even pick up their fucking phone because too many people were trying to sell stock, and the brokers didn't want to buy).
I honestly find it hard to believe that some people think that was better than what we have today.
---
Edit: The other thing I don't get is why ordinary investors (by which I mean anyone with less than $100m to invest) care about this. For a small investor, you are actually getting an even better deal because your order for 1000 shares or whatever can get filled instantaneously, in one chunk, for a great price! It's only when you're trying to buy hundreds of thousands of shares in a few minutes that you end up suffering price slippage.
The standard response is that ordinary investors have their money invested in mutual funds and pensions, who are large investors. But in that case you are already paying 0.5-2% per year to your fund manager, and why do you give a shit if they lose 10 basis points (0.1%) in price slippage because the market is more efficient than it used to be?
In fact, why is my pension fund manager trading so fucking much anyway? I don't have a pension because I think the fund manager is some genius stock picker, I have it because it's tax efficient and my employer contributes to it. Just buy the S&P500 and sit on it.
Here's the problem with that: the number of available ultra-close connections to the market is finite. If you carry this out to its only possible conclusion, whomever has the closest connection always wins, and everyone else always loses. The other market participants eventually realize that it is simply not possible for them to win, and that a closer connection is not for sale at any price, so they simply stop participating. This solves one problem - people stop losing money - but also destroys the market.
Arguments of the kind "let's carry this to its logical conclusion" are almost always fallacious, because they ignore limiting factors, or alternative explanations.
If your only advantage is speed then you need to have the fastest connection to the exchange, else your business model doesn't exist. If you have other advantages, then speed is less important. Nowadays there are very few market makers whose only advantage is speed, because most of them realized that continually paying through the nose to compete on speed is a mug's game.
You've also got a very peculiar definition of winning. A person who wishes to buy 10,000 Ford shares who places an order at $17 only to find that in the meantime the market has shifted to $17.01 and therefore purchases at that price hasn't "lost". They set out to buy Ford stock at market rate, and that's what they ended up doing.
If we want an efficient market,we need perfect information. Information asymmetry creates inefficient markets.
The moral argument behind free markets is that it leads to "efficient" outcomes. If people are going to do bullshit like this, there's no reason _not_ to set regulations to stop this.
There is no market anywhere in the world that is 100% efficient, because the costs of getting to efficiency are prohibitively high. It's like trying to reach the speed of light - you can expend more and more effort getting closer and closer, but you can never actually reach it.
I'm not saying that what we have now is perfect, but it's a damn sight better than what we used to have.
It seems like the disagreement really lies here. I'm not a finance expert so I'll probably get a few things wrong but is it fair to summarize the two perspectives as follows?
1. Jill is merely quoting a price for independent blocks of shares on independent exchanges. If a buy order is placed against that quoted price, she has the right to reissue quotes elsewhere. This is no different from Jill selling apples at the market on 1st street, as well as at the market on 2nd street, then receiving a large order on 1st street that prompts her to call her sales manager on 2nd street and have him increase the price of apples there. Or for Janice, sitting next to Jill's stall on 1st street, overhearing the sale at $17 and repricing her apples upwards for when the demand inevitably spills over to her stall.
2. Jill is making an offer to sell a combined block of shares at a particular price. Even though her offer is broken up over multiple exchanges, since a single buy order can execute on multiple exchanges her offer should hold across all of these exchanges. Yet she is taking advantage of the physical makeup of the market to bait large orders (thereby revealing market demand) and then switch to higher prices (thereby capturing a larger profit).
I emphasized "quote" and "offer" above because they capture two different concepts in contract law. I'm not sure if the concepts are the same in financial markets but the principle seems to be at the root of the disagreement. If Jill was merely "quoting", unless the rules of the exchange specify otherwise, she is free to reissue her quote and therefore perspective #1 makes sense. If Jill was making an "offer" however, presumably she should be bound to the terms of her offer regardless of the physical details around how she publishes that offer, reinforcing perspective #2.
So: do the market rules have such a distinction? I found the link [1] below which suggests both perspectives are valid - depending on the type of market one is participating in, if I understand it correctly. Is this a matter of people confusing the two types of markets? (I have to say that perspective #2 seems pretty impractical to me in markets with multiple exchanges participating, and #1 doesn't negatively impact the market -- either it makes economic sense for Jack to pay the new price or not, why do we care if he saves a few bucks if we fiddle with the rules?)
[1] http://www.investopedia.com/ask/answers/06/quoteorderdrivenm...
I don't know much about contract law, but it may be interesting to know that a resting order on exchange, with a set price and size, is called a quote.
The terminology offer is used in financial markets for a resting order to sell, distinguishing it from a bid which is a resting order to buy, although many market participants will actually use the terms bid and ask rather than bid and offer. Whether this is to avoid confusion with the contract law term, I have no idea.
It won't surprise you to learn that I also think that your perspective #2 is unworkable in a situation where you have multiple exchanges (how would it work - would you require that quotes on exchange B must remain for a specified period after a quote on exchange A is hit? That doesn't seem sensible).
Note in a perfect auction it should be Jill who receive the $17.05; but exchanges are more like (millisecond fast) mail-order catalogues, where the prices you quote are fixed the moment you send off your order. It would piss many people off that you only got half the items you wanted every time because the listed prices "went up" in between the time you mailed your order; but it would also make the whole thing closer to an auction.. so that's that.
The market maker is not sitting there to let you run him over and thank you for it.
As a price taker, the trader has to incur slippage due to the market impact of his large order.
If you go to a store, the store owner sees you take your apples up to the counter, and so he can theoretically change his price before you get there (although in practice, if he ever did that he would soon be out of business).
On a financial exchange, the market maker doesn't even find out that you wanted to buy until the trade has already happened. It is literally impossible for the market maker to change his price, because he doesn't find out about your order until it's already occurred.
What is possible is that the market maker is also quoting on another, totally separate exchange, and he decides to change his prices there, in reaction to seeing a big order on the first exchange.
It's like an apple seller who owns two carts in different parts of town. When you come to his first cart and buy all his apples for $2, he guesses that maybe you are going to go over to his second cart and buy all the apples there as well, so he calls his business partner who's running that cart, and tells him to raise his prices to $2.50 - which makes perfect sense as a business strategy, because demand has gone up.
Note that he only raised his prices because you bought all the apples at his first cart. If you just bought one apple out of the hundreds he has (because you're a small investor, not a giant investment bank) then he wouldn't bother to raise his prices.
A much better one is to think of a string of gas stations running down the highway. They all have an advertised price. A tanker truck arrives at the first gas station and buys all the gas at the advertised price. It then goes down the road and buys all the next stations gas at the same advertised price. Then the manager of the 2nd gas station calls the 3rd and says hey, we've just gotten wiped out of gas there is a lot of demand. The 3rd manager raises his price accordingly. The tanker truck can then decide if it wants to buy more gas at the new price or just take what they currently have.
"Fresh Apples here! Only the best apples for 2 dollars!" - "I would like every single apple you have, please. Also I'm buying all the apples from the guy across the street too." - "Thatll be 2.05 each, sir." - "What? I thought you just said 2?" - "Demand has just gone up."
Your description of how companies are pricing orders is exactly what's happening. On a given exchange no cancel can outrun a bid to accept a resting order. In fact, you don't have any idea that the bid has arrived until after a trade has happened.
What is being described in the article is that a trader is viewing an aggregate of all exchanges as if they were one exchange (either due to ignorance, naivety, bad tools, or due to misrepresentation). The trader then takes out an entire price level at one exchange (none of those orders are cancelled) before trying to do the same thing at the other exchanges. The participants who just got filled at exchange A, then cancel their orders at exchange B. To the trader who was viewing multiple exchanges as a single entity this seemed like it happened all at once, but to the traders who were viewing the exchanges, correctly, as different entities there is a timeline that is observable and public (in fact nanex describes it).
You'll notice that there was a quote at exchange A and exchange B. You reached for, and got, an apple at exchange A. Now you're trying to reach for an apple at exchange B and you're surprised that it's a different price.
People are mostly pissed because the time between reaching for the apple at A and B is so fractionally small that they feel there shouldn't be a difference in price. That's really the only issue they have.
This is a very HN specific way of thinking (and probably obvious given the startup culture here) but it is not a truism. Many, many, many (perhaps most) market participants are not involved in the markets to organize long term investments. They are there to hedge risk (whole classes of exchanges exist nearly solely for this, think commodities markets).
But that is the glory of the markets. You can be a participant who is looking for long term investment, Southwest Airlines can be there to hedge risk, and I can be there to make a dime fast and we can all participate in what seems to be a zero sum game and win.
Fun fact: HFT has an annual revenue ~1/50th[1][2] of Google's. What's worse: a few hundred people wasting their time moving prices of select stocks a few pennies, or several thousand wasting their time collecting scary amounts of data about you to try and get you to click an ad?
[1]http://en.wikipedia.org/wiki/High-frequency_trading#Market_s...
(a) what we have at the moment is still a lot better than what we had before - incremental progress!
(b) it's not at all obvious (to me) that discrete time steps would be better than what we have now. Market makers would be taking more risk, so that would quote in smaller size and at wider spreads, which could make trading more expensive for everybody.
That doesn't disprove my statement. The "multiple competing market makers who are all profitable" all have extremely fast connections to the market. They compete on relatively equal footing speed-wise, and so other factors come into play. But everyone outside of the small group of players with that speed advantage will always be paying a tax to those who do. And good luck compensating for your lack of speed by out-predicting large teams of MIT-educated quants with unlimited technology budgets. As an individual investor, your only hope for profit is that market values of the stocks you invest in rise by more than the tax you have to pay to HFT's. You better buy and hold, because with every transaction, you're paying them an additional tax.
When market values are rising, these effects go unnoticed because everyone is generally making money. That doesn't make the tax we are paying to these HFT's any more fair or less damaging to the market.
Then again, I have no idea about these things and should probably shut up.
"someone wants to buy a number of shares at a quoted price"
"a giant investment bank or hedge fund with some privileged
information about a stock wants to buy so many shares that
they actually need to go to multiple exchanges to satisfy
their demand"
As anyone with a lick of understanding in technology has to ask, why the hell do they need big spools of fiber to negate HFT systems? Can't they implement low latency time stamping much cheaper? I suppose that a box full of computer chips won't impress big named "journalists" nearly as much as a spool of fiber though...
It's actually a quite elegant solution, and most likely cheapest: it gives you very precise, reliable, repeatable, order-preserving delay for one-time installation cost and you don't have to pay to developers, wait for software to be written and debugged and don't have to buy additional hardware!
But the key word in your example is "simultaneously", and it's the thing that did not happen in this example. This is more like "I bought all the apples at the first cart, and by the time I got to the second card, half the carts had raised their prices, and most of the apples at the remaining parts had been bought by enterprising traders who decided there must be something special about apples all of a sudden".
It's hard to see the problem. Or the solution.
The first solution is to forbid multiple marketplaces for a single virtual asset. Honestly, the service provided by these marketplaces is very simple, and could be provided by a non-profit organization that is bound by law to ensure low barriers to entry. This would be a win for everybody, really.
The second solution is to enforce that markets operate on a synchronized heartbeat with sealed bid changes. It would work somewhat like this:
T=0: Bids from the last heartbeat are published; market starts accepting bids for the next heartbeat, but those bids remain sealed T=1: Market stops accepting bids T=2: Trading engine matches bids, executes orders, and publishes all bids; market starts accepting bids for the next heartbeat, but those bids remain sealed (that is, the market is now in the same state as it was at T=0)
Have one time unit be something like a minute, and force markets trading the same asset to be sufficiently synchronized.
Do we, in point of fact, even have a problem that needs solving? The core complaint is some unnamed institutional trader really wanted to buy a very large number of shares in one go at a very low price, while other institutional traders wanted to sell the shares at a higher price. Why are we meant to care who wins that fight?
If it wasn't possible for people not directly involved in those individual purchases to listen in and react to them quicker than the broker can fulfil the remaining purchases, it wouldn't be a problem. What is going on may well not actually be illegal, but as an individual trader it's not something you'd expect to be able to happen so it's definitely worth knowing about.
This isn't a perfect analogy, but it's close.
You're making the mistake of thinking that HFTers are inserting themselves between the buyers and the people offering to sell. That's not right. The HFTers ARE the ones offering to sell.
Speed shouldn't be the factor for why this isn't acceptable. The seller doesn't know that there are orders in the queue for the eBay order, they're just raising the price. That they're doing it quickly is just a matter of efficiency.
> I can sort of see that but I don't quite understand why there are different exchanges.
Yeah. No idea there.
> I would also expect there to be low cost systems by which you could place simultaneous orders on all exchanges
There are.
That said, I'm not an expert in the field, and I've just pieced this information from other posts. I have no strong opinion on the matter, but after throwaway's explanation (and all the subsequent discussion), my uninformed position agrees with his; that this article is exaggerative, and not indicative of anything being 'rigged'.
Moving fast, at least in my opinion, isn't cheating.
If they were raising the price on Ebay in response to the same customer's buy offer on Ebay, I would consider that unseemly, but not even necessarily unfair, as it only assumes that the buyer is willing to pay the newly raised price, and has approximately as much risk of losing the sale as making it.
What I do wonder is if these market reactions are so automatic and predictable whether there is a way to game them (I'm sure people already do this). It is probably a deterrent to front running on a large scale.
B) Yes, market making HFT are routinely fighting against other HFT that are designed to predict their behavior and make money from them.
The case for allowing it is simple. How do you disallow it without having even worse outcomes. There is quite a bit of evidence that suggests that for the average market participant HFT market makers are a positive not a negative.
In general it's also pretty scummy to do it. Imagine a shop seeing you taking items from shelves at an advertised price and saying "Well that shows there's demand in these goods so we're raising the prices on everything in the customers basket before they get to the checkout."
Your analogy is not all how HFT works. A better analogy would be a string of gas stations going down the highway. A tanker truck comes to the first one and buys all it's gas. Then the second one, and then the third. The manager at the third station calls the fourth and tells them to raise their prices. How is it scummy to do that, but not to buy up all the gas at what is clearly a too low price?
I don't believe this is necessary to make markets work.
What markets should do to be efficient is invest in clever, talented people doing clever, talented things.
Every step back from that is economically inefficient, because it makes it harder to create a population with deep reserves of wealth and opportunity.
Games like this one are the equivalent of having someone cut in front of you on the freeway in a semi.
It's not efficient, it's just banal abuse of a system that is supposed to reward good ideas and filter out bad ones.
Is this proven somewhere or you just assume the optimal strategy for markets is continuous?
I mean, it's not clear that the optimal strategy for "slightly imperfect markets" is at all close to the optimal strategy for markets with perfect information. And I actually doubt it can be proven, in the general case.
I've asked a couple of economists about this, but didn't get a satisfying answer. To be fair, it wasn't their area at all - and I may just have misunderstood what they were saying.
I don't think this follows at all. It isn't clear that if the assumptions are almost true the outcome reasonably close to that if the assumptions were true.
Even if it does hold true remember that economists view monopolies as perfectly efficient solutions but that in that scenario it is efficient because the monopoly captures all the available value not the consumers. I also believe that the maths behind the efficient market hypothesis break down if its assumptions don't hold.
Not really. The stock market is a giant pool of money. These parasite traders are nothing more than leaks in that pool. With enough of these leaks, the pool runs out of water. Additions of water to the pool (through a combination of rising market values and more investment) at various times will overshadow the effect of the leaks, but they are there nonetheless.
A person who wishes to buy 10,000 Ford shares who places an order at $17 only to find that in the meantime the market has shifted to $17.01 and therefore purchases at that price hasn't "lost"
Actually, they have lost. They lost 10,000 pennies, or $100, and received absolutely no value in return. That money is gone, never to return, into the pocket of an HFT. It has simply evaporated from the market.
Last I checked, the stock market was a market. Anyone is allowed to play, and like most things in life, you can pay to upgrade (either your connection, your analyst talent, etc. etc.). Look at the recent Barclays dark pool fiasco to find out what the liquidity in a market without HFT and transparent books looks like.
Well, when you have a pool, and water is constantly being sucked out of it, even a tiny bit at a time, eventually you will have no water left in the pool. Not a hard concept.
If I could wave a magic wand then we would have one exchange which was run as a public service, by some beneficent person with no profit motive. I don't have a magic wand :(
I agree that the current situation is the result of the market structure (multiple competing markets) but I don't agree that this is how markets are supposed to work. The reason I say this is that people with no knowledge of market microstructure (e.g. ordinary people or people with undergraduate degrees in economics) would not expect this kind of 'arbitrage' to be possible. I hesitate to call it front-running because this is a term better reserved for instances where a client relationship and non-public information exists.
I take your point that the situation we have now (multiple exchanges without specialists) may be better than we had before (a single exchange with specialists) but I still don't think it's _fair_.
I wonder what would happen if I could wave my magic wand and have multiple exchanges with no specialists and zero latency...
It's possible there's some massive downside to that, but afaict the advantages of liquidity that market-makers provide mostly accrue at larger timescales. So it's not clear the millisecond-shaving game is really improving markets (though it provides interesting challenges for technologists).
There is always a locality advantage in the market, this has been true as long as there have been markets, and it will be true forever. Why do we as market participants care?
The other problem with your scenario is that you make market making more risky. The riskier it is, the higher the profits must be. This means that the market makers must keep the bid/ask spread higher (their means of making a profit). This cascades to all of us in the form of higher execution costs.
The problem with the current scenario is that it makes market making more expensive, as it requires a lot of technological investment into the microsecond arms race. This means the market makers must pull in more revenue from their trading to cover these expenses, before they even get to thinking about making a profit. This cascades to all of us in the form of higher execution costs. The huge amount of money being spent on HFT infrastructure, software development, etc. is ultimately being paid by market participants. It's worth considering if this is an arms race worth funding to the max, or if 99% of the benefits could be had much more cheaply just by putting a floor on execution latency, thereby rendering this whole millisecond-shaving industry unnecessary.
At the very least, I'd be interested in seeing rigorous models that show a benefit to, say, markets that can trade at 1-microsecond granularity vs. 1-millisecond vs. 1-second.
http://www.linuxfoundation.org/collaborate/workgroups/networ...
It would be a wonderful thing to see all of those millions these guys have "invested" shaving a millisecond or two off their transaction times laid waste by a single command.
We don't just need it to be random. We need there to be no way of ever quite knowing if any given order will beat another order to the exchange (within a given time period, of course). They won't know if they can beat joe ordinary, and they definitely won't know if they can beat the other HFT's. That might be enough to put a lid on it.
Edit: For those playing along, here's the metaphor. Joe goes to market to buy sheep. Bill knows Joe is going so he sends a fast runner ahead of him to buy the cheapest sheep in town first so he can mark them up and sell them to Joe when he arrives. We try making everyone wait at the town gate for a random amount of time to give Joe a chance to arrive and get through. So Bill (being very rich) just sends 10 guys so one is very likely to be let in before Joe anyway. Next we introduce the stochastic filter. We make everyone line up and then shuffle the order every once in a while, but Bill still has more guys so he might still get one in first more often than not. Finally, we add the token bucket. For every one guy that we know employed by Bill admitted, we make the next one wait twice as long to get in, so if Joe and 10 Bills show up, Joe and the first Bill are essentially on even footing again because the 2nd through 10th Bill would have to wait too long to matter.
Not convinced about that statement about average market participants, also define average market participant and explain where the HFT's profits come from if not other participants.
How do you disallow it?
My initial suggestion was to slow down cancellations so that they take substantially longer than a new trade does to pass through the system. My perception is that it might reduce the visible liquidity/availability but not the real liquidity as much of the visible liquidity disappears when someone tries to trade against it.
Another suggestion would be to move to a single exchange
There have ALWAYS been sellers of liquidity. Due to automation human sellers have been replaced by computers that cost far far less. So the cost of liquidity has gone down DRAMATICALLY. Spreads used to be a quarter (or higher). Now they are a penny. That's a 25x reduction!
Here's the chief executive of Vanguard (the world's largest mutual fund company) talking about how HFTs have lowered trading costs for their clients:
http://www.cnbc.com/id/101615521
If you slow down cancellations or otherwise try to slow information flow to HFTs you will simply raise their risk which will force them to raise the price they charge for selling liquidity by increasing spreads.
Stop thinking of HFTers as parasites and think of them as service providers and you'll have a clearer picture of reality.
Note: This is not the behaviour I expect to see of share trading platforms but it is the way consumer goods sales should behave.
http://www.marketingmagazine.co.uk/article/1181195/real-time...
[0] A small shop could probably do it much quicker than a large supermarket which might have to allow for people being in there for an hour.
As I look around the markets, I don't see a lot of participants that are there to lose money. The ability to make a profit from market activities is central to a correctly working market.
So what actually ends up happening in a market with multiple competitive market makers? To make money, a market maker needs to trade a lot of volume. The only way to trade a lot of volume is to put up the most aggressive (worse for the market maker, better for end users) prices at any time. Market makers can only do this by charging a smaller spread than their competitors. They can only charge a smaller spread by either reducing their margins or getting smarter at deciding when to be in or out of the market, usually a combination of both. The end result is extremely tight markets that react to information very quickly (i.e. cheap to trade and very efficient).
Competition keeps markets honest. If you had one very fast guy, he would clean up, but when you have a dozen guys who are roughly equally fast, they all compete one another down to barely making profit above their cost of doing business. Only the most efficient can survive. If anything, we want more HFT by removing barriers to entry rather than creating a lot of regulations that would ironically help incumbents by killing off weaker competitors.
The single biggest cost to any market maker is their market risk. Latency is exceedingly cheap in comparison. Any increase in latency raises market risk thereby raising their biggest cost.
I've seen estimates that the entire high frequency trading industry made $1 billion profit in 2013, down from $5 billion in 2009. [0]
In contrast, JPMorgan made $6 billion profit in the last quarter, and that was reported as "not particularly impressive"! [1]
[0] http://www.reuters.com/article/2014/04/06/us-dark-markets-an...
[1] http://dealbook.nytimes.com/2014/07/15/jpmorgan-earnings-dec...
stomps foot
There are many markets where you list a product for a price, and are legally bound to sell them at that price.
Those markets function, proving that withdrawing quotes is not necessary to make markets work.
Seriously, how many times have we discussed this issue on this site and we still get this bullshit. Bill doesn't know Joe is going. He doesn't. Get it through your thick heads.
That was my reading of the article - it seems that either there is a flow of information from the trading events to the fast traders, or the scenario portrayed in the article was very unlikely (though I guess that couldn't be ruled out given how much trading there is). noonespecial's metaphor seems to apply, what have I misunderstood?
He doesn't know with certainty. He can guess that's what Joe is doing, but he could be wrong and be stuck with sheep that he can't sell for the price he intends to ask. Every second he owns sheep is a second he's taking a risk that they'll go down in price, not up.
From what I've gathered, through methods like "pinging" the market with many tiny transactions in likely spots, Bill can sound out what Joe is doing in the sheep market. Supposedly the market exchange will also "flash" the information about buy and sell orders to the HFT's in favorable network locations a few ms faster than the general public as well. Figuring out that Joe is buying sheep are what all of the "brilliant minds" that are heading into HFT everyone is talking about are doing. They're watching the road for Joe. Also Joe is not a small investor, he's a rancher that buys lots of sheep. Small investors don't place the kind of orders that HFT can attack.
Do note that this metaphor really only applies to the Front Running section of HFT, and really evolved from a fanciful attempt to coagulate network layer and application layer solutions into one magical unicorn fix. (Its kind of more about how tc works in linux than how markets work. :) )
I've probably misunderstood something, but it certainly seems to be an issue that gets people very exercised. I presume there must be some competitive advantage in being fast, otherwise people wouldn't do it, so surely the only real issue is whether or not the consequence of exercising that advantage is socially advantageous?
You drive up to a gas station, listing one price on its sign. By the time you pay, they've changed the price.
You see a house for sale. You make an offer, at that exact amount. There are no higher competing offers, but they want to back out.
You have legal recourse in each of those situations.
2) Actually, at least in New York there are no regulations that discuss the large roadsign pricing signs at gas stations. The law just says the price on the pump must match what you get charged. If they change the price at the pump but get behind on updating their big sign you are SOL.
3) People back out of selling houses all the time.
And for all of these it's worth pointing out that what we're really arguing about is time scale. No one would argue that the gas station (for example) wasn't allowed to sell gas for a different price today than it charged yesterday right?
Bid and ask prices for securities just change prices faster than what we're used to for retail products.
To really expand the scope of this discussion it's worth noting that time scales for retail product price changes are actually shrinking. Walmart has experimented with electronic labels in stores that allow them to change prices in real time. Uber changes prices in real time based on demand. It's interesting to watch consumer reaction to these new trends.
And I guess securities don't have any "this offer good for [x seconds]" on them. That's totally counter-intuitive to laymen, and speaking as a professional layman, I'm pretty sure I'm getting screwed because of it.
Electronic labels - you should be able to reserve a price for a time. Like, you want that shaving cream for $1.45, then you should be able to scan your Walmart member card at the electronic label to reserve that price. Should be valid for an hour, or a day, for up to X number of them.
...because the nightmare of picking it off the shelf, and the price is different when you check-out is just awful for consumers.
...and just to ramble a bit more... Sometimes it's cheaper for me to DRIVE to City A, fly back to my town, and then fly to my real destination than it is to book a flight from my town to my real destination. That's crazy, and I'm totally getting screwed, and I hope laws are enacted to stop that.
Iit would be nice if folks looked at the data instead of falling back on their irrational gut logic.