Search
× Search
Tuesday, November 19, 2024

Archived Discussions

Recent member discussions

The Algorithmic Traders' Association prides itself on providing a forum for the publication and dissemination of its members' white papers, research, reflections, works in progress, and other contributions. Please Note that archive searches and some of our members' publications are reserved for members only, so please log in or sign up to gain the most from our members' contributions.

Can external storage with 3 microsecond latency add value in a Trading Environment?

photo

 private private,

 Thursday, October 16, 2014

I've just started work at a company that develops storage products that can do a consistent round trip I/O in 3 microseconds. Can anyone think of a slam-dunk use-case for this?


Print

5 comments on article "Can external storage with 3 microsecond latency add value in a Trading Environment?"

photo

 Thomas Tomiczek, Owner at NetTecture & Trade-Robots

 Monday, October 20, 2014



And even if - I use last year drives (Sasung 843T 960GB reconfigured to 750GB) and get 35000 IOPS at 99.9% of the time. On top of that i have a 1 gb cache in the raid controller that is secured (no battery but a condensator). That is enough for backtesting - for the trading it is a total overkill. As I Said - the main problem with cases of trading even an SSD would be challenged to run out of a cache. David, traders do not send billions of orders per second that are meaningfull. Which means the data is not that hard to buffer. This is the main problem., And when you talk about network (writing to an adjacent server) you suddenly compete with Infiniband - and there you really do not talk microseconds on the network at all. Infiniband is WAAAAAAY faster.


photo

 Thomas Tomiczek, Owner at NetTecture & Trade-Robots

 Monday, October 20, 2014



You do have great use cases, just not in the trading / trader side. Analysis possibly - data warehoues. High volume transaction systems (like EXCHANGES that need to record all transactions).


photo

 private private,

 Friday, October 24, 2014



Hi Thomas,

Thank you for your comments. I do understand your point about the volume of trades and caching them in DRAM and I'm just about ready to take your advice and concentrate on Analytics and exchanges. I suppose I'm still questioning whether the latency of the 35,000 IOPS plays any part in the success of your business. At 35,000 IOPS from an SSD configured to 78% of capacity, you are probably seeing a latency of around 500 microseconds, +/- 300 microseconds. Would your business be more profitable if those IOPS completed faster, or are the IOPS completing fast enough that the business advantage in reducing the latency to 3 microseconds is negligible?


photo

 Thomas Tomiczek, Owner at NetTecture & Trade-Robots

 Friday, October 24, 2014



I see a lot less latency - and I do not particularly care because this stuff is used in a traditional database. It is used in relation to trading (backtests, analysis) but it is used like a data warehouse. Nothing in there is real time, and a 500ms delay would just mean the screen oipens half a second later. And then - I keep most data in memory ;) I do not WRITE that much. It is very had to get from a storage IOPS / Latency to a front end latency in a data warehouse / large data analysis scenario, especially when memory is involved as buffer.


photo

 private private,

 Friday, October 24, 2014



Thanks Thomas. I think I'm going to concentrate on the situations you've suggested and also on in-memory data grids, where the amount of data is large and almost by definition the response time is important.

Please login or register to post comments.

TRADING FUTURES AND OPTIONS INVOLVES SUBSTANTIAL RISK OF LOSS AND IS NOT SUITABLE FOR ALL INVESTORS
Terms Of UsePrivacy StatementCopyright 2018 Algorithmic Traders Association