Losing in faith in the Microsoft development and server ecosystem is grinding my Windows network environment to a halt
counterproductive Please be patient I try to up date this site. All MS Windows are screwed with some process slowing them down. This has been hindering the development for the systems I am working with. It is definitely not malware or a virus as my Norton should catch it. It seems that it is a full time job to maintain a Windows systems so I am considering going Mac front end desktop with Linux back end. I have a few other developers moving off of Microsoft .NET as it is proving to be counter productive for this type of development with HFT.
How important is microprocessor speed in the HFT ecosystem?
Its not the speed of the individual systems but the aggregate data models speed in coming together. This is a simplistic view of a very complex set of problems with latency factors for each layer as well as each delivery channel and application.
Simultaneity and the ability to react in advance of the market-workflows by fast-telemetry and its operations opens a number of potentials and new infrastructure control issues to prevent infrastructure-based frauds. So yes to some extent the speed of the HFT system is key as is the latency of the channels it talks to the exchanges it deals with.
Our solution by the way is to provide NIST UTC Services everywhere the trading platforms are operating. This makes compliance with the OATS and basic risk processing in secured computing much easier to document from a forensic standpoint
HFT will go to GPU and/or FPGA based computers/applications soon. CPU’s cannot keep up.
Agreed – that’s why I already have NTP running as a stand alone process in the GPU. The CUDA GPU Direct rocks!
It all depends. If your network connection is not very fast, it makes no sense to invest in sophisticated solutions such as FPGA. Definitely it is better to invest your time and money in the optimization algorithms in C/C++ and possibly fast CPU.
GPU is not a particularly good option in the HFT. With GPU you gain high throughput and the possibility of parallel computing, but if you want to have ultra-low latency definitely a better choice will be a FPGA
do you have any links/papers that compare the benefits/drawbacks of using FPGAs vs GPUs?
No and don’t have time to look for them… or to argue that I’m right. You just can compare the speed single CPU core vs single core on the GPU. Next consider that the communication from the GPU (and threads) consumes a lot of time and even if the GPU is integrated with the CPU it must be manage by the chip (like C204 or C206 for the new Intel CPU’s). Be aware that your software will run on OS, which means that the access to CPU/GPU will be based on the syscalls. Also remember that the OS allocates CPU time based on the scheduler, so you can speed up your code if you isolate the code from the os scheduler. The FPGA does not have the OS and all your code is directly in hardware.. so this is the fastest solution… but as I wrote at the beginning, I don’t have the time to explain everything…
GPU is good for the HPC.. and HPC != HFT 🙂
Pay your attention what they say about the cpu’s threads.
FPGA’s are the fastest right now but multi-threading is ever improving in GPU’s. I think the eventual winner will still be a GPU. If the logic changes, the FPGA still has to reconfigured. People are already selling FPGA SDK’s fairly cheaply.
DearApple? R U killing your iPhone or iPod ecosystem why not being so developer friendly? #apple #ipad #iphone
Take it from my perspective. If I know my C++ and Java, why do I need to re work with a new language called Objective C. Also, why do I have to spend a couple of hundred of bucks to join Apple’s developer program. I still have no guarantee my application for iPhone, iPad, or iPod will make it in the ITunes stores. Unlike Google, it will make it in the Android Market with no hassles. That is satisfactory for me to start developing. As it stands, I have no real incentive to develop for iTunes as Apple could refuse it. That is not worth the risk.
So guess what? Most Java and .NET developers will jump ship and focus on their Android or upcoming Windows 7 Mobile. As we know, it is the third party developers who make things happen. I mean, Google have done a phenomenal job at attracting them. Microsoft has always had them with their strong user group presence and budget for free pizza and pop. Where is iPhone? I just learned Adobe is giving out their Flash Builder 4 now as they realize they are losing out on this subpar technology.
Back to Apple. This goes out to those who are those who have just jumped aboard Apple tech juggernaut. First, where were you in the mid nineties when Apple was on its deathbed? Were you still in your diapers? If so, you might want to take heed? Very carefully.
Apple killed itself years ago because of its ‘our sh*t don’t smell’ attitude. Guess what? I had direct dealings with Apple five years ago. I don’t think I would ever work with such snob company ever again. Their public relations people were the worst to deal with at the world’s largest tech related trade show. I mean, they were the only confrontational company. They seem to pick who they work with unlike their completion.
Once again, they are the same point with this same attitude. I start to think that Apple only hire people who take could take a crap in a toilet and it would smell like a rose. Seriously, within Apple will have no solid future as their product pipeline has died? What is their next killer app? So Apple. Be nice to your developers or you will end up like Nokia and Blackberry as they write their obituaries as large corporate vultures fly around.
Good luck. Just my thoughts.