Tag Archives: Cluster

Redis cluster pushes 1.2 million insert per second

Redis cluster pushes 1.2 million insert per second

Whoa this is serious fast! Those metrics blows the doors off of Deltix HFT system

http://highscalability.com/blog/2014/8/27/the-12m-opssec-redis-cloud-cluster-single-server-unbenchmar.html

Now embed it something like this Facebook Torchnet could get very interesting.

Facebook open source Torchnet for AI

Join my FREE newsletter to learn more about embedding something like Facebook Tensor (LUA) into Redis NOSQL

HOW DO YOU START A PROFITABLE TRADING BUSINESS? Read more NOW >>>

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

Is 100% Redis fast than GPU/FPGA cluster for HFT?

Is 100% Redis fast than GPU/FPGA cluster for HFT?

I am looking for any expert opinion in this field for potential high frequency trading use the performance of a FPGA vs 100% Redis. All according to something similar to this link:

IBM Accelerates Power8 Clusters With GPUs, FPGAs, And Flash

[11:58:45 AM] Bryan Downing: there is this http://www.enterprisetech.com/2014/10/02/ibm-accelerates-power8-clusters-gpus-fpgas-flash/
[11:58:52 AM] Bryan Downing: the closest i could find
[11:59:02 AM] Bryan Downing: fpga is complicated but redis is easy to setup and maintain
[11:59:18 AM] Bryan Downing: it is free to so i think the performance could be adequate for 100% redis

Question is: could this FPGA/GPU cluster faster if you choose to be 100% Redis? Or at least is there the potential?

Please let me know by getting in touch via my contact form lower right. Thanks

Join my FREE newsletter if Redis is just as fast as a hardware solution

 

HOW DO YOU START A PROFITABLE TRADING BUSINESS? Read more NOW >>>

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

NOSQL Redis cluster tutorials

NOSQL Redis cluster tutorials

Here is a list

http://redis.io/topics/cluster-tutorial

https://groups.google.com/forum/m/#!topic/redis-db/OZB68Bq4Kwg

I love this site: https://www.digitalocean.com/community/tutorials/how-to-configure-a-redis-cluster-on-ubuntu-14-04

http://ilyabylich.svbtle.com/redis-cluster-quick-overview

http://antirez.com/news/69

Droplets: https://www.digitalocean.com/community/tutorials/how-to-create-your-first-digitalocean-droplet-virtual-server

Join my FREE newsletter to learn more about Redis cluster

 

HOW DO YOU START A PROFITABLE TRADING BUSINESS? Read more NOW >>>

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

Matlab on Biowulf cluster at NIH

Matlab on Biowulf cluster at NIH

This is possible but Mathworks has its own cloud service as well

http://biowulf.nih.gov/apps/matlab.html

Join my FREE newsletter to see how Matlab and cloud go together

HOW DO YOU START A PROFITABLE TRADING BUSINESS? Read more NOW >>>

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

Is a cluster of 16k core practical for quant trading research?

Is a cluster of 16k core practical for quant trading research?

Uh I said crazy things when I had a Vic 20 in 1983 but wtf you going to do with this many cores for a trading idea?

http://www.cs.washington.edu/events/colloquia/search/details?id=1338

Thanks to the NYC Contact for sending

Join my FREE newsletter to learn more about building clusters for trading

HOW DO YOU START A PROFITABLE TRADING BUSINESS? Read more NOW >>>

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

Open source Puppet for scale Matlab cluster for parallelism

Open source Puppet for scale Matlab cluster for parallelism

I must give full credit to you the usual Skype contact.

He suggested this open source to potentially automate. He said:

that installs and configures every aspect of matlab
[9:24:21 PM]  and reuse it
[9:24:29 PM] scaling out to 1,000 machines
[9:24:30 PM]  with the same install
[9:24:36 PM]  and if someone changes it
[9:24:40 PM] it just redoes it automatically
[9:24:43 PM] detects any change

Pretty genius but I have never implemented this?

Let me know what you think?

Join my FREE newsletter to see if this is worth pursuing

HOW DO YOU START A PROFITABLE TRADING BUSINESS? Read more NOW >>>

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

NOSQL Redis in memory database now closes its weak gap: Videos on cluster and failover for new version

NOSQL Redis in memory database now closes its weak gap: Videos on cluster and failover for new version

This is a presentation by the founder of this impressive NOSQL true open source solution

Join my FREE newsletter to learn how we can use Redis to our trading advantage

HOW DO YOU START A PROFITABLE TRADING BUSINESS? Read more NOW >>>

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

Are there workaround for weakness of Redis for cluster and sharding? Excellent NOSQL comparison PDF links as well

Are there workaround for weakness of Redis for cluster and sharding? Excellent NOSQL comparison PDF links as well

Decent comparison of leading NOSQL databases:
http://vldb.org/pvldb/vol5/p1724_tilmannrabl_vldb2012.pdf

Redis still show as a top contender but the limitation of sharding,failover, cluster, etc is a limitation. Here are some hopeful  workarounds

More Redis cluster and sharding capable info links:

http://stackoverflow.com/questions/27140459/does-spring-data-redis-support-jedis-sharding-pool

 

Join my FREE newsletter to see if Redis is still leading open source  NOSQL solution for trading

HOW DO YOU START A PROFITABLE TRADING BUSINESS? Read more NOW >>>

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

Looking for opinions on Redis 3 cluster and protocol opinion. Anyone? Anyone out there?

Looking for opinions on Redis 3 cluster and protocol opinion. Anyone? Anyone out there?

This is all brand new but how does it rack up again Storm, Kafka, and other frameworks in terms of performance.

http://redis.io/topics/cluster-tutorial

 

http://redis.io/topics/cluster-spec

 

Now you should have your own Redis cluster with 20 master nodes and automatic failover up and running.

http://big-elephants.com/2014-04/clustering-redis/

http://java.dzone.com/articles/12m-opssec-redis-cloud-cluster

It looks like Reds Cluster is supported in the Java Client Jedis: https://github.com/xetorthio/jedis

Does this enable you to ignore other libraries like Kafka or Storm?

Join my FREE newsletter to see what answers come out of this

HOW DO YOU START A PROFITABLE TRADING BUSINESS? Read more NOW >>>

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

What is your opinion of this Cheap Ubuntu Linux CPU cluster for your quant trading model generated by Matlab or C++ ? Affordable FPGA?

What is your opinion of this Cheap Ubuntu Linux CPU cluster for your quant trading model generated by Matlab or C++ ? Affordable FPGA?

Discuss here:

http://quantlabs.net/academy/forum/technical-forum/cheap-ubuntu-linux-cp-cluster-for-your-trading-model-generated-by-matlab-or-c-affordable-fpga-this-product-came-from-london-based-quant-httpshop-adapteva-comcollectionsp/#p59

Join my FREE newsletter to see if I might use this cluster

HOW DO YOU START A PROFITABLE TRADING BUSINESS? Read more NOW >>>

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!