Tag Archives: queries

Today is deadline for your queries on Sat May 12 LIVE Python Algo Trading workshop

Today is deadline for your queries on Sat May 12 LIVE Python Algo Trading workshop

Send your questions right away to be included for the Saturday workshop. All members should get in touch via my contact. If interested join the ELITE membership list below.

 

Are you ready to Join any of the following

New course!! Building Python algo trading system with Bitcoin an crypto currency focus

Shopping Cart

 

Introduction to Quant Elite Membership

Market analysis: Fed analysis for USA economy outlook April 3

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

More Algo Trading database and charting queries

Continuing series of queries from the same member

Hi Bryan.

 

On your journey to build your trading system, you mentioned that you were going to use Redis 4 NOSQL.

But you also mentioned MongoDB, which I was watching another video from that european company that uses MongoDB.

 

Question:

Are you using Redis 4 because you are migrating to a Mac OS GUI environment because Mongo is for Linux or can Mongo also be used for Mac? I would assume that it doesn’t matter.
Is Redis 4 just better, faster than MongoDB, etc? Is cost part of your reasoning, etc?
I am leaning towards going the Mac direction as well and using Linux for the back end.

 

Keep in mind, I am serious about getting deeper into coding (a few people I know have done coding or are in IT careers that could and would assist me).
I’ve been using PC’s for the last 15 years mostly but no3

 

My sister, who used to build PCs installed Ubuntu on one of my PCs as a backup for my data in case I couldn’t access files through Windows.
I am side-tracking a bit I realize, but I thought context is important so that you realize I am not a total newbie with OS environments.

 

In one of your videos, you mentioned charting you were going to do on Mac, called “Colorec” … maybe I didn’t hear properly.
I did a search on it, and could not find anything or that other application I thought you said called “Telerec”… You spoke a bit quickly, so I rewound the video but couldn’t make it out.

 

You mentioned other charting applications like Chart Director and Gnunplot? Are those for Linux or PCs?

 

I answer in my usual video style here

 

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

Japan queries on HFT brokers

Japan queries on HFT brokers

Tsk tsk no one ever learns

http://www.bloomberg.com/news/articles/2016-01-28/japan-s-financial-watchdog-queries-brokerages-on-hft-dark-pools

 

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

And now a message from AerospikeDB to all my queries with a design for potential HFT

And now a message from AerospikeDB to all my queries with a design for potential HFT

This came from their business development manager at AerospikeDB. Hearing from a vendor is a very cool thing:

Hi Peter
Thanks but what is cost structure for Aerospike?
Thanks

AerospikeDB is open source. So it’s the customer’s favorite price: free. The Community Edition is free. Is and always will be. The Enterprise Edition, which includes XDR (Cross Datacenter Replication) and security features, amongst others, is where the costed product is. For small businesses, we also have a Start Up Special which is also free, and gets you the Enterprise Edition until you meet revenue numbers ($2 million in annual revenues, or $20 million in funding). For companies big and small, we publish the following price list:http://www.aerospike.com/products-services/

Also note that we only charge based on total data in your database; unlike a cloud provider, we do not charge based on usage of the data.

More comments are embedded below, which was part of your original email….

 

Hi Bryan! I am looking through your video. I will get back to you once
I have a chance to check it out in full. Very exciting stuff!

The one thing I will note is that Redis doesn’t scale beyond a single
server. So if you need scaling and performance, and especially
cross-datacenter replication (XDR), then Aerospike can do what Redis
just doesn’t do. They are attempting to solve scaling via clustering,
but it’s a work-in-progress, and certainly not mature.

 

Peter

I posted an hour long video that explains evertyhing I learned in
the last 5 years

[1]

_Final architecture walthru of automated trading Linux Windows based
system with HFT potential. Hail Python?_

This is an important 1 HOUR VIDEO to take away confusion for a
trading system. I talk about all the pros and cons of each language
including NOSQL vs SQL databases. I hope this covers everything.

In a way, yes, but I wanted to get a clear idea. It looks like you want to have the following:• A desktop (Windows-based) trading desk application (buys and sells); broker-level, but not “exchange-floor” or “HFT cluster”-level.

• Seem you want an application that would allow brokers to control up HFT, but not the architecture to actually *execute/run* the HFT.

• This is important, because you are looking to allow what you call “HFT”, but not really the sort of thing where people are doing silicon-based HFT architectures to actually put in automated trading systems (q.v., Cisco Nexus: http://www.networkcomputing.com/networking/cisco-flexes-custom-silicon-muscle-for-high-frequency-trading-crowd/d/d-id/1233885?)

Let me know if any of those assumptions are correct or incorrect, because the kinds of solutions you are talking about are orders of magnitude larger and more complex to actually create an HFT cluster.

Also, this article on the topic was interesting to me. It was from 2012:

Rather than just say “this is best,” or “that is best,” the real thing to do is to check out your data modal, and your application architecture. First, I noticed that you created a two-part model, which inferred a desktop client, and then some remote “server,” but the differentiation between one and the other wasn’t very clear. For instance, are you doing server-side analytics, real-time analytics, or non-real time? Is it all desktop-based, or will there be a component of server-based, or both?

For instance, you might want to do “live” analytics with Hadoop or Spark; we have connectors for both. But that’s the sort of “big data” analytics that would fry your typical PC.

Also, I am presuming that any server you are using would have some sort of “upstream” connection to the live markets, such as NASDAQ FIX API (which replaced CTCI) (q.v., http://www.nasdaqtrader.com/content/technicalsupport/specifications/tradingproducts/fixactspec.pdf).

My thoughts would that you would need a “three tier” model, with the actual market APIs connecting to the “first tier” — the markets themselves. Then the “second tier” would be some sort of brokerage-based (or service-based) big data aggregation, transaction and analytics engine. The third tier would then be the desktop trader/broker desks.

Something akin to this?

Inline image 1

Your desktop-analytics engine would be different than your server-side engine, just looking at a subset of the overall market data model. For instance, a single ticker symbol, or a set of them, or some time-series data.

Aerospike only runs natively on Linux. Though you could make it work on a desktop OS (Windows, Mac) with a virtual box, it might be best to use some other sort of local datastore for the desktop.Then the big thing would be to make sure you used some sort of data schema that would allow portability, such as JSON, so that data on the middle tier could be easily interchanged regardless of what desktop app, or even a “headless” transaction processing engine, was subscribing to it.

I do also see Redis is used for: To store real-time stock prices.

Again, Redis is fine if you are just doing a single-node architecture. But it’s not for a scalable middle tier. However, if you wanted to use something like MongoDB or Redis, or whatever for the desktop, that would be fine; the middle tier could still be optimized for performance and scalability on Aerospike.

If you want to try out Aerospike:

And if you want to have more of a discovery call, give me a ring. If you decide to use us, I’d love to sign a “Start Up Special” agreement with you, or have you use the Community Edition, and then get you to blog about your project more. It would, of course, have to pass the muster of our marketing team.

Let me know if that makes sense, and whether you’d like to follow up with a call.

 

I say very cool!! But let’s see how my trading idea with Redis goes ….

http://quantlabs.net/blog/2014/12/more-simplified-potential-final-architecture-walthru-of-automated-trading-linux-windows-based-system-with-hft-potential/

JOIN MY FREE NEWSLETTER TO SEE WHICH I GO ON THIS SYSTEM

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

Rithmic appears to be rubbish. Not enough sales people to handle institutional queries?

Rithmic appears to be rubbish. Not enough sales people to handle institutional queries?

Wow, what garbage services (or lack of) to supply an army of sales of people to handle potential customer queries. I don’t see what the hype is with this junk company if they cannot handle simple questions at 9:30 AM on a working day. I need to move on. What would their service be like? Or better yet their operations? I say junk. Avoid and move to the competition.

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!