PDA

View Full Version : Delayed Robot Signals for Today



Billy
07-06-2011, 02:11 AM
Due to technical difficulties with one of Pascal's computers, the robot signals pages will likely not be updated today before around 6:00 am NY Time.
No signal changes are expected.
I will post my daily outlook soon after the robot pages are updated.
We apologize for the inconvenience.
Billy

asomani
07-06-2011, 03:13 AM
Thanks for the heads up, Billy.

Harry
07-06-2011, 06:22 AM
FYI - I see Pascal updated the IWM robot, please note the strength of todays signal is missing.

Pascal
07-06-2011, 07:01 AM
FYI - I see Pascal updated the IWM robot, please note the strength of todays signal is missing.

It is corrected. Thanks!

Pascal

TraderD
07-06-2011, 01:38 PM
It is corrected. Thanks!

Pascal

Out of curiosity, how long does it take, in compute time, to generate the daily signal(s)?

Trader D

Pascal
07-06-2011, 03:49 PM
Out of curiosity, how long does it take, in compute time, to generate the daily signal(s)?

Trader D

The robots signals are the final step of a night long process over three computers.


Pascal

TraderD
07-07-2011, 02:33 PM
The robots signals are the final step of a night long process over three computers.


Pascal

Thanks, Pascal. That sounds like a lot of calculations. Is shortening the calculation time the main challenge in generating real-time signals?

Pascal
07-07-2011, 03:07 PM
Thanks, Pascal. That sounds like a lot of calculations. Is shortening the calculation time the main challenge in generating real-time signals?

We need to change the technology.
I am now using Visual Basic on Excel.
The real-time system will use a distributed Java processing technology that executes incremental calculations from different computers located on the net. Basically what we call "cloud computing" technology.
The algo themselves stay the same.

Pascal

TraderD
07-07-2011, 03:23 PM
We need to change the technology.
I am now using Visual Basic on Excel.
The real-time system will use a distributed Java processing technology that executes incremental calculations from different computers located on the net. Basically what we call "cloud computing" technology.
The algo themselves stay the same.

Pascal

Thanks, that explains it. Cloud processing is one approach to speed up calculations of a distributable algorithm. Another approach is to use a GPU card (NVidia or ATI) that contains hundreds of processors. Programming is done under a somewhat "different" development paradigm but becoming popular nevertheless (e.g. http://www.nvidia.com/object/cuda_home_new.html). GPUs are also now available on the cloud tho they're rather cheap to own.

Trader D

admin
07-07-2011, 05:42 PM
TraderD,

We have looked into CUDA early on, but it is comparatively difficult to develop for, just C++ is production-grade. For real-time options trading, it's probably a must. For our case, we are good enough with a Java distributed cache-based solution.

Actually the heaviest parts of the algorithms, when tuned, have shown orders of magnitude enhancement and have been used by Pascal for "peeking" into the likely trend of the day towards the close. But the aim is to get to an end-to-end integrated system that can boot, set itself up, follow the data feeds incrementally, and be able to recover from failures in a reliable pattern. This is a lot of infrastructure, and one of the reasons the system is not here yet. Thankfully modern trends are closing the gap quickly - and making things more manageable for us.

Thanassis

adam ali
07-07-2011, 06:18 PM
Thanassis,

To you and everyone responsible for developing, maintaining and enhancing the architecture of the site, a big shout out. Thanks.

TraderD
07-07-2011, 07:06 PM
TraderD,

We have looked into CUDA early on, but it is comparatively difficult to develop for, just C++ is production-grade. For real-time options trading, it's probably a must. For our case, we are good enough with a Java distributed cache-based solution.

Actually the heaviest parts of the algorithms, when tuned, have shown orders of magnitude enhancement and have been used by Pascal for "peeking" into the likely trend of the day towards the close. But the aim is to get to an end-to-end integrated system that can boot, set itself up, follow the data feeds incrementally, and be able to recover from failures in a reliable pattern. This is a lot of infrastructure, and one of the reasons the system is not here yet. Thankfully modern trends are closing the gap quickly - and making things more manageable for us.

Thanassis

I can appreciate the infrastructure challenges, in particular robust recovery mid-way through an incremental calculation that has to be repeated every X minutes during the intraday session. Java development is of course quite more enjoyable than C++...

Pascal
07-08-2011, 02:47 AM
However nice it will be to have near real-time signals, I would like to remind everyone that the whole EV web site and the Robots are today based on old 2001 Excel processing.

To me, this means that "thinking straight" is still more important than "running fast".
Having both would not hurt though.



Pascal

admin
07-08-2011, 09:56 AM
>To me, this means that "thinking straight" is still more important than "running fast".

Absolutely, and this aspect makes all the difference in the world.