Navigation

    Backtrader Community

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    • Search
    For code/output blocks: Use ``` (aka backtick or grave accent) in a single line before and after the block. See: http://commonmark.org/help/

    Performing a "large" backtest - which VPS is suitable?

    General Discussion
    1
    1
    845
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • T
      Taewoo Kim last edited by Taewoo Kim

      I have a test case where I'm testing combination of 5 variables with about 7-8 variations.. so between 5^7 and 5^8 scenarios (using optstrategy)

      I have a pretty decent laptop (intel i7 + 12 gig memory) but it takes way too long. I tried splitting the tests into 6 and launching them separately onto 8gb ram VPS on digitalocean (that claim 4 "CPUs" => not clear if vCPU or physical). They are even slower than my machiine ( i ran them over night - 8 hrs -
      and spit out < 100 results per vps).

      As far as optimization goes.. i'm using sklearn in algo and pandas to feed cerebro . I made sure I pickled everything and load pickle as necessary. But that's about it. I specified "maxcpus" to match that of the VPS.

      As far as passing data, I'm passing 1 year worth:

      1. first data (data0) is pickled pandas data frame
      2. second data (data1) is the same, resampled at higher timeframe

      I am launching multiple tests with different time frames (1min / 1 hr, 15 min / 2 hr, 1hr / 1 day... you get the idea). One thing I noticed was that with a year's worth of data with optstrategy, there's a SIGNIFICANT delay between cerebro.run() and the first strategy.next() call. Where is the delay coming from and how can I speed it up?

      I've read the optimization post... and from htop, it looks like CPU is maxing out before ram ever even hits 50%

      Any ideas on server / speeding it up?

      1 Reply Last reply Reply Quote 0
      • 1 / 1
      • First post
        Last post
      Copyright © 2016, 2017, 2018 NodeBB Forums | Contributors
      $(document).ready(function () { app.coldLoad(); }); }