@run-out Anyway, thanks for your support, it works!

@run-out Yes, now that you mention it I remember I saw the pull request, but I don't understand why it's not merged yet (it was commited on june).

@run-out Here you got it (last columns are sma20 and sma50):

o h l c v d s symbol max52w min52w sma20 sma50
ts
2020-02-18 85.110069 85.527370 83.987318 84.245651 2872500 0.0 0 A NaN NaN NaN NaN
2020-02-19 84.156212 85.288892 82.914237 84.802040 4741300 0.0 0 A NaN NaN NaN NaN
2020-02-20 84.354941 84.444359 82.824826 83.798531 2543600 0.0 0 A NaN NaN NaN NaN
2020-02-21 83.361355 84.543710 82.864565 84.523842 1762500 0.0 0 A NaN NaN NaN NaN
2020-02-24 81.692144 82.059763 79.506263 79.983185 2919200 0.0 0 A NaN NaN NaN NaN
... ... ... ... ... ... ... .. ... ... ... ... ...
2020-11-24 118.959999 118.959999 111.430000 114.680000 5559900 0.0 0 A NaN NaN 108.683499 104.917219
2020-11-25 116.089996 116.959999 113.410004 114.349998 2862500 0.0 0 A NaN NaN 109.317999 105.209415
2020-11-27 113.769997 114.980003 112.940002 114.089996 983700 0.0 0 A NaN NaN 109.921499 105.502801
2020-11-30 113.889999 117.070000 113.669998 116.900002 3778400 0.0 0 A NaN NaN 110.661999 105.856778
2020-12-01 117.580002 118.379997 115.040001 115.360001 1753700 0.0 0 A NaN NaN 111.167999 106.204910

Using btalib crossover an error is shown:

Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pandas/core/computation/expressions.py:200: UserWarning: evaluating in Python space because the '-' operator is not supported by numexpr/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pandas/core/computation/expressions.py:200: UserWarning: evaluating in Python space because the '-' operator is not supported by numexpr for the bool dtype, use '^' instead

My code uses as input parameter a pandas dataframe:

if len(df)>50:
     sma50 = btalib.sma(df, period=50)
     df['sma50'] = btalib.sma(df, period=50).df

     if len(df)>200:
           sma200 = btalib.sma(df, period=200)
           df['sma200'] = sma200.df      
           btalib.crossover(sma50, sma200)

@SPECULARI-FUND I've the same problem. Have you any solution?

@Xavier-Escudero said in Cerebro run spends 20 seconds without any analyzer:

@run-out Thanks. I've tried but the next error is shown:

clslines = baselines + lines
TypeError: can only concatenate tuple (not "str") to tuple

It seems the error appears when I declare the lines field:

class PandasData(btfeed.PandasData):
    '''
    The ``dataname`` parameter inherited from ``feed.DataBase`` is the pandas
    DataFrame
    '''    
    lines = ('sma')
    
    params = (
        ('nullvalue', 0.0),
        # Possible values for datetime (must always be present)
        #  None : datetime is the "index" in the Pandas Dataframe
        #  -1 : autodetect position or case-wise equal name
        #  >= 0 : numeric index to the colum in the pandas dataframe
        #  string : column name (as index) in the pandas dataframe
        ('datetime', None),

        # Possible values below:
        #  None : column not present
        #  -1 : autodetect position or case-wise equal name
        #  >= 0 : numeric index to the colum in the pandas dataframe
        #  string : column name (as index) in the pandas dataframe
        ('open', 'o'),
        ('high', 'h'),
        ('low', 'l'),
        ('close', 'c'),
        ('volume', 'v'),
        ('openinterest', None),
        ('sma', -1)        
    )
    
    datafields = btfeed.PandasData.datafields + (
        [
            'sma'
        ]
    )    

And I am creating the data as:

  df = pd.DataFrame.from_records(ticks) 
  df = df.join(btalib.sma(df, period=20).df)

The data shows that everything is ok, all are floats or NaN (for example first values of SMA), so I don't understand the meaning of error.

Thanks again.

New: It works adding ',' at the end of lines:

lines = ('sma',)

@run-out Thanks. I've tried but the next error is shown:

clslines = baselines + lines
TypeError: can only concatenate tuple (not "str") to tuple

It seems the error appears when I declare the lines field:

class PandasData(btfeed.PandasData):
    '''
    The ``dataname`` parameter inherited from ``feed.DataBase`` is the pandas
    DataFrame
    '''    
    lines = ('sma')
    
    params = (
        ('nullvalue', 0.0),
        # Possible values for datetime (must always be present)
        #  None : datetime is the "index" in the Pandas Dataframe
        #  -1 : autodetect position or case-wise equal name
        #  >= 0 : numeric index to the colum in the pandas dataframe
        #  string : column name (as index) in the pandas dataframe
        ('datetime', None),

        # Possible values below:
        #  None : column not present
        #  -1 : autodetect position or case-wise equal name
        #  >= 0 : numeric index to the colum in the pandas dataframe
        #  string : column name (as index) in the pandas dataframe
        ('open', 'o'),
        ('high', 'h'),
        ('low', 'l'),
        ('close', 'c'),
        ('volume', 'v'),
        ('openinterest', None),
        ('sma', -1)        
    )
    
    datafields = btfeed.PandasData.datafields + (
        [
            'sma'
        ]
    )    

And I am creating the data as:

  df = pd.DataFrame.from_records(ticks) 
  df = df.join(btalib.sma(df, period=20).df)

The data shows that everything is ok, all are floats or NaN (for example first values of SMA), so I don't understand the meaning of error.

Thanks again.

@run-out Great! Have you got any example to use with?

I've seen that bta-lib generates lines, but you can get as well his pandas data.

sma = btalib.sma(df, period=20)
df = sma.df

I am feeding the cerebro 'addData' with a pandas data frame that has 'ohlcv'.

1. Do I need to join in one pandas dataframe information about ohlcv and one new column from sma? Or the lines need/can be passed aside?

2. I am not sure then if I need to adapt as well my PandasData class (see below)

Thanks in advance for your help!

 cerebro = bt.Cerebro()
 for i in range(len(self.data_list)):            
      data = PandasData(
           dataname=self.data_list[i][0], # Pandas DataFrame
           name=self.data_list[i][1] # The symbol
      )            
      cerebro.adddata(data)

class PandasData(btfeed.PandasData):
    '''
    The ``dataname`` parameter inherited from ``feed.DataBase`` is the pandas
    DataFrame
    '''

    params = (
        ('nullvalue', 0.0),
        # Possible values for datetime (must always be present)
        #  None : datetime is the "index" in the Pandas Dataframe
        #  -1 : autodetect position or case-wise equal name
        #  >= 0 : numeric index to the colum in the pandas dataframe
        #  string : column name (as index) in the pandas dataframe
        ('datetime', None),

        # Possible values below:
        #  None : column not present
        #  -1 : autodetect position or case-wise equal name
        #  >= 0 : numeric index to the colum in the pandas dataframe
        #  string : column name (as index) in the pandas dataframe
        ('open', 'o'),
        ('high', 'h'),
        ('low', 'l'),
        ('close', 'c'),
        ('volume', 'v'),
        ('openinterest', None),
    )

@vladisld I've checked that 16 seconds of the time is spent in init, creating the indicators for all stocks (more than 1400).

My understanding, related to python init is that it was only called once, and then the same object can be called with different analysis, but it's not really an object. There's any way to load the data feed and create indicators outside the strategy/analyzer, and then execute analyzers/strategy with these data?

Hi. I want to store in memory data of several stocks data with computed indicators, so they are reused in several executions.

I've tried to use the method init in one analyzer/strategy, but everytime I run the cerebro the 'init' method is started again, and it spends a lot of time (15 seconds with two indicators, and 1440 stocks. I've read in posts that cerebro can't be reused.

There's anyway to load the indicators once, and reuse them for every execution?

class ScreenerAnalyzer(bt.Analyzer):
    params = dict(period=10)
    
    def __init__(self):
        print('INIT----------')
        
        self.rets['over'] = list()
        self.rets['under'] = list()

        self.smas = {data: bt.indicators.SMA(data, period=self.p.period)
                     for data in self.datas}
        self.atrs = {data: bt.indicators.ATR(data, period=14)
                     for data in self.datas}

 def execute_analysis(self):
        cerebro = bt.Cerebro()
        for i in range(len(self.data_list)):            
            data = PandasData(
                dataname=self.data_list[i][0], # Pandas DataFrame
                name=self.data_list[i][1] # The symbol
                )            
            cerebro.adddata(data)

        cerebro.addanalyzer(ScreenerAnalyzer, period=10)
        
        start_time = timeit.default_timer()
        cerebro.run(runonce=False, stdstats=False, writer=False)
        elapsed = timeit.default_timer() - start_time
        print(f'analysis: {elapsed}')