Hi

I have worked on converting a Pinescript indicator to backtrader.

I will describe some findings in the process, give some tips, show a example and so on.

variables
in pinescript, variables seem to work like lines in backtrader. So for every variable used in the script I have added a line:

pinescript:

setupCountUp = na

backtrader ind.__init__:

self.setup_sell = bt.LineNum(float('nan'))

conditions
to use methods like barssince, valuewhen from pinescript, which allows conditions like: setupCountUp == self.p.setup_bars the easiest method I found is to use numpy for this.

1. convert a line to a numpy array (using get(size=SIZE) to not work on complete line but only a defined range of data)

def line2arr(line, size=-1):
    if size <= 0:
        return np.array(line.array)
    else:
        return np.array(line.get(size=size))

2. provide methods which works as methods from pinescript: so I wrote the methods I needed.

def na(val):
    return val != val

def nz(x, y=None):
    if isinstance(x, np.generic):
        return x.fillna(y or 0)
    if x != x:
        if y is not None:
            return y
        return 0
    return x

def barssince(condition, occurrence=0):
    cond_len = len(condition)
    occ = 0
    since = 0
    res = float('nan')
    while cond_len - (since+1) >= 0:
        cond = condition[cond_len-(since+1)]
        if cond and not cond != cond:
            if occ == occurrence:
                res = since
                break
            occ += 1
        since += 1
    return res

def valuewhen(condition, source, occurrence=0):
    res = float('nan')
    since = barssince(condition, occurrence)
    if since is not None:
        res = source[-(since+1)]
    return res

rewriting

the process of rewriting the pinescript in python using backtrader was simple after this. basically it can be split up to:

1. look for vars, params, signals used in pinescript
2. define vars, params, signal in indicator
3. strip all plot related code from pinescript
4. rewrite pinescript code in indicators next method

plotting

since i only want to have signals as lines in indicator, I did not set all vars used in pinescript in the lines dict, but in init. So I had a better control of what the indicator is plotting. But the indicator had more values then just the signals, so how to handle them?
The solution was a observer, which takes care of plotting all other information, the indicator has. Here you can setup all the plot related code from pinescript.

some remaining issues

maybe some of you guys know answers for this:

Questions:

• is it possible to create lines with conditions (outside of __init__) like: self.line1 > val ?
• is there a way to get something like barssince, valuewhen natively in backtrader?

Issues:

• the code is not very good, since a lot of the code can be done better in python, but if you don't want to fiddle to much with it, this should be fine
• refactoring would make the code better readable

I hope, this will help some of you!
I will post the code of a indicator, observer and the pinescript methods in a next post below.

If anyone needs this, here is a BBSqueeze indicator.

implementation is based on this: https://www.netpicks.com/squeeze-out-the-chop/

BBSqueeze

from __future__ import (absolute_import, division, print_function,
                        unicode_literals)

import backtrader as bt

from . import KeltnerChannel


class BBSqueeze(bt.Indicator):

    '''
    https://www.netpicks.com/squeeze-out-the-chop/

    Both indicators are symmetrical, meaning that the upper and lower bands or channel lines are the same distance from the moving average. That means that we can focus on only one side in developing our indicator. In our case, we’ll just consider the upper lines.

    The basic formulas we need are:

        Bollinger Band = Moving Average + (Number of standard deviations X Standard Deviation)
        Keltner Channel = Moving Average + (Number of ATR’s X ATR)

    Or if we translate this into pseudo-code:

        BBUpper = Avg(close, period) + (BBDevs X StdDev(close, period))
        KCUpper = Avg(close, period) + (KCDevs X ATR(period))

    The squeeze is calculated by taking the difference between these two values:

        Squeeze = BBUpper – KCUpper

    Which simplifies down to this:

        Squeeze = (BBDevs X StdDev(close, period)) – (KCDevs X ATR(period))
    '''

    lines = ('squeeze',)
    params = (('period', 20), ('devfactor', 2.0), ('movav', bt.ind.MovAv.Simple),)

    plotinfo = dict(subplot=True)

    def _plotlabel(self):
        plabels = [self.p.period, self.p.devfactor]
        plabels += [self.p.movav] * self.p.notdefault('movav')
        return plabels

    def __init__(self):
        bb = bt.ind.BollingerBands(
            period=self.p.period, devfactor=self.p.devfactor, movav=self.p.movav)
        kc = KeltnerChannel(
            period=self.p.period, devfactor=self.p.devfactor, movav=self.p.movav)
        self.lines.squeeze = bb.top - kc.top

KeltnerChannel

from __future__ import (absolute_import, division, print_function,
                        unicode_literals)

import backtrader as bt


class KeltnerChannel(bt.Indicator):

    lines = ('mid', 'top', 'bot',)
    params = (('period', 20), ('devfactor', 1.5),
              ('movav', bt.ind.MovAv.Simple),)

    plotinfo = dict(subplot=False)
    plotlines = dict(
        mid=dict(ls='--'),
        top=dict(_samecolor=True),
        bot=dict(_samecolor=True),
    )

    def _plotlabel(self):
        plabels = [self.p.period, self.p.devfactor]
        plabels += [self.p.movav] * self.p.notdefault('movav')
        return plabels

    def __init__(self):
        self.lines.mid = ma = self.p.movav(self.data, period=self.p.period)
        atr = self.p.devfactor * bt.ind.ATR(self.data, period=self.p.period)
        self.lines.top = ma + atr
        self.lines.bot = ma - atr

i fixed issues with my datafeeds by adjusting the time to the end of the period they are on. Backtrader expects somehow the endtime of a period, while most data will have the starttime of a period as the datetime.

A custom csv feed with time adjustment which can be used to fix that:

import backtrader as bt
from backtrader.utils import date2num
from datetime import datetime, time, timedelta



def getstarttime(timeframe, compression, dt, sessionstart=None, offset=0):
    '''
    This method will return the start of the period based on current
    time (or provided time).
    '''
    if sessionstart is None:
        # use UTC 22:00 (5:00 pm New York) as default
        sessionstart = time(hour=22, minute=0, second=0)
    if dt is None:
        dt = datetime.utcnow()
    if timeframe == bt.TimeFrame.Seconds:
        dt = dt.replace(
            second=(dt.second // compression) * compression,
            microsecond=0)
        if offset:
            dt = dt - timedelta(seconds=compression*offset)
    elif timeframe == bt.TimeFrame.Minutes:
        if compression >= 60:
            hours = 0
            minutes = 0
            # get start of day
            dtstart = getstarttime(bt.TimeFrame.Days, 1, dt, sessionstart)
            # diff start of day with current time to get seconds
            # since start of day
            dtdiff = dt - dtstart
            hours = dtdiff.seconds//((60*60)*(compression//60))
            minutes = compression % 60
            dt = dtstart + timedelta(hours=hours, minutes=minutes)
        else:
            dt = dt.replace(
                minute=(dt.minute // compression) * compression,
                second=0,
                microsecond=0)
        if offset:
            dt = dt - timedelta(minutes=compression*offset)
    elif timeframe == bt.TimeFrame.Days:
        if dt.hour < sessionstart.hour:
            dt = dt - timedelta(days=1)
        if offset:
            dt = dt - timedelta(days=offset)
        dt = dt.replace(
            hour=sessionstart.hour,
            minute=sessionstart.minute,
            second=sessionstart.second,
            microsecond=sessionstart.microsecond)
    elif timeframe == bt.TimeFrame.Weeks:
        if dt.weekday() != 6:
            # sunday is start of week at 5pm new york
            dt = dt - timedelta(days=dt.weekday() + 1)
        if offset:
            dt = dt - timedelta(days=offset * 7)
        dt = dt.replace(
            hour=sessionstart.hour,
            minute=sessionstart.minute,
            second=sessionstart.second,
            microsecond=sessionstart.microsecond)
    elif timeframe == bt.TimeFrame.Months:
        if offset:
            dt = dt - timedelta(days=(min(28 + dt.day, 31)))
        # last day of month
        last_day_of_month = dt.replace(day=28) + timedelta(days=4)
        last_day_of_month = last_day_of_month - timedelta(
            days=last_day_of_month.day)
        last_day_of_month = last_day_of_month.day
        # start of month
        if dt.day < last_day_of_month:
            dt = dt - timedelta(days=dt.day)
        dt = dt.replace(
            hour=sessionstart.hour,
            minute=sessionstart.minute,
            second=sessionstart.second,
            microsecond=sessionstart.microsecond)
    return dt


class CSVAdjustTime(bt.feeds.GenericCSVData):

    params = dict(
        adjstarttime=False,
    )

    def _loadline(self, linetokens):
        res = super(CSVAdjustTime, self)._loadline(linetokens)
        if self.p.adjstarttime:
            # move time to start time of next candle
            # and subtract 0.1 miliseconds (ensures no
            # rounding issues, 10 microseconds is minimum)
            new_date = getstarttime(
                self._timeframe,
                self._compression,
                self.datetime.datetime(0),
                self.sessionstart,
                -1) - timedelta(microseconds=100)
            self.datetime[0] = date2num(new_date)
        return res

@curious_one your datetime is a string, try converting it to datetime objects. Look at pandas to_datetime() method.

df.Datetime = pandas.to_datetime(
            df.Datetime, format='%Y-%m-%d  %H:%M:%S')

BBSqueeze with configureable multiplicators for bb and keltner

from __future__ import (absolute_import, division, print_function,
                        unicode_literals)

import backtrader as bt

from . import KeltnerChannel


class BBSqueeze(bt.Indicator):

    '''
    https://www.netpicks.com/squeeze-out-the-chop/

    Both indicators are symmetrical, meaning that the upper and lower bands or channel lines are the same distance from the moving average. That means that we can focus on only one side in developing our indicator. In our case, we’ll just consider the upper lines.

    The basic formulas we need are:

        Bollinger Band = Moving Average + (Number of standard deviations X Standard Deviation)
        Keltner Channel = Moving Average + (Number of ATR’s X ATR)

    Or if we translate this into pseudo-code:

        BBUpper = Avg(close, period) + (BBDevs X StdDev(close, period))
        KCUpper = Avg(close, period) + (KCDevs X ATR(period))

    The squeeze is calculated by taking the difference between these two values:

        Squeeze = BBUpper – KCUpper

    Which simplifies down to this:

        Squeeze = (BBDevs X StdDev(close, period)) – (KCDevs X ATR(period))
    '''

    lines = ('squeeze',)
    params = (('period', 20), ('bbdevs', 2.0), ('kcdevs', 1.5), ('movav', bt.ind.MovAv.Simple),)

    plotinfo = dict(subplot=True)

    def _plotlabel(self):
        plabels = [self.p.period, self.p.bbdevs, self.p.kcdevs]
        plabels += [self.p.movav] * self.p.notdefault('movav')
        return plabels

    def __init__(self):
        bb = bt.ind.BollingerBands(
            period=self.p.period, devfactor=self.p.bbdevs, movav=self.p.movav)
        kc = KeltnerChannel(
            period=self.p.period, devfactor=self.p.kcdevs, movav=self.p.movav)
        self.lines.squeeze = bb.top - kc.top

@tsguo3 if you want to be sure, you can always read the source code.

Another indicator, Chandelier Exit

import backtrader as bt


class ChandelierExit(bt.Indicator):

    ''' https://corporatefinanceinstitute.com/resources/knowledge/trading-investing/chandelier-exit/ '''

    lines = ('long', 'short')
    params = (('period', 22), ('multip', 3),)

    plotinfo = dict(subplot=False)

    def __init__(self):
        highest = bt.ind.Highest(self.data.high, period=self.p.period)
        lowest = bt.ind.Lowest(self.data.low, period=self.p.period)
        atr = self.p.multip * bt.ind.ATR(self.data, period=self.p.period)
        self.lines.long = highest - atr
        self.lines.short = lowest + atr

@hfrog713 said in Converting a Tradingview Strategy to a Backtrader Strategy - EMA Crossover:

def next(self):
    if self.position.size:
        if self.crossover < 0:
            self.sell()
    elif self.crossover > 0:
        self.buy()

Here is a indention error, the elif self.crossover > 0

Here is the valbands indicator converted from mq5.

import backtrader as bt


class ValBandsIndicator(bt.Indicator):

    '''
    Candlesticks length volatility indicator

    - histo - candlestick length in pips
    - lines are averages from the candlesticks length with
      standard deviation

    Settings are analogous to the Bollinger Channel


    Usage:
    https://www.mql5.com/en/code/687
    http://forex-strategies-revealed.com/money-management/keep-every-pip

        It is useful for tracking gaps on the market. The gap
        contains everything that is above the top line
        - crossing the upper border - a) �� (towards a position)
                                        b) SL (against a position)
                                        c) entry prohibition at this point
        - crossing the lower border - flat
        - crossing the lower border upwards - beginning of a trend

        Histo: the length of the candle in pips.
        Bands: the average of the candle length with standard deviation.
        - Top: reading above it suggests that a candle is taller than usual,
            and it's the time to Take profit. (Also, don't open any new
            trades there).
        - Mid: reading close to it - an active trend.
        - Bot: reading below it - ranging market. (Crossing the pink line
            from below - beginning of a trend).

    Source:

        //+------------------------------------------------------------------------+
        //|                                                         Val_Bands.mq5  |
        //|                                             Copyright � 2010, Fomenko  |
        //|                                                http://faa1947@mail.ru  |
        //+------------------------------------------------------------------------+
        //|   Candlesticks length volatility indicator:                            |
        //|      - histogram - candlestick length in pips;                         |
        //|      - lines are averages from the candlesticks length with standard   |
        //|        deviation;                                                      |
        //|    Settings are analogous to the Bollinger Channel;                    |
        //|    Usage. It is useful for tracking gaps on the market. The gap        |
        //|                     contains everything that is above the yellow line; |
        //|      - crossing the upper border - �) �� (towards a position);         |
        //|                                    b) SL (against a position);         |
        //|                                    c) entry prohibition at this point; |
        //|      - crossing the lower border - flat;                               |
        //|      - crossing the lower border upwards - beginning of a trend.       |
        //+------------------------------------------------------------------------+
        #property copyright "Copyright � 2010, Fomenko"
        #property link      "http://faa1947@mail.ru"
        //---- indicator version
        #property version   "1.00"
        //---- drawing the indicator in a separate window
        #property indicator_separate_window
        //---- number of indicator buffers 5
        #property indicator_buffers 5
        //---- four plots are used in total
        #property indicator_plots   4
        //+-----------------------------------+
        //|  Indicator drawing parameters     |
        //+-----------------------------------+
        //---- drawing the indicator as a color histogram
        #property indicator_type1 DRAW_COLOR_HISTOGRAM
        //---- the following colors are used in the four color histogram
        #property indicator_color1 Gray,Red,Lime,Yellow
        //---- indicator line is a solid one
        #property indicator_style1 STYLE_SOLID
        //---- Indicator line width is equal to 2
        #property indicator_width1 2
        //---- displaying the indicator label
        #property indicator_label1 "Val Histogram"

        //---- drawing the indicator as a line
        #property indicator_type2 DRAW_LINE
        //---- lime color is used for the line
        #property indicator_color2 Lime
        //---- the indicator line is a dash-dotted curve
        #property indicator_style2 STYLE_DASHDOTDOT
        //---- indicator line width is equal to 1
        #property indicator_width2 1
        //---- displaying the line label
        #property indicator_label2  "Mov"

        //---- drawing the indicator as a line
        #property indicator_type3 DRAW_LINE
        //---- yellow color is used for the line
        #property indicator_color3 Yellow
        //---- the indicator line is a dash-dotted curve
        #property indicator_style3 STYLE_DASHDOTDOT
        //---- indicator line width is equal to 1
        #property indicator_width3 1
        //---- displaying the line label
        #property indicator_label3  "Up"

        //---- drawing the indicator as a line
        #property indicator_type4 DRAW_LINE
        //---- use red color for the line
        #property indicator_color4 Red
        //---- the indicator line is a dash-dotted curve
        #property indicator_style4 STYLE_DASHDOTDOT
        //---- indicator line width is equal to 1
        #property indicator_width4 1
        //---- displaying the line label
        #property indicator_label4  "Down"

        //+-----------------------------------+
        //|  Declaration of constants         |
        //+-----------------------------------+
        #define RESET  0 // the constant for getting the command for the indicator recalculation back to the terminal

        //+-----------------------------------+
        //|  Indicator input parameters       |
        //+-----------------------------------+
        input int BandsPeriod=14;         // Calculation period
        input double BandsDeviations=1.0; // Standard deviation size
        //+-----------------------------------+
        //---- declaration of the integer variables for the start of data calculation
        int min_rates_total;
        //---- declaration of integer variables for the indicators handles
        int HMA_Handle,LMA_Handle;
        //---- declaration of dynamic arrays that
        //---- will be used as indicator buffers
        double UpBuffer[],DownBuffer[],MaBuffer[],ValBuffer[],ColorValBuffer[];
        //+------------------------------------------------------------------+
        //| Val_Bands indicator initialization function                      |
        //+------------------------------------------------------------------+
        void OnInit()
        {
        //---- initialization of variables of the start of data calculation
        min_rates_total=BandsPeriod;

        //---- getting handle of the iMA indicator
        HMA_Handle=iMA(NULL,0,BandsPeriod,0,MODE_SMA,PRICE_HIGH);
        if(HMA_Handle==INVALID_HANDLE) Print(" Failed to get handle of the iMA indicator");

        //---- getting handle of the iMA indicator
        LMA_Handle=iMA(NULL,0,BandsPeriod,0,MODE_SMA,PRICE_LOW);
        if(LMA_Handle==INVALID_HANDLE) Print(" Failed to get handle of the iMA indicator");

        //---- set ValBuffer[] dynamic array as an indicator buffer
        SetIndexBuffer(0,ValBuffer,INDICATOR_DATA);
        //---- performing the shift of the beginning of the indicator drawing
        PlotIndexSetInteger(0,PLOT_DRAW_BEGIN,min_rates_total);
        //---- setting the indicator values that won't be visible on a chart
        PlotIndexSetDouble(0,PLOT_EMPTY_VALUE,EMPTY_VALUE);
        //---- indexing the elements in buffers as timeseries
        ArraySetAsSeries(ValBuffer,true);

        //---- set ColorValBuffer[] dynamic array as an indicator buffer
        SetIndexBuffer(1,ColorValBuffer,INDICATOR_COLOR_INDEX);
        //---- performing the shift of the beginning of the indicator drawing
        PlotIndexSetInteger(1,PLOT_DRAW_BEGIN,min_rates_total);
        //---- indexing the elements in buffers as timeseries
        ArraySetAsSeries(ColorValBuffer,true);

        //---- set MABuffer[] dynamic array as an indicator buffer
        SetIndexBuffer(2,MaBuffer,INDICATOR_DATA);
        //---- performing the shift of the beginning of the indicator drawing
        PlotIndexSetInteger(2,PLOT_DRAW_BEGIN,min_rates_total);
        //---- setting the indicator values that won't be visible on a chart
        PlotIndexSetDouble(2,PLOT_EMPTY_VALUE,EMPTY_VALUE);
        //---- indexing the elements in buffers as timeseries
        ArraySetAsSeries(MaBuffer,true);

        //---- set UpBuffer[] dynamic array as an indicator buffer
        SetIndexBuffer(3,UpBuffer,INDICATOR_DATA);
        //---- performing the shift of the beginning of the indicator drawing
        PlotIndexSetInteger(3,PLOT_DRAW_BEGIN,min_rates_total);
        //---- setting the indicator values that won't be visible on a chart
        PlotIndexSetDouble(3,PLOT_EMPTY_VALUE,EMPTY_VALUE);
        //---- indexing the elements in buffers as timeseries
        ArraySetAsSeries(UpBuffer,true);

        //---- set DownBuffer[] dynamic array as an indicator buffer
        SetIndexBuffer(4,DownBuffer,INDICATOR_DATA);
        //---- performing the shift of the beginning of the indicator drawing
        PlotIndexSetInteger(4,PLOT_DRAW_BEGIN,min_rates_total);
        //---- setting the indicator values that won't be visible on a chart
        PlotIndexSetDouble(4,PLOT_EMPTY_VALUE,EMPTY_VALUE);
        //---- indexing the elements in buffers as timeseries
        ArraySetAsSeries(DownBuffer,true);

        //---- initializations of a variable for the indicator short name
        string shortname;
        StringConcatenate(shortname,"Val_Bands( ",BandsPeriod,", ",BandsDeviations," )");
        //---- creating a name for displaying in a separate sub-window and in a tooltip
        IndicatorSetString(INDICATOR_SHORTNAME,shortname);
        //---- determination of accuracy of displaying the indicator values
        IndicatorSetInteger(INDICATOR_DIGITS,0);
        //---- initialization end
        }
        //+------------------------------------------------------------------+
        //| Val_Bands iteration function                                     |
        //+------------------------------------------------------------------+
        int OnCalculate(const int rates_total,    // number of bars in history at the current tick
                        const int prev_calculated,// number of bars calculated at previous call
                        const datetime &time[],
                        const double &open[],
                        const double &high[],
                        const double &low[],
                        const double &close[],
                        const long &tick_volume[],
                        const long &volume[],
                        const int &spread[])
        {
        //---- checking the number of bars to be enough for the calculation
        if(BarsCalculated(HMA_Handle)<rates_total
            || BarsCalculated(LMA_Handle)<rates_total
            || rates_total<min_rates_total)
            return(RESET);

        //---- declarations of local variables
        int to_copy,limit,bar,k;
        double HMA[],LMA[];
        double sum,oldval,newres,deviation;

        //---- calculations of the necessary amount of data to be copied
        //---- and the 'limit' starting index for the bars recalculation loop
        if(prev_calculated>rates_total || prev_calculated<=0)// checking for the first start of the indicator calculation
            {
            to_copy=rates_total;                 // calculated number of all bars
            limit=rates_total-min_rates_total-1; // starting index for calculation of all bars
            }
        else
            {
            limit=rates_total-prev_calculated;  // starting index for calculation of new bars
            to_copy=limit+1;                    // calculated number of new bars only
            }

        //--- copy newly appeared data in the arrays
        if(CopyBuffer(HMA_Handle,0,0,to_copy,HMA)<=0) return(RESET);
        if(CopyBuffer(LMA_Handle,0,0,to_copy,LMA)<=0) return(RESET);

        //---- indexing elements in arrays as timeseries
        ArraySetAsSeries(HMA,true);
        ArraySetAsSeries(LMA,true);
        ArraySetAsSeries(high,true);
        ArraySetAsSeries(low,true);

        //---- first indicator calculation loop
        for(bar=limit; bar>=0 && !IsStopped(); bar--)
            {
            ValBuffer[bar]=(high[bar]-low[bar])/_Point;
            MaBuffer[bar]=(HMA[bar]-LMA[bar])/_Point;
            }

        //---- the second indicator calculation loop
        for(bar=limit; bar>=0 && !IsStopped(); bar--)
            {
            sum=0.0;
            k=bar+BandsPeriod-1;
            oldval=MaBuffer[bar];

            while(k>=bar)
                {
                newres=ValBuffer[k]-oldval;
                sum+=newres*newres;
                k--;
                }

            deviation=BandsDeviations*MathSqrt(sum/BandsPeriod);
            UpBuffer[bar]=oldval+deviation;
            DownBuffer[bar]=oldval-deviation;

            ColorValBuffer[bar]=0;

            if(ValBuffer[bar]>UpBuffer[bar]) ColorValBuffer[bar]=3;
            else if(ValBuffer[bar]>MaBuffer[bar]) ColorValBuffer[bar]=2;
            else if(ValBuffer[bar]>DownBuffer[bar]) ColorValBuffer[bar]=1;
            }
        //----
        return(rates_total);
        }
        //+------------------------------------------------------------------+

    '''

    lines = ('histo', 'top', 'mid', 'bot',)

    params = dict(
        period=14,
        devfactor=1.0,
        point=0.0001  # 10**pip_location
    )

    plotlines = dict(
        histo=dict(_method='bar', alpha=0.5, width=0.1),
        top=dict(),
        mid=dict(),
        bot=dict()
    )

    def __init__(self):
        self.hma = bt.ind.SMA(
            self.data.high, period=self.p.period)
        self.lma = bt.ind.SMA(
            self.data.low, period=self.p.period)
        self.ma = (self.hma - self.lma) / self.p.point
        self.stddev = self.p.devfactor * bt.ind.StdDev(
            self.data, self.ma, period=self.p.period)
        self.l.histo = (self.data.high - self.data.low) / self.p.point
        self.l.mid = self.ma
        self.l.top = self.ma + self.stddev
        self.l.bot = self.ma - self.stddev

I fixed the issue with oanda broker. It will now assume, there is no stopside

    #print(rts)
    data1 = bt.feeds.PandasData(dataname=rts)
    print(data1)
    cerebro.adddata(data1,name = '1M', timeframe=bt.TimeFrame.Minutes, compression = 1)
    data30 = cerebro.resampledata(data1, name='data30', timeframe=bt.TimeFrame.Minutes, compression = 30)
    print(data30)
    # Add the Data Feed to Cerebro
    # no need to add since already added with resampledata: cerebro.adddata(data30,name = '30M')

@duni4i you did not define the timeframe and compression for data1 when adding it, for data30 you did it by defining resample data to be 30 minutes (your code resamples from 1 day data, which will not work). I hope this is your issue, since i did not run your code.

you could provide some code to see what issue you have, its better than just guesswork what your issues may be.

@the-world did you trade on that data feed or did you execute all trades on the BTCUSDT data (you can provide the data feed you want your trades to be on as a parameter for buy, sell, close, etc.)
The trades will happen on the data feed you provide, if left out the first data is used.

Here is the valbands indicator converted from mq5.

import backtrader as bt


class ValBandsIndicator(bt.Indicator):

    '''
    Candlesticks length volatility indicator

    - histo - candlestick length in pips
    - lines are averages from the candlesticks length with
      standard deviation

    Settings are analogous to the Bollinger Channel


    Usage:
    https://www.mql5.com/en/code/687
    http://forex-strategies-revealed.com/money-management/keep-every-pip

        It is useful for tracking gaps on the market. The gap
        contains everything that is above the top line
        - crossing the upper border - a) �� (towards a position)
                                        b) SL (against a position)
                                        c) entry prohibition at this point
        - crossing the lower border - flat
        - crossing the lower border upwards - beginning of a trend

        Histo: the length of the candle in pips.
        Bands: the average of the candle length with standard deviation.
        - Top: reading above it suggests that a candle is taller than usual,
            and it's the time to Take profit. (Also, don't open any new
            trades there).
        - Mid: reading close to it - an active trend.
        - Bot: reading below it - ranging market. (Crossing the pink line
            from below - beginning of a trend).

    Source:

        //+------------------------------------------------------------------------+
        //|                                                         Val_Bands.mq5  |
        //|                                             Copyright � 2010, Fomenko  |
        //|                                                http://faa1947@mail.ru  |
        //+------------------------------------------------------------------------+
        //|   Candlesticks length volatility indicator:                            |
        //|      - histogram - candlestick length in pips;                         |
        //|      - lines are averages from the candlesticks length with standard   |
        //|        deviation;                                                      |
        //|    Settings are analogous to the Bollinger Channel;                    |
        //|    Usage. It is useful for tracking gaps on the market. The gap        |
        //|                     contains everything that is above the yellow line; |
        //|      - crossing the upper border - �) �� (towards a position);         |
        //|                                    b) SL (against a position);         |
        //|                                    c) entry prohibition at this point; |
        //|      - crossing the lower border - flat;                               |
        //|      - crossing the lower border upwards - beginning of a trend.       |
        //+------------------------------------------------------------------------+
        #property copyright "Copyright � 2010, Fomenko"
        #property link      "http://faa1947@mail.ru"
        //---- indicator version
        #property version   "1.00"
        //---- drawing the indicator in a separate window
        #property indicator_separate_window
        //---- number of indicator buffers 5
        #property indicator_buffers 5
        //---- four plots are used in total
        #property indicator_plots   4
        //+-----------------------------------+
        //|  Indicator drawing parameters     |
        //+-----------------------------------+
        //---- drawing the indicator as a color histogram
        #property indicator_type1 DRAW_COLOR_HISTOGRAM
        //---- the following colors are used in the four color histogram
        #property indicator_color1 Gray,Red,Lime,Yellow
        //---- indicator line is a solid one
        #property indicator_style1 STYLE_SOLID
        //---- Indicator line width is equal to 2
        #property indicator_width1 2
        //---- displaying the indicator label
        #property indicator_label1 "Val Histogram"

        //---- drawing the indicator as a line
        #property indicator_type2 DRAW_LINE
        //---- lime color is used for the line
        #property indicator_color2 Lime
        //---- the indicator line is a dash-dotted curve
        #property indicator_style2 STYLE_DASHDOTDOT
        //---- indicator line width is equal to 1
        #property indicator_width2 1
        //---- displaying the line label
        #property indicator_label2  "Mov"

        //---- drawing the indicator as a line
        #property indicator_type3 DRAW_LINE
        //---- yellow color is used for the line
        #property indicator_color3 Yellow
        //---- the indicator line is a dash-dotted curve
        #property indicator_style3 STYLE_DASHDOTDOT
        //---- indicator line width is equal to 1
        #property indicator_width3 1
        //---- displaying the line label
        #property indicator_label3  "Up"

        //---- drawing the indicator as a line
        #property indicator_type4 DRAW_LINE
        //---- use red color for the line
        #property indicator_color4 Red
        //---- the indicator line is a dash-dotted curve
        #property indicator_style4 STYLE_DASHDOTDOT
        //---- indicator line width is equal to 1
        #property indicator_width4 1
        //---- displaying the line label
        #property indicator_label4  "Down"

        //+-----------------------------------+
        //|  Declaration of constants         |
        //+-----------------------------------+
        #define RESET  0 // the constant for getting the command for the indicator recalculation back to the terminal

        //+-----------------------------------+
        //|  Indicator input parameters       |
        //+-----------------------------------+
        input int BandsPeriod=14;         // Calculation period
        input double BandsDeviations=1.0; // Standard deviation size
        //+-----------------------------------+
        //---- declaration of the integer variables for the start of data calculation
        int min_rates_total;
        //---- declaration of integer variables for the indicators handles
        int HMA_Handle,LMA_Handle;
        //---- declaration of dynamic arrays that
        //---- will be used as indicator buffers
        double UpBuffer[],DownBuffer[],MaBuffer[],ValBuffer[],ColorValBuffer[];
        //+------------------------------------------------------------------+
        //| Val_Bands indicator initialization function                      |
        //+------------------------------------------------------------------+
        void OnInit()
        {
        //---- initialization of variables of the start of data calculation
        min_rates_total=BandsPeriod;

        //---- getting handle of the iMA indicator
        HMA_Handle=iMA(NULL,0,BandsPeriod,0,MODE_SMA,PRICE_HIGH);
        if(HMA_Handle==INVALID_HANDLE) Print(" Failed to get handle of the iMA indicator");

        //---- getting handle of the iMA indicator
        LMA_Handle=iMA(NULL,0,BandsPeriod,0,MODE_SMA,PRICE_LOW);
        if(LMA_Handle==INVALID_HANDLE) Print(" Failed to get handle of the iMA indicator");

        //---- set ValBuffer[] dynamic array as an indicator buffer
        SetIndexBuffer(0,ValBuffer,INDICATOR_DATA);
        //---- performing the shift of the beginning of the indicator drawing
        PlotIndexSetInteger(0,PLOT_DRAW_BEGIN,min_rates_total);
        //---- setting the indicator values that won't be visible on a chart
        PlotIndexSetDouble(0,PLOT_EMPTY_VALUE,EMPTY_VALUE);
        //---- indexing the elements in buffers as timeseries
        ArraySetAsSeries(ValBuffer,true);

        //---- set ColorValBuffer[] dynamic array as an indicator buffer
        SetIndexBuffer(1,ColorValBuffer,INDICATOR_COLOR_INDEX);
        //---- performing the shift of the beginning of the indicator drawing
        PlotIndexSetInteger(1,PLOT_DRAW_BEGIN,min_rates_total);
        //---- indexing the elements in buffers as timeseries
        ArraySetAsSeries(ColorValBuffer,true);

        //---- set MABuffer[] dynamic array as an indicator buffer
        SetIndexBuffer(2,MaBuffer,INDICATOR_DATA);
        //---- performing the shift of the beginning of the indicator drawing
        PlotIndexSetInteger(2,PLOT_DRAW_BEGIN,min_rates_total);
        //---- setting the indicator values that won't be visible on a chart
        PlotIndexSetDouble(2,PLOT_EMPTY_VALUE,EMPTY_VALUE);
        //---- indexing the elements in buffers as timeseries
        ArraySetAsSeries(MaBuffer,true);

        //---- set UpBuffer[] dynamic array as an indicator buffer
        SetIndexBuffer(3,UpBuffer,INDICATOR_DATA);
        //---- performing the shift of the beginning of the indicator drawing
        PlotIndexSetInteger(3,PLOT_DRAW_BEGIN,min_rates_total);
        //---- setting the indicator values that won't be visible on a chart
        PlotIndexSetDouble(3,PLOT_EMPTY_VALUE,EMPTY_VALUE);
        //---- indexing the elements in buffers as timeseries
        ArraySetAsSeries(UpBuffer,true);

        //---- set DownBuffer[] dynamic array as an indicator buffer
        SetIndexBuffer(4,DownBuffer,INDICATOR_DATA);
        //---- performing the shift of the beginning of the indicator drawing
        PlotIndexSetInteger(4,PLOT_DRAW_BEGIN,min_rates_total);
        //---- setting the indicator values that won't be visible on a chart
        PlotIndexSetDouble(4,PLOT_EMPTY_VALUE,EMPTY_VALUE);
        //---- indexing the elements in buffers as timeseries
        ArraySetAsSeries(DownBuffer,true);

        //---- initializations of a variable for the indicator short name
        string shortname;
        StringConcatenate(shortname,"Val_Bands( ",BandsPeriod,", ",BandsDeviations," )");
        //---- creating a name for displaying in a separate sub-window and in a tooltip
        IndicatorSetString(INDICATOR_SHORTNAME,shortname);
        //---- determination of accuracy of displaying the indicator values
        IndicatorSetInteger(INDICATOR_DIGITS,0);
        //---- initialization end
        }
        //+------------------------------------------------------------------+
        //| Val_Bands iteration function                                     |
        //+------------------------------------------------------------------+
        int OnCalculate(const int rates_total,    // number of bars in history at the current tick
                        const int prev_calculated,// number of bars calculated at previous call
                        const datetime &time[],
                        const double &open[],
                        const double &high[],
                        const double &low[],
                        const double &close[],
                        const long &tick_volume[],
                        const long &volume[],
                        const int &spread[])
        {
        //---- checking the number of bars to be enough for the calculation
        if(BarsCalculated(HMA_Handle)<rates_total
            || BarsCalculated(LMA_Handle)<rates_total
            || rates_total<min_rates_total)
            return(RESET);

        //---- declarations of local variables
        int to_copy,limit,bar,k;
        double HMA[],LMA[];
        double sum,oldval,newres,deviation;

        //---- calculations of the necessary amount of data to be copied
        //---- and the 'limit' starting index for the bars recalculation loop
        if(prev_calculated>rates_total || prev_calculated<=0)// checking for the first start of the indicator calculation
            {
            to_copy=rates_total;                 // calculated number of all bars
            limit=rates_total-min_rates_total-1; // starting index for calculation of all bars
            }
        else
            {
            limit=rates_total-prev_calculated;  // starting index for calculation of new bars
            to_copy=limit+1;                    // calculated number of new bars only
            }

        //--- copy newly appeared data in the arrays
        if(CopyBuffer(HMA_Handle,0,0,to_copy,HMA)<=0) return(RESET);
        if(CopyBuffer(LMA_Handle,0,0,to_copy,LMA)<=0) return(RESET);

        //---- indexing elements in arrays as timeseries
        ArraySetAsSeries(HMA,true);
        ArraySetAsSeries(LMA,true);
        ArraySetAsSeries(high,true);
        ArraySetAsSeries(low,true);

        //---- first indicator calculation loop
        for(bar=limit; bar>=0 && !IsStopped(); bar--)
            {
            ValBuffer[bar]=(high[bar]-low[bar])/_Point;
            MaBuffer[bar]=(HMA[bar]-LMA[bar])/_Point;
            }

        //---- the second indicator calculation loop
        for(bar=limit; bar>=0 && !IsStopped(); bar--)
            {
            sum=0.0;
            k=bar+BandsPeriod-1;
            oldval=MaBuffer[bar];

            while(k>=bar)
                {
                newres=ValBuffer[k]-oldval;
                sum+=newres*newres;
                k--;
                }

            deviation=BandsDeviations*MathSqrt(sum/BandsPeriod);
            UpBuffer[bar]=oldval+deviation;
            DownBuffer[bar]=oldval-deviation;

            ColorValBuffer[bar]=0;

            if(ValBuffer[bar]>UpBuffer[bar]) ColorValBuffer[bar]=3;
            else if(ValBuffer[bar]>MaBuffer[bar]) ColorValBuffer[bar]=2;
            else if(ValBuffer[bar]>DownBuffer[bar]) ColorValBuffer[bar]=1;
            }
        //----
        return(rates_total);
        }
        //+------------------------------------------------------------------+

    '''

    lines = ('histo', 'top', 'mid', 'bot',)

    params = dict(
        period=14,
        devfactor=1.0,
        point=0.0001  # 10**pip_location
    )

    plotlines = dict(
        histo=dict(_method='bar', alpha=0.5, width=0.1),
        top=dict(),
        mid=dict(),
        bot=dict()
    )

    def __init__(self):
        self.hma = bt.ind.SMA(
            self.data.high, period=self.p.period)
        self.lma = bt.ind.SMA(
            self.data.low, period=self.p.period)
        self.ma = (self.hma - self.lma) / self.p.point
        self.stddev = self.p.devfactor * bt.ind.StdDev(
            self.data, self.ma, period=self.p.period)
        self.l.histo = (self.data.high - self.data.low) / self.p.point
        self.l.mid = self.ma
        self.l.top = self.ma + self.stddev
        self.l.bot = self.ma - self.stddev

@andi said in Resampling from daily to monthly - lagging issue:

As a result, I come to the conclusion that the implementation in the resample method is not what I would expect. I would probably consider it to be incorrect, at least with regards to resample daily to monthly. However, I am happy to discuss this interpretation.

@andi said in Resampling from daily to monthly - lagging issue:

I do know the new value as soon as I do have a closing price for the month (in contrast to get that value one day later),

The datetime 2019-12-30 23:59:59 does not say there is no more data for this period, but the timestamp 2020-01-02 23:59:59 does. Between these two timestamps the period switches at 2020-01-01 00:00:00 and 2020-01-02 00:00:00.

So backtrader will know about the date being the last one as soon as a date from new period appears. in your image with expected values you have all values shifted by -1. so id 4 will actually be your id 5.

You may fill some data with a datafiller filter.

See docu: https://www.backtrader.com/docu/filters/

@dasch but thread anything i write with caution since i do not fully understand the inner works of backtrader at some points.

@run-out so for the initial question, the feed will forward as soon as a date appears that is over the boundry of the current period. So only when 2020 starts, the data forwards. Possibilities to overcome this: add some kind of filter for datas or use replay for data.

for the boundoff and rightedge i will try to ellaborate in a further message.

@aalli you may want to define the seperator for your csv data by providing the separator param.

data = bt.feeds.GenericCSVData(
    dataname='USDJPY_H1.csv',
 
    fromdate=datetime.datetime(2014, 4, 2),    
    todate=datetime.datetime(2014, 4, 4),

    nullvalue=0.0,  

    dateformat='%Y-%m-%d %H:%M:%S',

    datetime=0,   
    time=-1,    
    open=1,    
    high=2,    
    low=3,    
    close=4,    
    adjclose=5,    
    volume=6,    
    openinterest=-1, 
    seperator='\t',
    timeframe=bt.TimeFrame.Minutes, compression=60)