generic csv data dtformat not correct?

Fagus

Hey guys, my Issue is that I want to read a custom csv file and add the data but something goes wrong and no data is actually added I guess, resulting in the error

AttributeError: 'Plot_OldSync' object has no attribute 'mpyplot'

My Code for the custom data is the following:

    datapath = os.path.join(modpath, 'datas\\Coinbase_BTCUSD_1h.csv')
    datef = '%Y-%m-%d %I-%p'
    data = bt.feeds.GenericCSVData(
        dataname=datapath,
        fromdate=datetime.datetime(2017, 7, 1, 11),
        todate=datetime.datetime(2020, 8, 14, 22),
        dtformat=datef,
        reverse=True,
        # specifying columns
        datetime=0,
        open=2,
        high=3,
        low=4,
        close=5,
        volume=7,
        openinterest=-1
    )

The CSV file I am trying to read has the following format:

Date,Symbol,Open,High,Low,Close,Volume BTC,Volume USD
2020-08-14 10-PM,BTCUSD,11777.33,11797.52,11734.83,11797.52,298.79,3514421.22
2020-08-14 09-PM,BTCUSD,11774.77,11794.63,11714.1,11777.33,674.78,7933568.87
2020-08-14 08-PM,BTCUSD,11815.28,11838.65,11751.54,11774.77,719.56,8482977.35

If I try to convert the the time string manually using

test = datetime.datetime.strptime('2020-08-14 10-PM', '%Y-%m-%d %I-%p')
print(test)

I get the time I would expect.

Any help would be really appreciated, also do you have some tips for debugging? How can I read out the values of the data while debugging (I am using PyCharm), it just seems like it is an infinitely recursive list, I just want to access the data that has been read so I can confirm what the mistake is in the future.

Thank you all in advance :)

vladisld

I've run your code and it seems the dtformat is defined correctly - just try to use the correct fromdate-todate interval (like 2017/7/1 - 2020/8/15 ).

The error you are seeing is raised during the plotting and probably related to the fact that indeed no data was loaded for the requested time period.

Fagus

@vladisld Yes you are right, my mistake was that I was using a reversed csv file and for GenericCSVData the reverse=True does not do anything. Then the csv file gets read assuming that the next row will be a later timestamp and ignores everything if the first line is too late to be considered. Might be wring with that but that's my explanation I came up with.
Anyway I tried and reversed the csv file manually and now it works, thank you.

But still, for further workings: do you have a trick for debugging? When I load it in a pandas dataframe for example it is really easy to read out the data, but where is the data stored in the GenericCSVData object? I am curious to find out, is it present in the line buffers?