Pandas Dataframe issue (int object has no attribute to_pydatetime)

Suraj Thorat

Re: Pandas Dataframe issue with datetime index

Anyone has got a solution to this?
I am still not able to figure out why this error is occurring. (AttributeError: 'int' object has no attribute 'to_pydatetime')

Below is my code which is giving the error. I have tried the above two solutions. They haven't worked either and have tried multiple ways to solve this.

try:
        connection = psycopg2.connect(user="<ABC>",
                                      host="<ABC>",
                                      port="<ABC>",
                                      database="<ABC>")

        cursor = connection.cursor()
        # Print PostgreSQL Connection properties
        print(connection.get_dsn_parameters(), "\n")

        # Print PostgreSQL version
        cursor.execute("SELECT version();")
        record = cursor.fetchone()
        print("You are connected to - ", record, "\n")

except (Exception, psycopg2.Error) as error:
    print("Error while connecting to PostgreSQL", error)
ticker_data = psql.read_sql("""select tick_date as datetime,open_price as open,high_price as high,low_price as low,close_price as close,volume from stock_ticker_daily_new where stock_code = 'PNC' and tick_date > '2019-09-01' and tick_date < '2019-11-25';"""  , connection)
ticker_data['datetime'] = pd.to_datetime(ticker_data['datetime'])
data = bt.feeds.PandasData(dataname=ticker_data)
cerebro.adddata(data, name = i)
    
cerebro.addanalyzer(Screener_SMA, period=14)
cerebro.run(runonce=False, stdstats=False, writer=True)
# for i in ticker_symbols['stock_code']:
#     ticker_data[i] = psql.read_sql("""select tick_date as datetime,open_price as open,high_price as high,low_price as low,close_price as close,volume from stock_ticker_daily_new where stock_code = '%s' and tick_date > '2019-11-01' and tick_date < '2019-11-25';""" % i, connection)
print(ticker_data)# print(ticker_data)
# closing database connection.
if (connection):
    cursor.close()
    connection.close()

This is the error.

You are connected to -  ('PostgreSQL 11.6 on x86_64-apple-darwin16.7.0, compiled by Apple LLVM version 8.1.0 (clang-802.0.42), 64-bit',) 

     datetime   open   high    low  close  volume
0  2019-09-03  15.50  15.50  14.30  14.45     681
1  2019-09-04  14.20  15.45  14.10  14.90    5120
2  2019-09-05  15.00  15.00  14.40  14.40     179
3  2019-09-06  15.00  15.00  14.35  14.95   12216
4  2019-09-09  15.00  15.00  14.55  14.65    3073
5  2019-09-11  15.00  15.00  14.40  14.50     510
6  2019-09-12  15.00  15.00  14.25  14.35    3827
7  2019-09-13  14.85  14.95  14.60  14.90    5684
8  2019-09-16  14.80  14.80  14.20  14.55   11345
9  2019-09-17  14.80  14.80  14.80  14.80     180
10 2019-09-18  14.75  14.90  14.35  14.85    9394
11 2019-09-19  15.00  15.00  14.30  14.45    2896
12 2019-09-20  14.30  17.30  14.30  15.05   14271
13 2019-09-23  15.90  15.90  14.75  14.75   14584
14 2019-09-24  15.40  15.40  14.35  15.05   12124
15 2019-09-25  16.80  16.80  13.50  14.10   32398
16 2019-09-26  14.55  15.50  14.30  14.40    9016
17 2019-09-27  15.25  15.25  14.20  14.40    2886
18 2019-09-30  15.20  15.20  14.00  14.05    2671
19 2019-10-01  14.75  14.75  13.25  13.35    2039
20 2019-10-03  14.85  14.85  13.10  13.65    3409
21 2019-10-04  14.45  14.45  13.25  13.35    2180
22 2019-10-07  13.10  14.20  13.10  13.35     570
23 2019-10-09  14.85  14.85  13.35  13.55     406
24 2019-10-10  14.40  14.45  13.10  13.40     300
25 2019-10-11  14.20  14.20  13.10  13.35     530
26 2019-10-14  13.00  14.75  13.00  13.50   30290
27 2019-10-15  14.75  14.75  12.50  12.80    1043
28 2019-10-16  13.90  13.90  12.60  12.75    1266
29 2019-10-17  14.30  14.30  12.10  12.65    2504
30 2019-10-18  13.95  13.95  12.80  13.00     253
31 2019-10-22  14.70  14.70  12.55  13.25    2360
32 2019-10-23  14.80  14.80  12.40  13.70   35380
33 2019-10-24  14.90  14.90  13.35  13.80    1362
34 2019-10-25  14.80  14.80  13.35  13.30     198
35 2019-10-29  14.50  14.50  13.25  13.50    1911
36 2019-10-30  14.00  14.00  12.75  14.00    1137
37 2019-10-31  15.45  15.45  13.10  14.60    2528
38 2019-11-01  14.95  14.95  13.35  14.00    1435
39 2019-11-04  14.00  14.75  14.00  14.70    2088
40 2019-11-05  15.00  15.00  14.05  14.70     268
41 2019-11-06  14.50  14.50  13.65  13.75     309
42 2019-11-07  14.90  14.90  14.15  14.70     222
43 2019-11-08  14.50  14.55  13.60  13.95    5583
44 2019-11-11  14.80  14.80  14.00  14.70     857
45 2019-11-13  14.70  14.80  14.05  14.35     267
46 2019-11-14  14.95  14.95  14.00  14.25    1025
47 2019-11-15  13.60  14.90  13.20  14.65   13032
48 2019-11-18  14.80  14.80  13.50  14.50     428
49 2019-11-19  14.05  14.70  13.75  14.15    7511
50 2019-11-20  14.00  14.70  13.75  14.65    1511
51 2019-11-21  14.70  14.70  13.75  14.05    2347
52 2019-11-22  13.95  15.10  13.80  14.70    7812
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
<ipython-input-226-20a6becfd09f> in <module>
     23 
     24 cerebro.addanalyzer(Screener_SMA, period=14)
---> 25 cerebro.run(runonce=False, stdstats=False, writer=True)
     26 # for i in ticker_symbols['stock_code']:
     27 #     ticker_data[i] = psql.read_sql("""select tick_date as datetime,open_price as open,high_price as high,low_price as low,close_price as close,volume from stock_ticker_daily_new where stock_code = '%s' and tick_date > '2019-11-01' and tick_date < '2019-11-25';""" % i, connection)

~/py_37_env/lib/python3.7/site-packages/backtrader/cerebro.py in run(self, **kwargs)
   1125             # let's skip process "spawning"
   1126             for iterstrat in iterstrats:
-> 1127                 runstrat = self.runstrategies(iterstrat)
   1128                 self.runstrats.append(runstrat)
   1129                 if self._dooptimize:

~/py_37_env/lib/python3.7/site-packages/backtrader/cerebro.py in runstrategies(self, iterstrat, predata)
   1210                 data._start()
   1211                 if self._dopreload:
-> 1212                     data.preload()
   1213 
   1214         for stratcls, sargs, skwargs in iterstrat:

~/py_37_env/lib/python3.7/site-packages/backtrader/feed.py in preload(self)
    436 
    437     def preload(self):
--> 438         while self.load():
    439             pass
    440 

~/py_37_env/lib/python3.7/site-packages/backtrader/feed.py in load(self)
    477 
    478             if not self._fromstack(stash=True):
--> 479                 _loadret = self._load()
    480                 if not _loadret:  # no bar use force to make sure in exactbars
    481                     # the pointer is undone this covers especially (but not

~/py_37_env/lib/python3.7/site-packages/backtrader/feeds/pandafeed.py in _load(self)
    266 
    267         # convert to float via datetime and store it
--> 268         dt = tstamp.to_pydatetime()
    269         dtnum = date2num(dt)
    270         self.lines.datetime[0] = dtnum

AttributeError: 'int' object has no attribute 'to_pydatetime'

There is a chance I am making some mistake. Can someone please help me with it? If any other information is needed or more of the code is needed I can uploaded it but I thought this would be sufficient since I think the issue is in the format of the data I am getting out from sql.
Few things to know about the data types I have tried

Tried making the date column into date time and then into index. Didn't work.
Just for the information only the volume column is an int. Others are float and I am converting datetime column into pandas date time and then index.
EVEN IF I add this line to set index same error is given.

'''
ticker_data = ticker_data.set_index('datetime')
'''

Any help would be appreciated and if anything else is needed I would be happy to add on to the question. Thanks in advance.

backtrader

@Suraj-Thorat said in Pandas Dataframe issue (int object has no attribute to_pydatetime):

Anyone has got a solution to this?

Yes. Read the documentation.

The error is self-explaining.

int object has no attribute to_pydatetime

@Suraj-Thorat said in Pandas Dataframe issue (int object has no attribute to_pydatetime):

     datetime   open   high    low  close  volume
0  2019-09-03  15.50  15.50  14.30  14.45     681
1  2019-09-04  14.20  15.45  14.10  14.90    5120

And you have an index which is made up of int values.

@Suraj-Thorat said in Pandas Dataframe issue (int object has no attribute to_pydatetime):

EVEN IF I add this line to set index same error is given.

Basic engineering principles:

You say you have done something
But you show code with something else
That means that for all intent and purposes you haven't done that.

The PandasData has a dedicated documentation page, which shows the parameters available for the data feed, and the following is stated

Link: Docs - PandasData - https://www.backtrader.com/docu/pandas-datafeed/pandas-datafeed/

...
    params = (
        # Possible values for datetime (must always be present)
        #  None : datetime is the "index" in the Pandas Dataframe
        #  -1 : autodetect position or case-wise equal name
        #  >= 0 : numeric index to the colum in the pandas dataframe
        #  string : column name (as index) in the pandas dataframe
        ('datetime', None),
...

Marki

Your entire answer is a waste of everyone's time. I have the same problem and know exactly NOTHING more from your reply. You should try to climb down from the all-mighty feeling of yours and decide between giving constructive answers and restraining yourself from writing at all. Everything else is a waste.

Please take this as constructive criticism of your actions.

Best regards,

Mark

run-out

@Marki Hi Marki, That post you are replying to is really old. If you need some help, please open a new thread and we'll be glad to assist. Thanks!