@backtrader I am already doing so, will also share here when I am finished. Though I am really wondering what your setup is like. ibtest was not able to solve connection issues for as it is.

this problem has been discussed many times here, people including me claim that such a problem exists while the author claims against. bt's ib integration is not in ideal condition for continuous automation.

Hello,

I am paper trading with IB and have trade history enabled. I want to find out in which case notify_trade doesn't obtain a new Trade instance after a closed one. Assuming I have a closed trade for a given contract, if I make a new order and not close the trade, should notify_trade obtain a new trade with new history or append to history?

Every once in a while I notice that trade.history[0] is does not belong to my new open order but the previous opening order of the closed price. An example of trade.history you can see below:

[TradeHistory([('status', AutoOrderedDict([('status', 1), ('dt', 736969.4541666667), ('barlen', 0), ('size', -107500), ('price', 1.15164), ('value', 123801.3), ('pnl', 0.0), ('pnlcomm', 0.0), ('tz', <UTC>)])), ('event', AutoOrderedDict([('order', <backtrader.brokers.ibbroker.IBOrder object at 0x113c50cc0>), ('size', -107500), ('price', 1.15164), ('commission', 2.476026)]))]),
TradeHistory([('status', AutoOrderedDict([('status', 2), ('dt', 736969.4736689815), ('barlen', 337), ('size', 0), ('price', 1.15164), ('value', 0.0), ('pnl', -95.67500000000618), ('pnlcomm', -100.62896600000617), ('tz', <UTC>)])), ('event', AutoOrderedDict([('order', <backtrader.brokers.ibbroker.IBOrder object at 0x114dbe710>), ('size', 107500), ('price', 1.15253), ('commission', 2.47794)]))]),
TradeHistory([('status', AutoOrderedDict([('status', 1), ('dt', 736969.4907986111), ('barlen', 0), ('size', 107500), ('price', 1.15262), ('value', 123906.65), ('pnl', -95.67500000000618), ('pnlcomm', -100.62896600000617), ('tz', <UTC>)])), ('event', AutoOrderedDict([('order', <backtrader.brokers.ibbroker.IBOrder object at 0x114c9cbe0>), ('size', 107500), ('price', 1.15262), ('commission', 2.4781330000000006)]))])]

@backtrader thank you for the suggestion. Though would that still work If I need to replay multiple timeframes?

I was thinking of resampling my low tf data dataframe with pandas to higher timeframe and use it for backfilling source. (if I got you right above).

If I have multiple replays, then I will do the pandas resampling multiple times, but I think concatenating and backfilling wouldn't be the right approach, because they have different compressions on bt PandasData level.

What would you suggest for multiple replays?

Hello,

I want to reduce the time required for backfilling.

I was wondering whether it is ever possible to backfill replayed data. Currently backfilling is done via executing the strategy on low time frame data and higher time framed replayed datas, which takes a bit of time. I just need to do backfilling to initialize higher time frame datas before executing my strategy live.

It would be easier for me if I was directly allowed to provide higher timeframe data myself instead of executing the strategy for backfilling.

Best

contacted IB live chat and it was suggested to use ib_insync instead of ibapi or IBpy to avoid lags.

In addition, when a network problem or similar occurs, with stalled IbPy2 and multiple contracts, it will not be able to notice the network problem right away like ib_insync.

@backtrader

I have done many tests to figure out what might be causing such delays. backtrader itself can handle multiple contracts well for backtesting, so the issue was not backtrader itself.

I have tried reqMktData on multiple contracts (20-30) simultaneously with ib_insync and IbPy2 and it turned out that IbPy2 was lagging way behind and causing the delays. (lots of more than 5 seconds delays for IbPy2 and way less amount of 1-2 seconds and less delays for ib_insync).

I will post here the test codes for you guys if you want to.

Best

https://community.backtrader.com/topic/970/backtest-vs-live-bars-off-by-1-discrepancy/17

https://community.backtrader.com/topic/989/live-data-does-not-match-historical-data-for-ibtest-py-359/6

the threads above are similar to this one.

Has anyone ever managed to run backtrader with IB 24h without any data streaming issues as described here?