@Jonny8 said in Own indicator: "if function" with min max is very slow:

test

are you sure it is slow where you said it was? Have you profiled the code?

also check out https://min.io/

That sounds like a very long time. are you sure you're not running into memory issues? Pandas craps out under memory pressure. It starts compressing and you'll see very high CPU loads but nothing is really getting done.

If parsing the CSV is taking a long time, then I suppose pickling would work, there was a post on that and the guy saw really good improvements, but I think a better solution is probably to maintain a custom data feed in a memory db like Redis.

if its not working maybe you're missing session start and end params

https://community.backtrader.com/topic/3269/compression-using-daily-and-minute-timeframes-unsuccessful-during-replaydata/10

looks fine to me

@Jonny8 said in Own indicator: "if function" with min max is very slow:

test

are you sure it is slow where you said it was? Have you profiled the code?

ah! reminds me jupyter notebook has problems with multiprocessing too!

@Soham-Jain I haven't worked on resampling for a while but I'm quite sure pandas should support downsampling. That is a very common data science task.

might be just easier to compress it yourself with Pandas

looks awesome. ty

Not sure how you use it. but i just use tear sheet and its working fine.

I think i might have fixed some other bugs, but there are github issues that have solutions.