c10::Error on simplex basecalling

[cocvincent]

Hello,

I am currently experiencing a problem with simplex basecalling.

I'm trying to basecall with the dna_r10.4.1_e8.2_400bps_sup@v4.3.0 model.

After 23 hours of processing, I get the error c10::error

I also have a "bam" file in my output folder, but I'm not sure it's complete.

I'm using 100G of memory with A100/V100 GPU on a computing cluster.

I hope you can help me, thanks.

[vellamike]

The error suggests that you are running out of host (CPU) memory - are you certain that you are running on a device with 100G of memory available (this should be enough)? Also, does this work for you without multiplexing?

[cocvincent]

Hello,
thank you for your reply.

I'm sure I'm using 100g of RAM. I could see that this threshold had been exceeded.

I tried with 160g of RAM (the maximum I can allocate). Same problem.

I'm currently testing without multiplexing, waiting for the results.

Is it possible to reduce the amount of RAM used by Dorado knowing that Guppy doesn't encounter this type of problem?

Thanks.

[cocvincent]

Hello,
I had the same problem without multiplexing

[cocvincent]

Hello,

The basecalling worked surprisingly well by splitting the dataset (pod5 list) in 2 parts to reduce the memory.

Thanks you for your help.

[HalfPhoton]

Thanks for the update @cocvincent. I'll close this ticket as resolved and we'll continue to work on improving the stability of Dorado