prod3b test diffuse file has no triggered events

[HealthyPear]

I just realized this while upgrading the integration tests for protopipe

it seems to be "easier" to just use simtel to simulate proper smaller files (like it was done before for the old prod2 test files in ctapipe) so I will try

[kosack]

can you give the file name of the file you are talking about?

Also, Note that ctapipe-extra is no longer used, but the current test datasets are a copy of the last version. I guess we need to open a separate issue tracker for issues like this.

[HealthyPear]

gamma_diffuse_LaPalma_baseline_20Zd_180Az_prod3_test.simtel.gz

though now that I notice I am using 0.3.1 but I tried also from ctapipe 0.10.5 and got the same problem so I guess the file in 0.3.3 is the same

[HealthyPear]

this file was produced using eventio_cut_file at ~10Mb so probably in that file up to 10 Mb no even was a triggering one?

[kosack]

thanks. Yes it seems to be empty of events. I don't recall where this came from, but we will need to get another. It is so far not used anywhere in ctapipe.

Yes, I suspect 10MB was too low in this case. The header information can be quite large, so it may have just stored the headers and no events.

[HealthyPear]

I don't recall where this came from, but we will need to get another. It is so far not used anywhere in ctapipe.

Mea culpa :)
I made it for some tests of cta-observatory/ctapipe#1408, but for some reason, I never realized the problem (or probably in the end I didn't even use it?)

Anyway I wanted to test everything in protopipe by using only diffuse data since it's the most general case.

I suspect 10MB was too low in this case.

Max suggested use simtel to produce a smaller file but with sure triggered events (I think this is what happened for the old gamma_test and gamma_test_large files from prod2)

[maxnoe]

@HealthyPear No, those were also cut.

But some of the more recent files I produced were intentionally simulated with small number of showers / higher energy so we'd get a few nice events.

the lst_prod3_calibration_and_mcphotons.simtel.zst for example contains 2 events of each calibration type and two 500 GeV gammas.