Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Apply pointcloud, continued #223

Merged
merged 46 commits into from
Aug 10, 2023
Merged

Apply pointcloud, continued #223

merged 46 commits into from
Aug 10, 2023

Conversation

brettviren
Copy link
Member

This continues the work started in #217.

  • fill point cloud from ICluster (see BlobSampling and BlobSampler)
  • figure out PCA with Eigen (see util/test/doctest_eigen_pca.cxx)
  • figure out Hough for direction (see util/test/doctest_pointcloud_hough.cxx)
  • a test for writeing point cloud to tensor to file
  • a test for reading point cloud from tensor from file
  • projection back to frame (started, see BlobSetReframer)
  • a test of projections against original frame
  • a test that exports point cloud to bee/paraview for evaluation

The main test is img/test/test-tenio.{org,bats} and the tenio-*.jsonnet files in same dir.

Emit warning if config still provides no ignored "wiener_threshold_tag".

Also remove the utterly rediculous and afaic find totally unused 50
argument long constructor.
This uncovers the problem that wclsFrameSaver in larwirecell uses the
"threshold" tag to both loate the wiener RMS summary and to save it
into the art::Event.  For now I have left this, until understanding
how best to handle it.  If we also change this to "wiener" it has
downstream consequences on any consumer of the art::Event.
…vor of "wiener".

WARNING to art/larsoft users:

The wclsFrameSaver uses this tag both to find traces and to save a
vector<double> data product in the art::Event.  This commit changes
how wclsFrameSaver is configured.  There are to implications:

1) You may have your own configuration of wclsFrameSaver.  It MUST use
"wiener" to find Wiener RMS summary as "threshold" does no longer
exist.

2) Any art/larsoft code downstream must look for these values in
"wiener" and not "threshold".

If all goes well, any old configuration will cause art/larsoft to
exist quickly and loudly so it should be easy to find the
configuration that needs updating.
Note, some tests fail.  Merge my apply-pointcloud first to see if they are already fixed
A test name change broke history-comp1d.bats.  I need to regenerate data repo
This is intended to be used as part of a test for tiling.  The tenio
test runs it and we get something out, but more work is still needed.

Note, there is also a much older BlobReframer, (which really takes
ICluster).  It is broken in the case that the blobs have lost their
connection with their original frame, such as when they are read from
file.
… reframe from blobs without an IFrame available
@brettviren
Copy link
Member Author

Some of the checklist is not done - and more is needed - but we decided to get this in before moving on to the clustering stage of the porting.

@brettviren brettviren marked this pull request as ready for review July 25, 2023 13:24
@HaiwangYu
Copy link
Member

Compiles and runs for both uboone and FD-VD. Compared to uboone ref:
Screenshot 2023-08-09 at 10 42 22 PM
All looks good for now. Will do more checks together with other PRs.

@HaiwangYu HaiwangYu merged commit 74a6ca0 into master Aug 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants