Skip to content

Initial Camera UX Updates and Polygon Mesh Support #326

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 80 commits into from
Nov 10, 2025
Merged

Initial Camera UX Updates and Polygon Mesh Support #326

merged 80 commits into from
Nov 10, 2025

Conversation

@himanshunaidu
Copy link
Collaborator

@himanshunaidu himanshunaidu commented Oct 25, 2025

No description provided.

@himanshunaidu
Create copies of main camera files
6dbd519
@himanshunaidu
Add new UI folder
abac498
@himanshunaidu
Set up initial camera view with new ARKit features
14522f3
@himanshunaidu
Additional Camera Manager setup for camera image processing
0dea7f4
@himanshunaidu
Handle Camera Manager errors
5f6bebd
@himanshunaidu
Add references to segmentation pipeline
f25a33f
@himanshunaidu
Setup structured concurrency in camera manager and segmentation pipeline
e69faee
@himanshunaidu
Fix structured concurrency and mappings between content view and came…
d6abe6c 
…ra manager
@himanshunaidu
Additional cleanup work
b75b4c9
@himanshunaidu
Fix alignment and post-processing of segmentation images
1f99165
@himanshunaidu
Create segmentation bounding frame
e2e949e
@himanshunaidu
Initial logic for detected object alignment along with other changes
0cb1bc4
@himanshunaidu
Complete initial logic for detected object alignmnent
87f9c9d
@himanshunaidu
Alignment of ar view controller with camera image aspect ratio, and o…
597a4ea 
…ther changes
@himanshunaidu
Additional changes to save
08ee32a
@himanshunaidu
Add initial orientation flexibility without aspect ratio fixes
4a46e68
@himanshunaidu
Fix orientation flexibility in ar view controller
ab49a53
@himanshunaidu
Fix backing of segmentation image to pixel buffer
d1b6a26
@himanshunaidu
Replace device orientation with interface orientation for ar view con…
752ca84 
…troller, and other changes
@himanshunaidu
Struct based restructuring and relax the requirement of colored segme…
bddc8c9 
…ntation
This was linked to issues Oct 28, 2025
Instead of permanently processing the camera and depth images at the Camera View, use the original images #321
Closed
Replace Camera View UIView with ARView #322
Closed
Utilize the polygon mesh provided by ARKit instead of only the camera images #329
Closed
Fix concurrency issues found by compiler with Strict Concurrency Checking as Complete #328
Open
@himanshunaidu himanshunaidu removed a link to an issue Oct 28, 2025
Fix concurrency issues found by compiler with Strict Concurrency Checking as Complete #328
Open
This was linked to issues Oct 28, 2025
CameraManager is being used as a primitive variable #140
Closed
Make the GrayscaleToColorCIFilter non-blocking and maybe make it a simple object instead of a CIFilter #161
Closed
@himanshunaidu himanshunaidu linked an issue Oct 28, 2025 that may be closed by this pull request
If Segmentation frames get backlogged due to model performance issues, the app functionality freezes #152
Closed
@himanshunaidu himanshunaidu linked an issue Nov 8, 2025 that may be closed by this pull request
Handle the fatal errors more gracefully, there are too many fatal errors in the application currently #187
Closed
@himanshunaidu himanshunaidu linked an issue Nov 9, 2025 that may be closed by this pull request
The inconsistent usage of the SegmentationClassConstants properties is making things confusing #212
Closed
@himanshunaidu himanshunaidu removed a link to an issue Nov 9, 2025
CPU usage due to ARKit and CoreML gradually increases over time #331
Open
@himanshunaidu himanshunaidu linked an issue Nov 9, 2025 that may be closed by this pull request
Foreground color is deprecated #117
Closed
@himanshunaidu himanshunaidu mentioned this pull request Nov 9, 2025
Closed
@himanshunaidu himanshunaidu merged commit 48ee9ec into main Nov 10, 2025
@himanshunaidu himanshunaidu changed the title Camera UX Updates and Polygon Mesh Support Initial Camera UX Updates and Polygon Mesh Support Nov 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Handle the fatal errors more gracefully, there are too many fatal errors in the application currently Make the GrayscaleToColorCIFilter non-blocking and maybe make it a simple object instead of a CIFilter If Segmentation frames get backlogged due to model performance issues, the app functionality freezes CameraManager is being used as a primitive variable Foreground color is deprecated
The inconsistent usage of the SegmentationClassConstants properties is making things confusing Instead of permanently processing the camera and depth images at the Camera View, use the original images Replace Camera View UIView with ARView Utilize the polygon mesh provided by ARKit instead of only the camera images Work on the performance issues of the mesh processing pipeline

2 participants

@himanshunaidu