AR synchronization with Naver map sdk #2

Snowapril · 2021-08-05T14:24:47Z

This revision includes:

Changes

1. Setup ThomasGorisse/Sceneform SDK

2. Physically based gltf rendering with filament dependency

3. Collect nearby symbols using Naver map SDK

4. Render symbol augmented information to proper direction

References

For rendering nearby building information, it need to know gps location of current device. code is referenced on https://navermaps.github.io/android-map-sdk/guide-ko/4-2.html

As naver maps sdk document recommend to use frame layout, i replaced it https://navermaps.github.io/android-map-sdk/guide-ko/4-2.html

For correctly navigating user to specific building, it need exact accelerometer & magnetic field sensor value. Continuously query their values and create rotation matrix. And add some comments

there is just textview for now

calculate bearing between two locations and return

need to test in READ world

https://github.com/github/super-linter/blob/master/docs/run-linter-locally.md

lijm1358

App keeps crashing after about 10 seconds of running with LogCat:

2021-08-06 11:31:26.482 27278-27278/com.sinbaram.mapgo E/Filament: Panic
    in HandleBase::HandleId filament::OpenGLDriver::allocateHandle(void *):348
    reason: OpenGL backend handle arena is full, please increase FILAMENT_OPENGL_HANDLE_ARENA_SIZE_IN_MB which is currently set to 4 MiB.

I know project is under development, so wonder if it's normal.

hyunyunV · 2021-08-06T04:26:50Z

LGTM

hyunyunV

LGTM

Snowapril · 2021-08-06T05:15:16Z

App keeps crashing after about 10 seconds of running with LogCat:
2021-08-06 11:31:26.482 27278-27278/com.sinbaram.mapgo E/Filament: Panic
    in HandleBase::HandleId filament::OpenGLDriver::allocateHandle(void *):348
    reason: OpenGL backend handle arena is full, please increase FILAMENT_OPENGL_HANDLE_ARENA_SIZE_IN_MB which is currently set to 4 MiB.
I know project is under development, so wonder if it's normal.

Oh it is weird. I think it is internal problem in sceneform sdk while using flilament dependency.
There is similar issue in filament repository.

I'll check it out today. Thanks.

Snowapril · 2021-08-06T05:18:22Z

@lijm1358 What device did you build on? Android studio emulator or your device?
If it was your device, please comment your device name here.

lijm1358 · 2021-08-06T05:42:42Z

@lijm1358 What device did you build on? Android studio emulator or your device?
If it was your device, please comment your device name here.

I was running on my device Galaxy S21+(SM-G996N), Android 11.

lijm1358 · 2021-08-06T05:48:11Z

btw, I was just commented out some lines build.gradle (app) before gradle build cause apikey.properties is not exist, and don't know how does it look like. Though api key doesn't seem to be used in this branch, but this might have affected the error above.

def apikeyPropertiesFile = rootProject.file("apikey.properties")
def apikeyProperties = new Properties()
apikeyProperties.load(new FileInputStream(apikeyPropertiesFile))

Snowapril · 2021-08-06T05:58:11Z

btw, I was just commented out some lines build.gradle (app) before gradle build cause apikey.properties is not exist, and don't know how does it look like. Though api key doesn't seem to be used in this branch, but this might have affected the error above.
def apikeyPropertiesFile = rootProject.file("apikey.properties")
def apikeyProperties = new Properties()
apikeyProperties.load(new FileInputStream(apikeyPropertiesFile))

@lijm1358 Ah, that is the main cause of crash I think. For keeping secret api keys from public repository, I add ignore rule in .gitignore for keeping out of secret key file from being included in commit.

I'll add API secret key file management guide in project README later. At now, you just need to add "apikey.properties" file to the client directory. After that, you should fill its content with key-value pair. I shared a copy of secret key files to the discord, please check it out.

lijm1358 · 2021-08-07T10:31:32Z

Ah, that is the main cause of crash I think. For keeping secret api keys from public repository, I add ignore rule in .gitignore for keeping out of secret key file from being included in commit.

I'll add API secret key file management guide in project README later. At now, you just need to add "apikey.properties" file to the client directory. After that, you should fill its content with key-value pair. I shared a copy of secret key files to the discord, please check it out.

@Snowapril Adding the key file not worked for me unfortunately... maybe should try another android device.

Snowapril · 2021-08-07T10:36:08Z

Hmm.. maybe there exists uncovered test case in this branch yet.
I registered new issue(#4) about testing in the outside.
At now, I think this PR need to be closed for a moment.
After testing application and debugging your issue and then I'll reopen this PR.
Thanks for reporting.

create symbol renderable data class for managing symbol nodes SymbolRenderable can be compared with Symbol variable. With this new data class, we can create renderables which did not exist before.

Before, application continuously create renderables even they already exists in renderable list. Now, rendering routine changed like below. 1. Collect nearby symbols 2. Create renderables which did not exist in mSymbolRenderables 3. Delete renderables which exist in mSymbolRenderables but not in new

Snowapril · 2021-08-10T10:34:49Z

@lijm1358 Can you check crash one more time? I fixed some stuffs

lijm1358 · 2021-08-10T13:22:57Z

@Snowapril No crashes anymore, everything seems to be work fine.

Set camera movement only once and set tracking mode as `Face` As camera is updated manually by code, camera tracking mode is automatically set to `nofollow`. But if camera mode is `nofollow`, without manually camera update, there is no camera movement. Therefore, update camera movement only once and set tracking mode for correctly working

this commit will be removed after debugging all ar rendering stuffs by rebasing

Snowapril · 2021-08-15T03:11:46Z

Now looks clear and there is no more crash. I think we can merge this branch to main

Snowapril and others added 18 commits August 1, 2021 12:04

[ci skip] : remove linter badges

8e5431a

feat(ar-maps) : import sceneform sdk for abstraction

ba2093d

feat(ar-maps) : implement sceneform sample scene

945acc3

feat(ar-maps) : add gltf model url parameter

48ca448

feat(ar-maps) : add message printing for google privacy requirements

88da4d6

refactor(ar-maps): fix super-linter issues

4be0678

feat(ar-maps) : add gps access permission

7cc9baa

feat(ar-maps) : add google location services dependency

90aab23

feat(ar-maps) : add place model for describe location

9e1aafc

feat(ar-maps) : add gps location tracking routine

acaeb46

For rendering nearby building information, it need to know gps location of current device. code is referenced on https://navermaps.github.io/android-map-sdk/guide-ko/4-2.html

feat(ar-maps) : replace fragment to FrameLayout for naver map

8971545

As naver maps sdk document recommend to use frame layout, i replaced it https://navermaps.github.io/android-map-sdk/guide-ko/4-2.html

feat(ar-maps) : add sensor tracking listener

151623e

For correctly navigating user to specific building, it need exact accelerometer & magnetic field sensor value. Continuously query their values and create rotation matrix. And add some comments

feat(ar-maps) : add map default options & camera update

6652255

feat(ar-maps) : add query nearby symbols and print

860a03a

feat(ar-maps) : add layout for view renderable

d0b9b6e

there is just textview for now

feat(ar-maps) : implement bearing calculation function

cdbab3c

calculate bearing between two locations and return

feat(ar-maps) : add building view renderable render

78a4807

need to test in READ world

refactor(ar-maps) : modify super-linter warnings

24ef170

https://github.com/github/super-linter/blob/master/docs/run-linter-locally.md

This was referenced Aug 5, 2021

Add representative image view to augmented view renderable #3

Open

Need real world test demo of ar rendering work #4

Closed

lijm1358 reviewed Aug 6, 2021

View reviewed changes

hyunyunV approved these changes Aug 6, 2021

View reviewed changes

docs(ar-maps) : add client build guide for key generation

d9286b9

Snowapril closed this Aug 7, 2021

Snowapril added 3 commits August 10, 2021 19:25

fix(ar-maps) : upgrade gradle version uptodate

08522b0

fix(ar-maps) : add symbol renderable model

8b05b6d

create symbol renderable data class for managing symbol nodes SymbolRenderable can be compared with Symbol variable. With this new data class, we can create renderables which did not exist before.

Snowapril reopened this Aug 10, 2021

Snowapril and others added 3 commits August 10, 2021 20:05

refactor(ar-maps) : fix super-linter issues

57a04c4

refactor(ar-maps) : delete inessential data class file

bb74e89

refactor(ar-maps) : add comments for resolve undocumented warnings

997b273

Snowapril and others added 4 commits August 11, 2021 16:55

debug(ar-maps) : add debugging text for symbol information

926f98a

this commit will be removed after debugging all ar rendering stuffs by rebasing

feat(ar-maps): modify camera tracking mode setting order

c4c94df

feat(ar-maps) : modify bearing degree calculate method

230973e

Snowapril force-pushed the ar-maps branch from b353955 to 230973e Compare August 14, 2021 16:41

feat(ar-maps) : add image downloader function

e5e3268

Snowapril force-pushed the ar-maps branch 2 times, most recently from f2396c9 to 75ea13d Compare August 15, 2021 02:50

refactor(ar-maps) : fix linter issues

bf81342

Snowapril force-pushed the ar-maps branch from 75ea13d to bf81342 Compare August 15, 2021 02:56

Snowapril merged commit b0ccbc4 into main Aug 15, 2021

lijm1358 mentioned this pull request Aug 16, 2021

Implement RestAPI server with Django #8

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

AR synchronization with Naver map sdk #2

AR synchronization with Naver map sdk #2

Snowapril commented Aug 5, 2021

lijm1358 left a comment

hyunyunV commented Aug 6, 2021

hyunyunV left a comment

Snowapril commented Aug 6, 2021 •

edited

Snowapril commented Aug 6, 2021

lijm1358 commented Aug 6, 2021

lijm1358 commented Aug 6, 2021

Snowapril commented Aug 6, 2021

lijm1358 commented Aug 7, 2021 •

edited

Snowapril commented Aug 7, 2021

Snowapril commented Aug 10, 2021

lijm1358 commented Aug 10, 2021

Snowapril commented Aug 15, 2021 •

edited

AR synchronization with Naver map sdk #2

AR synchronization with Naver map sdk #2

Conversation

Snowapril commented Aug 5, 2021

Changes

1. Setup ThomasGorisse/Sceneform SDK

2. Physically based gltf rendering with filament dependency

3. Collect nearby symbols using Naver map SDK

4. Render symbol augmented information to proper direction

References

lijm1358 left a comment

Choose a reason for hiding this comment

hyunyunV commented Aug 6, 2021

hyunyunV left a comment

Choose a reason for hiding this comment

Snowapril commented Aug 6, 2021 • edited

Snowapril commented Aug 6, 2021

lijm1358 commented Aug 6, 2021

lijm1358 commented Aug 6, 2021

Snowapril commented Aug 6, 2021

lijm1358 commented Aug 7, 2021 • edited

Snowapril commented Aug 7, 2021

Snowapril commented Aug 10, 2021

lijm1358 commented Aug 10, 2021

Snowapril commented Aug 15, 2021 • edited

Snowapril commented Aug 6, 2021 •

edited

lijm1358 commented Aug 7, 2021 •

edited

Snowapril commented Aug 15, 2021 •

edited