Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use MapTiler terrain tiles #1184

Merged
merged 3 commits into from
Apr 15, 2022

Conversation

wipfli
Copy link
Member

@wipfli wipfli commented Apr 14, 2022

Launch Checklist

@acalcutt it seems like we can use the maptiler key to get terrain tiles for now.

  • Confirm your changes do not include backports from Mapbox projects (unless with compliant license) - if you are not sure about this, please ask!
  • Briefly describe the changes in this PR.
  • Include before/after visuals or gifs if this PR includes visual changes.
  • Write tests for all new functionality.
  • Document any changes to public APIs.
  • Post benchmark scores.
  • Manually test the debug page.
  • Suggest a changelog category: bug/feature/docs/etc. or "skip changelog".
  • Add an entry inside this element for inclusion in the maplibre-gl-js changelog: <changelog></changelog>.

@github-actions
Copy link
Contributor

github-actions bot commented Apr 14, 2022

Bundle size report:

Size Change: 0 B
Total Size Before: 202 kB
Total Size After: 202 kB

Output file Before After Change
maplibre-gl.js 193 kB 193 kB 0 B
maplibre-gl.css 9.41 kB 9.41 kB 0 B
ℹ️ View Details No major changes

@acalcutt
Copy link
Contributor

great news about being able to use the maptiler source there

2 questions about this commit

1.) Should exaggeration be set to 1 in the example? Right now it is set to 2 which is a bit much for the example https://stackblitz.com/edit/web-platform-9zjbbl?file=index.html

2.) When I submitted the Terrain Button to max I had made a separate test page, 'debug\terrain_control.html', which hasn't been getting updated with the new style formatting. just wondering if that should be done or if the debug file should just be removed. I made it initially to show how to use a terrain button, but that could probably be worked into the other example.

@acalcutt
Copy link
Contributor

acalcutt commented Apr 15, 2022

Maybe something like this as the demo page ( https://stackblitz.com/edit/web-platform-qeeptw?file=index.html )

1.) Make the map have a location and default pitch, so you can actually see the terrain when loading the demo page
2.) Add a TerrainControl button (note, this example uses the non-terrain css, so on my demo page this is a blank button)
3.) Make the navigation control actually be able to change pitch with the visualizePitch option.
4.) Remove the marker since its not really related to the terrain example.
5.) Set exaggeration to 1 so the maptiler tiles look right.

@wipfli
Copy link
Member Author

wipfli commented Apr 15, 2022

Thanks @acalcutt

@HarelM HarelM merged commit d8aa186 into maplibre:terrain3d Apr 15, 2022
HarelM added a commit that referenced this pull request May 12, 2022
* A working prototype, which adds 3d-terrain to maplibre-gl. Sadly, during the
development i did no intermediate commits, so in this first commit all the
following functionality is included:

* allow MTK terrainRGB-tiles encoding with parameters:
  [6553.6, 25.6, 0.03, 10000.0]. In our opinion 0.1 for height-steps is to
  rough.
* create a TerrainSourceCache.js class which is similar to SourceCache.js and
  holds all the terrain-tiles used for the 3D-mesh. If a terrainRGB tile is
  used in both, terrain & hillshading, it is loaded twice. This makes the
  whole process much more easy.
* create a 3d-mesh in raster_dem_tile_worker_source.js with the martini
  library.
* rewrite the draw logic to render all layers, except symbols, into a
  framebuffer. This framebuffer a later used as a texture onto the 3d-mesh.
* rewrite symbol rendering to use 3d-coordinates. This is done with an extra
  a_ele shader parameter, because the z-value of the a_pos variable is already
  used for other things.
* add the third dimension into the collision index.
* create a terrain.html test-page.

* render more tiles to avoid wholes on tiled maps at canvas bottom

* Proof of concept! to get mercator-coords from the 3d-mesh on screen.
This is done with an extra framebuffer in which all tile coordinates are
rendered in an encoded rgb value. Dont know why, but this framebuffer looks
very inperformant. As advantage, grabbing coordinates from screen
is very fast. It may help to render the framebuffer only every 100ms instead
of every requestAnimationFrame?
This logic is currently used in
* map.project
* map.unproject.
Other usecases are:
* elevate camera over terrain
* use in mouse-events
* use in queryRenderedFeatures

* fix bug in picking correct coords from coordsFramebuffer

* Add Depthbuffer to RTT Framebuffer

* add z-dimension to circle layers

* switch to regular grid, correct rendering below ZL14, remove visible tile-boundaries

* fix raster-rendering, hacky performance improvement

* add z-dimension to fill-extrusion

* fix regular grid

* hide symbols behind terrain

* calculate elevation of symbol/circle/extrusion only once

* render coords-framebuffer only on camera movement

* improve performacne: render layers to texture only once

* * raise camera to correct zoomlevel-distance over terrain
* add exaggeration setting in TerrainSourceCache
* fix farZ clipping-plane
* set points: any declaration to Array<Object>

* Add an elevation offset of 450m to put the dead sea into positive values

* add yarn.lock file with martini entries

* render tiles only if terrain is loaded

* reuse framebuffer objects during rtt rendering

* reuse regular-mesh in all tiles

* add transform.elevation

* create transform.invProjMatrix before elevation correcture

* * move exaggeration calculation into shaders
* new more performant encoding of the coords-framebuffer

* some minor fixes, add map.addTerrain and map.removeTerrain

* refactor texture rendering

* decrease the number of framebuffers
* decrease the number of framebuffer/texture switches
* more caching and less re-rendering

the old render-pipeline renders layer by layer,
which is ok to render on display framebuffer, but when
rendering into a textures it is more performant to render all
necessary layers at once.

* moved elevation-calculation to GPU

This checkin is only for backup, so do not test!

* changed elevation calculation from CPU to GPU

This change had a big impact in performacne. To calculate the hight in
CPU sometimes about 100ms per tile was needed. When loading a lot of
tiles the framerate was really bad. This works now much better.
NOTE: Currently only the Mesh elevation is moved to GPU, symbols are
still calculated via the CPU.

* refactor render to texture workflow below ZL 14

Until now, below ZL 14 (e.g. our Vector-Tile maxzoom) the tile-size
increased with ZL, so ZL 1-14 had 1024px, ZL 15 2048px, ZL 16 4096px,
and so on. This was very easy to program, but needed also a lot of GPU
performacne and RAM. So now, the TerrainSourceCache holds tiles for each
zoomlevel of the size 1024, and below ZL 14 in each is renderd a
sub-region of ZL 14.

* refactor the coords-framebuffer.

Also the coords-framebuffer use a textures with 1024px in size. To avoid
bluring the texture below ZL 14 an additional small texture is needed
(u_coords_index) which holds in its RGBA values the tile quadrants of
the sub-regions.
NOTE: This is currently a work in progress!

* fix calculate_visibility in overzoomed terrain-tiles

* add very basic logic of loading tiles in respect of their elevation

* correct unprojecting coordinates

* correct calculation of elevation in CPU for different maxzoom settings

* calcuate symbol visibility via a depth-framebuffer, because the coords-framebuffer visibility calculation gets to wired if terrain-tiles & vector-tiles has different maxzoom settings

* fix symbol flickering

* typo

* move symbol/circle/fill_extrusion height calculation to GPU

* bugfix when rerender tiles, closes #24

* * free GPU less aggressive
* add deltaZoom setting to load less detailed terraintiles
* fix bug in _emptyDemTexture
* redraw only necesarry tiles (this still has bugs!)

* bugfix with TerrainSourceCache.deltaZoom

* * bugfix in u_terrain_matrix
* remember texture-coords to know which tile has to rerender
* disable raster fading if 3d is enabled

* add linear interpolation

* remove visible tile-boundaries

* reimplement deltaZoom

* fix marker wobbling & check visibility

* some code cleanup

* ...

* use preloaded terraintiles when zooming in and out

* ...

* bugfix for empty render-to-texture stack

* set LOD tile-loading in case of terrain3d

* avoid double-rendering (because of fading logic) of raster tiles

* calculate_visibility now checks visibility also some pixels above

* ...

* add code-documentation

* remove mtk raster-dem tiles hack

* add more minor fixes and add some comments

* bugfix for collision-index calculation with disabled 3d,
fixes #38

* revert old fill_extrusion_bucket centroid code,
because new logic had bugs

* fixes #36

* Update CHANGELOG.md

* Revert "Update CHANGELOG.md"

This reverts commit 0b81a41.

* attribution fixes (from astridx)

a1272d9

b9b0370

* Update .gitignore

* fix missing new line lint complained about

* first try (not finished) to leave the camera at the same height when dragging map.

* Revert "attribution fixes (from astridx)"

This reverts commit 2031d8e.

* Create a TerrainControl to toggle terrain

* fix tabs and comment

* change exaggeration type to number. add options to control example

* change terrain icon fill color when enabled

remove second "flat/enabled" svg. used color from gps location button.

* revert some merge changes

* Revert package-lock.json for pull request

* some improvements leave the camera in the same height during paning

* set default pitch back to 65, because of too much labels & missing sky

* fix "mismatched image size" errors in some of our stylesheets

* add default values during tinySDF generation

* fire "terrain" events

* let use TerrainControl use terrain-Event

* typo

* may fix farZ clippingplane calculation

* fix TileID-order of transform.coveringTiles result

* call transform.updateElevation on every rendering

* rerender rtt tiles on geojson.setData

* freezeElevation while camera-easing

* make tests running

* speedup symbol-placement in 2D mode

* ...

* add first very poor TerrainSourceCache test

* ...

* show correct tileBoundaries & collisionBoxes in terrain

* load LOD tiles in respect of terrain

* rename getElevationWithExaggeration to getElevation

* calculate tileDistanceToCamera form future-use in tile reduction algorithm

* update terrain-test page to maxPitch = 85

* Fix some lint warnings

* Fix some lint warnings

* lint warning fixes

* Improve typings, fix lint warnings

* Add type to getElevation parameter

* Update collision expected again?

* calculate farZ clipping-plane in respect of  transform.getHorizon

* reduce number of loaded tiles

* fix transform.locationPoint in 3d-mode

* fix not rendered areas in high zoomlevels

* fix typescript errors

* fix mouse zoom & tilt logic in 2D

* if last layer is a rtt layer, do not render it twice, fixes #1036

* correct calculation of queryRenderedFeatures coordinates in 3d-mode. fixes #1075

* Fix build typescript generation

* remove fixme's and create issues for that

* Small code fixes to avoid review comments

* Fix lint

* Fix draw_symbol unit test

* Fix unit test

* Remove console.log

* Fix build

* refacture TerrainSourceCache class

* fix lint errors

* add tests for sourceCache.usedForTerrain partent-tile-logic

* minor fixes

* Added some types and minor changes.

* encapsulate a_centroid shader attributes to #TERRAIN3D preprocessor

* remove terrain-instance from transform class, instead put as argument

* add forgotten return statements

* Add terrain to style spec (#1138)

* Add terrain to style spec

* Fix lint

* Added a test in style to make sure the terrain is created.

* fix lint

* Added validator to terrain object

* update some code-comments

* do not upload fill-extrusion centroid vertextbuffer in 2d

* transform.elevation setter: do not set unmodified state to let map.load event set correct map-location

* fix minor bugs when enable/disable terrain

* fix lint

* add test for recalcuateZoom

* Fixes related to console errors and some typings improvement in terrain branch (#1182)

* Fixes related to console errors and some typings improvement

* Fix lint

* Added -1 for terrain calculation, added a test, fixed public field

* Add typings

* Use MapTiler terrain tiles (#1184)

* Use MapTiler terrain tiles

* Default location Innsbruck, add terrain control

* Remove terrain_control debug page

* remove freezeElevation event when disable terrain3d, fixes #1185

* Fixes #1186 - add typeof guard check

* Terrain3D symbol cutoff at horizon (#1188)

* implement collision-index perspective cutoff logic

* getBounds calculate corners based on visible horizion

* add tests

* Use demotiles.maplibre.org (#1190)

* Fix terrain source button (#1192)

* When terrain is on, render last layer correct, fixes #1124 (#1189)

* when terrain is on render last layer correct, fixes #1124

* Added test to verify the bug

* Fix lint

Co-authored-by: HarelM <harel.mazor@gmail.com>

* Fix lint

Co-authored-by: max demmelbauer <max@toursprung.com>
Co-authored-by: Andrew Calcutt <acalcutt@techidiots.net>
Co-authored-by: acalcutt <acalcutt@worcester.edu>
Co-authored-by: HarelM <harel.mazor@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants