Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Time from setting hash to page loading increasingly slow on staging #172

Closed
hjhawkinsiv opened this issue Nov 10, 2020 · 13 comments
Closed
Assignees
Labels
Refactor Refactor Branch Specific

Comments

@hjhawkinsiv
Copy link
Collaborator

On staging as the test runs, the time between when the hash is set and when the page loads continually increases. The result being for the first 100 layers, staging takes ~4x golden to produce the screenshots.

Testing code:

start = time.time()
earthtime(f'window.location.hash="{hash_}"') # js call to set layer hash
end = time.time()
page_load = end - start

start = time.time()
loaded = earthtime.map_loaded(30) # waits maximum 15s for frames to be drawn
end = time.time()
map_load = end - start

Timing both of these lines separately:

image

image

Console log for loading layer 24

[231.84 11/10/2020 10:51:40 AM] index: hashChange: [object Object]
index.ts:1346 [231.93 11/10/2020 10:51:40 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [231.93 11/10/2020 10:51:40 AM] LayerDB setVisibleLayers: [pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [232.01 11/10/2020 10:51:40 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [232.01 11/10/2020 10:51:40 AM] LayerDB setVisibleLayers: [anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [232.09 11/10/2020 10:51:40 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [232.09 11/10/2020 10:51:40 AM] LayerDB setVisibleLayers: [pgh_new_apartment_units_bv]
index.ts:1346 [232.22 11/10/2020 10:51:40 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [232.22 11/10/2020 10:51:40 AM] LayerDB setVisibleLayers: []
index.ts:1343 [232.34 11/10/2020 10:51:41 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [232.34 11/10/2020 10:51:41 AM] LayerDB setVisibleLayers: [bdrk_subtle]
index.ts:1343 [232.43 11/10/2020 10:51:41 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [232.43 11/10/2020 10:51:41 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010]
index.ts:1343 [232.52 11/10/2020 10:51:41 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [232.52 11/10/2020 10:51:41 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017]
index.ts:1343 [232.58 11/10/2020 10:51:41 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [232.59 11/10/2020 10:51:41 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [232.65 11/10/2020 10:51:41 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [232.65 11/10/2020 10:51:41 AM] LayerDB setVisibleLayers: [pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [232.70 11/10/2020 10:51:41 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [232.70 11/10/2020 10:51:41 AM] LayerDB setVisibleLayers: [anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [232.78 11/10/2020 10:51:41 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [232.78 11/10/2020 10:51:41 AM] LayerDB setVisibleLayers: [pgh_new_apartment_units_bv]
index.ts:1346 [232.88 11/10/2020 10:51:41 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [232.88 11/10/2020 10:51:41 AM] LayerDB setVisibleLayers: []
index.ts:1343 [232.99 11/10/2020 10:51:41 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [232.99 11/10/2020 10:51:41 AM] LayerDB setVisibleLayers: [bdrk_subtle]
index.ts:1343 [233.08 11/10/2020 10:51:41 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [233.08 11/10/2020 10:51:41 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010]
index.ts:1343 [233.17 11/10/2020 10:51:41 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [233.17 11/10/2020 10:51:41 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017]
index.ts:1343 [233.22 11/10/2020 10:51:41 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [233.22 11/10/2020 10:51:41 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [233.26 11/10/2020 10:51:42 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [233.26 11/10/2020 10:51:42 AM] LayerDB setVisibleLayers: [pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [233.32 11/10/2020 10:51:42 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [233.33 11/10/2020 10:51:42 AM] LayerDB setVisibleLayers: [anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [233.41 11/10/2020 10:51:42 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [233.41 11/10/2020 10:51:42 AM] LayerDB setVisibleLayers: [pgh_new_apartment_units_bv]
index.ts:1346 [233.50 11/10/2020 10:51:42 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [233.50 11/10/2020 10:51:42 AM] LayerDB setVisibleLayers: []
index.ts:1343 [233.60 11/10/2020 10:51:42 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [233.60 11/10/2020 10:51:42 AM] LayerDB setVisibleLayers: [bdrk_subtle]
index.ts:1343 [233.69 11/10/2020 10:51:42 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [233.69 11/10/2020 10:51:42 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010]
index.ts:1343 [233.80 11/10/2020 10:51:42 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [233.80 11/10/2020 10:51:42 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017]
index.ts:1343 [233.84 11/10/2020 10:51:42 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [233.84 11/10/2020 10:51:42 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [233.89 11/10/2020 10:51:42 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [233.89 11/10/2020 10:51:42 AM] LayerDB setVisibleLayers: [pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [233.94 11/10/2020 10:51:42 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [233.94 11/10/2020 10:51:42 AM] LayerDB setVisibleLayers: [anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [234.03 11/10/2020 10:51:42 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [234.03 11/10/2020 10:51:42 AM] LayerDB setVisibleLayers: [pgh_new_apartment_units_bv]
index.ts:1346 [234.13 11/10/2020 10:51:42 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [234.13 11/10/2020 10:51:42 AM] LayerDB setVisibleLayers: []
index.ts:1343 [234.23 11/10/2020 10:51:42 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [234.23 11/10/2020 10:51:42 AM] LayerDB setVisibleLayers: [bdrk_subtle]
index.ts:1343 [234.32 11/10/2020 10:51:43 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [234.32 11/10/2020 10:51:43 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010]
index.ts:1343 [234.41 11/10/2020 10:51:43 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [234.41 11/10/2020 10:51:43 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017]
index.ts:1343 [234.47 11/10/2020 10:51:43 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [234.47 11/10/2020 10:51:43 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [234.52 11/10/2020 10:51:43 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [234.52 11/10/2020 10:51:43 AM] LayerDB setVisibleLayers: [pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [234.57 11/10/2020 10:51:43 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [234.57 11/10/2020 10:51:43 AM] LayerDB setVisibleLayers: [anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [234.65 11/10/2020 10:51:43 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [234.66 11/10/2020 10:51:43 AM] LayerDB setVisibleLayers: [pgh_new_apartment_units_bv]
index.ts:1346 [234.75 11/10/2020 10:51:43 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [234.75 11/10/2020 10:51:43 AM] LayerDB setVisibleLayers: []
index.ts:1343 [234.86 11/10/2020 10:51:43 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [234.87 11/10/2020 10:51:43 AM] LayerDB setVisibleLayers: [bdrk_subtle]
index.ts:1343 [234.96 11/10/2020 10:51:43 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [234.96 11/10/2020 10:51:43 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010]
index.ts:1343 [235.04 11/10/2020 10:51:43 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [235.04 11/10/2020 10:51:43 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017]
index.ts:1343 [235.09 11/10/2020 10:51:43 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [235.09 11/10/2020 10:51:43 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [235.15 11/10/2020 10:51:43 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [235.15 11/10/2020 10:51:43 AM] LayerDB setVisibleLayers: [pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [235.20 11/10/2020 10:51:43 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [235.20 11/10/2020 10:51:43 AM] LayerDB setVisibleLayers: [anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [235.28 11/10/2020 10:51:44 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [235.29 11/10/2020 10:51:44 AM] LayerDB setVisibleLayers: [pgh_new_apartment_units_bv]
index.ts:1346 [235.38 11/10/2020 10:51:44 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [235.38 11/10/2020 10:51:44 AM] LayerDB setVisibleLayers: []
index.ts:1343 [235.48 11/10/2020 10:51:44 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [235.48 11/10/2020 10:51:44 AM] LayerDB setVisibleLayers: [bdrk_subtle]
index.ts:1343 [235.58 11/10/2020 10:51:44 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [235.59 11/10/2020 10:51:44 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010]
index.ts:1343 [235.67 11/10/2020 10:51:44 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [235.67 11/10/2020 10:51:44 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017]
index.ts:1343 [235.72 11/10/2020 10:51:44 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [235.72 11/10/2020 10:51:44 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [235.76 11/10/2020 10:51:44 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [235.77 11/10/2020 10:51:44 AM] LayerDB setVisibleLayers: [pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [235.81 11/10/2020 10:51:44 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [235.81 11/10/2020 10:51:44 AM] LayerDB setVisibleLayers: [anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [235.91 11/10/2020 10:51:44 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [235.91 11/10/2020 10:51:44 AM] LayerDB setVisibleLayers: [pgh_new_apartment_units_bv]
index.ts:1346 [236.01 11/10/2020 10:51:44 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [236.01 11/10/2020 10:51:44 AM] LayerDB setVisibleLayers: []
index.ts:1343 [236.11 11/10/2020 10:51:44 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [236.11 11/10/2020 10:51:44 AM] LayerDB setVisibleLayers: [bdrk_subtle]
index.ts:1343 [236.20 11/10/2020 10:51:44 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [236.20 11/10/2020 10:51:44 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010]
index.ts:1343 [236.29 11/10/2020 10:51:45 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [236.29 11/10/2020 10:51:45 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017]
index.ts:1343 [236.35 11/10/2020 10:51:45 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [236.35 11/10/2020 10:51:45 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [236.40 11/10/2020 10:51:45 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [236.40 11/10/2020 10:51:45 AM] LayerDB setVisibleLayers: [pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [236.44 11/10/2020 10:51:45 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [236.44 11/10/2020 10:51:45 AM] LayerDB setVisibleLayers: [anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [236.53 11/10/2020 10:51:45 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [236.53 11/10/2020 10:51:45 AM] LayerDB setVisibleLayers: [pgh_new_apartment_units_bv]
index.ts:1346 [236.64 11/10/2020 10:51:45 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [236.64 11/10/2020 10:51:45 AM] LayerDB setVisibleLayers: []
index.ts:1343 [236.74 11/10/2020 10:51:45 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [236.74 11/10/2020 10:51:45 AM] LayerDB setVisibleLayers: [bdrk_subtle]
index.ts:1343 [236.83 11/10/2020 10:51:45 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [236.83 11/10/2020 10:51:45 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010]
index.ts:1343 [236.91 11/10/2020 10:51:45 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [236.92 11/10/2020 10:51:45 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017]
index.ts:1343 [236.96 11/10/2020 10:51:45 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [236.96 11/10/2020 10:51:45 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [237.03 11/10/2020 10:51:45 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [237.03 11/10/2020 10:51:45 AM] LayerDB setVisibleLayers: [pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [237.07 11/10/2020 10:51:45 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [237.08 11/10/2020 10:51:45 AM] LayerDB setVisibleLayers: [anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [237.16 11/10/2020 10:51:45 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [237.16 11/10/2020 10:51:45 AM] LayerDB setVisibleLayers: [pgh_new_apartment_units_bv]
index.ts:1346 [237.25 11/10/2020 10:51:46 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [237.25 11/10/2020 10:51:46 AM] LayerDB setVisibleLayers: []
index.ts:1343 [237.36 11/10/2020 10:51:46 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [237.37 11/10/2020 10:51:46 AM] LayerDB setVisibleLayers: [bdrk_subtle]
index.ts:1343 [237.46 11/10/2020 10:51:46 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [237.46 11/10/2020 10:51:46 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010]
index.ts:1343 [237.55 11/10/2020 10:51:46 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [237.55 11/10/2020 10:51:46 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017]
index.ts:1343 [237.60 11/10/2020 10:51:46 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [237.60 11/10/2020 10:51:46 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [237.65 11/10/2020 10:51:46 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [237.65 11/10/2020 10:51:46 AM] LayerDB setVisibleLayers: [pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [237.71 11/10/2020 10:51:46 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [237.71 11/10/2020 10:51:46 AM] LayerDB setVisibleLayers: [anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [237.80 11/10/2020 10:51:46 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [237.80 11/10/2020 10:51:46 AM] LayerDB setVisibleLayers: [pgh_new_apartment_units_bv]
index.ts:1346 [237.89 11/10/2020 10:51:46 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [237.89 11/10/2020 10:51:46 AM] LayerDB setVisibleLayers: []
index.ts:1343 [237.99 11/10/2020 10:51:46 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [237.99 11/10/2020 10:51:46 AM] LayerDB setVisibleLayers: [bdrk_subtle]
index.ts:1343 [238.09 11/10/2020 10:51:46 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [238.09 11/10/2020 10:51:46 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010]
index.ts:1343 [238.18 11/10/2020 10:51:46 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [238.18 11/10/2020 10:51:46 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017]
index.ts:1343 [238.23 11/10/2020 10:51:46 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [238.23 11/10/2020 10:51:46 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [238.28 11/10/2020 10:51:47 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [238.28 11/10/2020 10:51:47 AM] LayerDB setVisibleLayers: [pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [238.33 11/10/2020 10:51:47 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [238.33 11/10/2020 10:51:47 AM] LayerDB setVisibleLayers: [anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [238.42 11/10/2020 10:51:47 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [238.42 11/10/2020 10:51:47 AM] LayerDB setVisibleLayers: [pgh_new_apartment_units_bv]
index.ts:1346 [238.52 11/10/2020 10:51:47 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [238.52 11/10/2020 10:51:47 AM] LayerDB setVisibleLayers: []
index.ts:1343 [238.62 11/10/2020 10:51:47 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [238.62 11/10/2020 10:51:47 AM] LayerDB setVisibleLayers: [bdrk_subtle]
index.ts:1343 [238.71 11/10/2020 10:51:47 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [238.71 11/10/2020 10:51:47 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010]
index.ts:1343 [238.79 11/10/2020 10:51:47 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [238.79 11/10/2020 10:51:47 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017]
index.ts:1343 [238.86 11/10/2020 10:51:47 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [238.86 11/10/2020 10:51:47 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [238.91 11/10/2020 10:51:47 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [238.91 11/10/2020 10:51:47 AM] LayerDB setVisibleLayers: [pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [238.95 11/10/2020 10:51:47 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [238.96 11/10/2020 10:51:47 AM] LayerDB setVisibleLayers: [anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [239.04 11/10/2020 10:51:47 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [239.04 11/10/2020 10:51:47 AM] LayerDB setVisibleLayers: [pgh_new_apartment_units_bv]
index.ts:1346 [239.13 11/10/2020 10:51:47 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [239.13 11/10/2020 10:51:47 AM] LayerDB setVisibleLayers: []
index.ts:1343 [239.25 11/10/2020 10:51:47 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [239.25 11/10/2020 10:51:48 AM] LayerDB setVisibleLayers: [bdrk_subtle]
index.ts:1343 [239.34 11/10/2020 10:51:48 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [239.34 11/10/2020 10:51:48 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010]
index.ts:1343 [239.42 11/10/2020 10:51:48 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [239.43 11/10/2020 10:51:48 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017]
index.ts:1343 [239.47 11/10/2020 10:51:48 AM] timelineUIHandler checked; calling setVisibleLayers
LayerDB.ts:68 [239.47 11/10/2020 10:51:48 AM] LayerDB setVisibleLayers: [bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [239.53 11/10/2020 10:51:48 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [239.53 11/10/2020 10:51:48 AM] LayerDB setVisibleLayers: [pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [239.58 11/10/2020 10:51:48 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [239.58 11/10/2020 10:51:48 AM] LayerDB setVisibleLayers: [anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv]
index.ts:1346 [239.67 11/10/2020 10:51:48 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [239.67 11/10/2020 10:51:48 AM] LayerDB setVisibleLayers: [pgh_new_apartment_units_bv]
index.ts:1346 [239.76 11/10/2020 10:51:48 AM] timelineUIHandler not checked; calling setVisibleLayers
LayerDB.ts:68 [239.76 11/10/2020 10:51:48 AM] LayerDB setVisibleLayers: []
index.ts:922 [240.78 11/10/2020 10:51:49 AM] handlLayers; calling setVisibleLayers
LayerDB.ts:68 [240.78 11/10/2020 10:51:49 AM] LayerDB setVisibleLayers: [bdrk_subtle,total_race_2017]

uicmp log for loading layer 24

Tue Nov 10 10:51:31 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019: Page load ... 9.567882776260376s
Tue Nov 10 10:51:34 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019:Map load ... 0.23515796661376953s
Tue Nov 10 10:51:34 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019 ... True
Tue Nov 10 10:51:34 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019 ... https://rsargent.earthtime.org/explore#v=40.46512,-80.00675,11.288,latLng&t=3.16&ps=100&l=bdrk_subtle,pgh_nhbds_2010,anim_acs_renter_housing_costs_amt_2010_2017,pgh_new_apartment_units_bv&forceLegend=true&bt=20050101&et=20171231&startDwell=0.5&endDwell=1.01
Tue Nov 10 10:51:36 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019 ... 968x542
Tue Nov 10 10:51:36 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019 ... 1.4023494720458984s
Tue Nov 10 10:51:37 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019 ... 968x542
Tue Nov 10 10:51:37 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019 ... 1.4383840560913086s
Tue Nov 10 10:51:39 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019 ... 968x542
Tue Nov 10 10:51:39 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019 ... 1.4323642253875732s
Tue Nov 10 10:51:39 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019:RSS ... 540.38MB
Tue Nov 10 10:51:39 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019:ΔRSS ... 4.66MB
Tue Nov 10 10:51:39 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019:VMS ... 6620.51MB
Tue Nov 10 10:51:39 2020 :: https://rsargent.earthtime.org/explore:24 New apt $ 2005-2019:ΔVMS ... 4.78MB
@hjhawkinsiv hjhawkinsiv added the Refactor Refactor Branch Specific label Nov 10, 2020
@hjhawkinsiv
Copy link
Collaborator Author

hjhawkinsiv commented Nov 10, 2020

Graphs for map and page load times for the first 100 layers from most recent test run (Tue Nov 10 11:47:48 2020)

image

image

@rsargent
Copy link
Member

I committed the detailed console.log commenting from the screenshot for loading waypoint 24 in 516cb9f

@rsargent
Copy link
Member

Here's a super-easy repro!

@pdille
Copy link
Contributor

pdille commented Nov 11, 2020

Should be resolved in commit 14f13e2 Please confirm.

@hjhawkinsiv
Copy link
Collaborator Author

hjhawkinsiv commented Nov 11, 2020

Updated measurements. Test now takes 21 minutes to produce screenshots, down from 55.

image

image

@pdille
Copy link
Contributor

pdille commented Nov 11, 2020

@hjhawkinsiv So page load time is significantly better now but still clearly increasing over time?

@hjhawkinsiv
Copy link
Collaborator Author

That would appear to be the case. This is what it looks like for golden:

image

@pdille
Copy link
Contributor

pdille commented Nov 11, 2020

I'll take another look. I was hoping it was the low hanging fruit I found, and while that did drop the load time by ~2.5X, something else is still at play...

@rsargent
Copy link
Member

I tried the bookmark bar 23/24 test from before. Here are the profile results.

On the 4th click (the 2nd visit to waypoint 24):
image
image

On the 40th click (the 20th visit to waypoint 24):
image
image

Some notable increases in time:

  • populateLayerLibrary increased from 160ms to 825ms.
  • handleVisibleLayersStateChange increased from 27ms to 246ms.
  • updateTimelineIfNeeded increased from 65 ms to 515ms
  • bottom-up overall time in querySelectorAll increased from 79ms to 767ms,

Is it possible we might be filling the DOM with unused elements and DOM operations are becoming slower?

Also, there was also a lot more grey "Task" time for the 40th click, but I don't know what it is.
image

@pdille
Copy link
Contributor

pdille commented Nov 12, 2020

@hjhawkinsiv Alright, take two. Pushed some more changes. Let me know how it goes this round. Seems significantly better for me.

@hjhawkinsiv
Copy link
Collaborator Author

hjhawkinsiv commented Nov 12, 2020

New measurements. The overall time for generating the screenshots ~10 minutes. Map load times appear to also be significantly more stable across the entire test, with the only spike being Fires at Night, which is expected.

image

image

@rsargent
Copy link
Member

rsargent commented Nov 12, 2020 via email

@rsargent
Copy link
Member

Looks like testing the top 100 on staging this morning (8am run) took only 9 mins 35 secs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Refactor Refactor Branch Specific
Projects
None yet
Development

No branches or pull requests

3 participants