Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mapping turn lanes in SF peninsula, DC and LA #153

Closed
abhisheksaikia opened this issue Feb 5, 2016 · 53 comments

Comments

@abhisheksaikia
Copy link

commented Feb 5, 2016

Objective: Map missing turn lanes from tertiary and up in SF peninsula, DC and LA.

Team: @mapbox/team-data

Features to map: Turn lanes (motorway, trunk, primary, secondary and tertiary) from satellite imagery

Focus Area: SF peninsula and DC

Estimated features to map: unknown

Mapping speed: unknown

Available data sources

Source Description Quality License
Mapbox Satellite Imagery High
Bing Imagery Imagery High

Tasks

Location Description Start End(ETA) Validation
Palo Alto - Redwood City Trial run for estimates and workflow evaluation 12/10 (12/11) Completed
SF Peninsula Turn lanes on motorway and trunk junctions in San Francisco Peninsula 20/01/16 5/02/2016 Completed
Turn lanes in Palo Alto - 1 Mapping turn lanes on highways tertiary and up in Palo Alto 08/02/16 09/02/16 Completed
Turn lanes in DC - 1 Mapping turn lanes on highways tertiary and up in DC 08/02/16 08/02/16 Completed
Turn lanes in SF city Mapping turn lanes on highways tertiary and up in SF city 09/02/16 10/02/16 Completed
Turn lanes in DC Mapping turn lanes on highways tertiary and up in DC 11/02/16 12/02/16 Completed
Turn lanes in LA Mapping turn lanes on highways tertiary and up in LA 12/02/16 29/03/2016 Completed

JOSM Workflow

Setup

  • Task Config
  • Activate the following in from JOSM preferences > Map Settings
    • Map Paint Styles: Lanes and road attributes
    • Tagging Presets: lane attributes
  • Filter out non road features with boundary: | leisure: | landuse: | waterway: | amenity: | natural: | building:
  • Add inverse filter: highway=motorway | motorway_link | trunk| trunk_link | primary | secondary | tertiary
  • Read http://wiki.openstreetmap.org/wiki/Key:turn:lanes

Mapping

  • Check all motorways for turn lanes at exits and entry points
  • Split the road into segments based on the total number of lanes for the segment
  • For each road segment tag the turn lanes based on the road markings in the direction of the way. Eg. turn:lanes=left|through|right. See OSM turn:lanes
  • For bi-directional segments, use turn:lanes:backward= and turn:lanes:forward= to specify turn lanes in each direction.
  • Verify correct tagging using the Lane attributes style

Issues to keep in mind:

Changeset Comment: Add missing turn lanes from satellite imagery https://github.com/mapbox/mapping/issues/153

Source: Bing/Mapbox

@abhisheksaikia abhisheksaikia changed the title Mapping turn lanes in SF peninsula Mapping turn lanes in SF peninsula and DC Feb 5, 2016
@abhisheksaikia abhisheksaikia assigned jothirnadh and unassigned planemad Feb 8, 2016
@jinalfoflia

This comment has been minimized.

Copy link

commented Feb 8, 2016

The imagery at some places is not very clear and at-times the turn-lanes are covered by cars. In situations like these Mapillary plugin can be used. If there is Mapillary imagery coverage in that area, they can used to verify the presence of turn-lanes.

Name of the plugin: Mapillary

turnlanes_mapillary

Additionally, Strava global-heat cycle layer can used to verify if a particular lane is a cycle-way.
tms[16]:http://globalheat.strava.com/tiles/cycling/color3/{zoom}/{x}/{y}.png

/cc @mapbox/team-data

@jothirnadh

This comment has been minimized.

Copy link

commented Feb 9, 2016

The new Turn lane mapping task of SF city is up for mapping. This task will include all the turn lanes from tertiary and above. If you face problems in loading the blocks please split it.

cc @mapbox/team-data

@Rub21

This comment has been minimized.

Copy link
Contributor

commented Feb 9, 2016

@mapbox/peru-office is jumping on this task!,

Guys tengan en consideracion las intruciones.. :)

@jothirnadh

This comment has been minimized.

Copy link

commented Feb 10, 2016

The turn lane mapping tasks, DC task - 1 and Palo Alto task - 1 are completed and validated as well. The new DC turn lane mpping task is also up for mapping.

cc @mapbox/team-data

@jothirnadh

This comment has been minimized.

Copy link

commented Feb 11, 2016

Statistics of Turn lane mapping done in SF Peninsula

Duration: Jan 20th to Feb 10th

Team: @mapbox/team-data
screen shot 2016-02-11 at 4 02 05 pm

Roads marked with turn lanes Total
motorway 70
motorway_link 2111
trunk 432
trunk_link 116
primary 1317
secondary 1569
tertiary 518
Total 6133

cc @lxbarth and @mikelmaron

@ruthmaben

This comment has been minimized.

Copy link

commented Feb 11, 2016

How do we go forward with tagging these @mapbox/team-data

screenshot 2016-02-11 15 53 30

@planemad

This comment has been minimized.

Copy link
Contributor

commented Feb 11, 2016

^ Not completely sure whats going on here. Would this be left|left;through @Andygol ?

@abhisheksaikia

This comment has been minimized.

Copy link
Author

commented Feb 11, 2016

^I think this might be : left | merge_to_left;through @planemad @Andygol ?

@Andygol

This comment has been minimized.

Copy link
Member

commented Feb 11, 2016

@ruthmaben

Would this be left|left;through

this is right tagging ☝️

@Andygol

This comment has been minimized.

Copy link
Member

commented Feb 11, 2016

@planemad
could you change changeset comment or create new task config for http://tasks.openstreetmap.us/project/22 ?

@Andygol

This comment has been minimized.

Copy link
Member

commented Feb 11, 2016

Please pay attention in a case lanes=3 or similar. There is could be specified number of lanes in :forward and :backward directions

java openstreetmap editor 2016-02-11 14-32-50

@talllguy

This comment has been minimized.

Copy link

commented Feb 11, 2016

DC 3 inch imagery

@abhisheksaikia DC GIS has an open data site with some additional resources, including 3 inch imagery from 2015, which was just posted four weeks ago. If we could somehow get this in JOSM, it'd be very useful. It is redacted around a few sensitive areas, e.g. The White House, but it is otherwise complete

Redacted Areas

2016-02-11 09_14_11-redactedareas pdf - adobe acrobat reader dc

@ediyes

This comment has been minimized.

Copy link

commented Feb 11, 2016

Hey @Andygol
What is the tag for this case?
image

cc. @mapbox/team-data

@talllguy

This comment has been minimized.

Copy link

commented Feb 11, 2016

@mapbox/team-data you guys crushed through this task, wow. Just looking through the data and some of the ones in the done areas still do not have turn lanes. What is the protocol to ignore?

http://www.openstreetmap.org/way/379685261/history

@Andygol

This comment has been minimized.

Copy link
Member

commented Feb 11, 2016

@ediyes

What is the tag for this case?

turn:lanes=left|left;through|through

@talllguy

This comment has been minimized.

Copy link

commented Feb 12, 2016

@Andygol are the turn lane tags supposed to follow the paint on the road, or the intent of the paint? In other words, for routing purposes, would a turn:lanes=left|foo|foo tag indicate that at the end of that segment, the vehicle must turn left, or that the road marking underneath that segment indicates that there is a left turn lane ahead?

The reason I ask is while reviewing some of this tagging in DC I've found an instance with a left turn lane ends at a one-way (part of a dualized highway) that would be impossible. Though the paint indicates there is a left only restriction, the left only is beyond that intersection at the other part of the one-way pair. I thought it should be through until beyond the one-way pair, and then left after that.

@jothirnadh

This comment has been minimized.

Copy link

commented Feb 12, 2016

Statistics of Turn lane mapping done in DC

Duration: 1 day

Team: @mapbox/team-data
screen shot 2016-02-12 at 12 16 26 pm

Roads marked with turn lanes Total
motorway 20
motorway_link 8
trunk 34
trunk_link 3
primary 211
secondary 59
tertiary 35
Total 370

Observations:

  • The imagery in not clear compared to SF which made it hard to identify turn lanes.
  • The number of marked turn lanes in DC are much lesser (370) than the SF region (6133)

Next actions:

cc @planemad @lxbarth and @mikelmaron

@abhisheksaikia

This comment has been minimized.

Copy link
Author

commented Feb 12, 2016

The reason I ask is while reviewing some of this tagging in DC I've found an instance with a left turn lane ends at a one-way (part of a dualized highway) that would be impossible.

@talllguy Regarding your query above^^, can you provide a link to the instance in OSM which will help in understanding the scenario better? Thanks.

@Andygol

This comment has been minimized.

Copy link
Member

commented Feb 12, 2016

@talllguy

would a turn:lanes=left|foo|foo tag indicate that at the end of that segment, the vehicle must turn left

turn:lanes=left|| tagging indicates that from the leftmost lane we are allowed to move only in left direction when we reach an intersection/junction.

or that the road marking underneath that segment indicates that there is a left turn lane ahead?

if we have to prepare to change lane for a left turn from an extra lane we use turn:lanes=slight_left| beforehand of it

http://wiki.openstreetmap.org/wiki/Key:turn#Turning_indications

@abhisheksaikia

This comment has been minimized.

Copy link
Author

commented Feb 12, 2016

New tasks for LA : http://tasks.openstreetmap.us/project/23 and Larger SF peninsula: http://tasks.openstreetmap.us/project/24 are up.

  • Start working on LA mapping task first in the priority areas.
  • Please split the tasks beforehand as the tasks might be too big in most cases.

cc @mapbox/team-data

@jothirnadh

This comment has been minimized.

Copy link

commented Feb 12, 2016

Just looking through the data and some of the ones in the done areas still do not have turn lanes. What is the protocol to ignore?

Thanks for flagging this out @talllguy , we are trying our best to identify all the turn lanes visible in Bing/Mapbox imagery from tertiary roads and above. By mistake we might be missing some due to the poor imagery quality. If you find any of the missing turn lanes, please flag them here so that we can add them.

@talllguy

This comment has been minimized.

Copy link

commented Feb 12, 2016

@Andygol I should have included a screenshot. Here:

2016-02-12 10_45_55-java openstreetmap editor
segment link

So here I would say it should be through|right on the tagged segment, and then the segment in the middle would have a lane count of 1, with left only (assuming no uturns).

The question is if this is about mapping for routing directly.

@talllguy

This comment has been minimized.

Copy link

commented Feb 12, 2016

@jothirnadh I think I understand. If there isn't an explicitly denoted lane restriction visible on the imagery, you'd not tag it. Right?

@maning

This comment has been minimized.

Copy link
Contributor

commented Feb 23, 2016

Fixing the ^^^ above case, we split the road into 3 ways. Starting from the south we add the following tags:

  • way 1: lanes=7, lanes:backward=4, turn:lanes:backward=left|||
  • way 2: lanes=7, lanes:backward=4, turn:lanes:backward=left|||, lanes:forward=3, turn:lanes:forward=||right
  • way 3: lanes=7,lanes:forward=3, turn:lanes:forward=||right

screen shot 2016-02-23 at 15 47 58

@Andygol

This comment has been minimized.

Copy link
Member

commented Feb 25, 2016

Here is some tips how to add recently used tags. Just hold Shift pressed while choosing recently added tags from the Add value dialog. You may add recently used tags selecting it by mouse or using shortcut ⌘+⇧+[number]

turn_lanes_mapping

@planemad

This comment has been minimized.

Copy link
Contributor

commented Feb 26, 2016

Summarizing discussion from #155

  • The project focus is on turn lanes. So for completion we need correct addition of only turn:lanes, turn:lanes:forward, turn:lanes:backward. All other tags are extra information and not considered for project completion or validation.
  • Only segments which have a turn lane needs to be tagged ☝️ . No turn lanes = no need for turn lane tag
  • Adding lane= to help with style visualization and validation is ok, but not requirement for project completion. We can do lane mapping as a separate project for more efficient mapping and easier validation later.

cc @mapbox/team-data

@jothirnadh

This comment has been minimized.

Copy link

commented Feb 29, 2016

As per discussion with @pratikyadav @mikelmaron and @maning we are updating our workflow to add dual carriageways in case of physical separations on roads. At present, we have decided to add dual carriageways only for roads which are not part of any relation.

Dual-carriage way vs Fwd-Bkwd tagging

At some locations we are finding roads mapped by single carriageway while the imagery shows clear separation between roads.

dualcarriageway

When to add dual carriageway?

  • Add Dual-carriage when
    • you see physical separation betweens roads
    • no relation is attached to the way.
  • Add turn:lanes tag to both the ways.

This is added as a long term fix so that the present work of mapping turn:lanes does not become redundant in case dual carriageways are mapped in the future.

cc @mapbox/team-data

@Andygol

This comment has been minimized.

Copy link
Member

commented Feb 29, 2016

Here I've spotted difference in Bing and Mapbox imagery. Bing imagery was created 1/3/2015-1/17/2015 date of Mapbox imagery unknown. I suggest that Bing is newer
https://www.openstreetmap.org/#map=18/33.774646/-118.043975

bing_mapbox_img_diff

Bing approvement from Strava heatmap

@Andygol

This comment has been minimized.

Copy link
Member

commented Feb 29, 2016

I've updated alignment of highway ☝️ according Bing imagery + Mapillary
https://www.openstreetmap.org/changeset/37530197

@jothirnadh

This comment has been minimized.

Copy link

commented Mar 7, 2016

Important
We cleaned up 4206 empty turn lanes (turn:lanes=| or turn:lanes=|| ) in LA region with this cleanup workflow.

According to #144 (comment) we only add turn:lanes if there is a turn lane with solid white markings on the road. We will not add empty turn lanes just for the turn lane visualization in JOSM.

cc @mapbox/team-data

@abhisheksaikia

This comment has been minimized.

Copy link
Author

commented Mar 8, 2016

Capturing the estimated shipping dates for turn lanes mapping:

ESTIMATED 🚢 DATES for turn lanes mapping task in LA for @mapbox/team-data :

  • Progress till now: 67% done.
  • Daily Progress: 4-5 %
  • Estimated days remaining to complete the mapping task: ~8 working days.
  • Estimated days required for validation: ~1 week (5 working days)
  • Estimated time required to 🚢 both mapping validation in turn lanes: ~3 weeks (25th March, 2016).

Next actions for the team in turn lanes mapping:

cc @lxbarth @planemad @jothirnadh

@jothirnadh

This comment has been minimized.

Copy link

commented Mar 10, 2016

According to #144 (comment) we only add turn:lanes if there is a solid white turn markings on the road. We will not add empty turn lanes just for the turn lane visualization in JOSM.

screen shot 2016-03-10 at 2 41 35 pm

This issue is already been flagged and rectified but still finding it to be repeated by our @mapbox/team-data .

Overpass query: http://overpass-turbo.eu/s/eTL

@Rub21 can you follow this workflow and and use the above overpass query to clean this up in SF, DC and LA? It would be great if you can document your findings in this ticket.

@jothirnadh

This comment has been minimized.

Copy link

commented Mar 14, 2016

Statistics of Turn lane mapping done in LA

Duration: Feb 12th to March14th (still continuing)

Team: @mapbox/team-data

Users tunr:lanes turn:lanes:forward turn:lanes:backward Total
aarthy 11 11 10 32
andygol 706 434 415 1555
calfarome 1259 1191 1223 3673
Chetan_Gowda 20 28 29 77
dannykath 2073 1006 980 4059
ediyes 1301 946 936 3183
jinalfoflia 21 22 24 67
Jothirnadh 149 2107 2014 4270
karitotp 3017 3002 2895 8914
Luis36995 1118 322 306 1746
manings 32 21 25 78
nikhilprabhakar 92 68 58 218
oini 3 1 3 7
PlaneMad 1 2 3 6
pratikyadav 69 10 8 87
RichRico 1863 2233 2233 6329
ruthmaben 0 8 20 28
saikabhi 104 201 205 510
samely 2398 1164 1159 4721
srividya_c 2 2 4
Total 14239 12777 12548 39564

Expected time of completion: 25th March

@jothirnadh

This comment has been minimized.

Copy link

commented Mar 15, 2016

While @mapbox/team-data working on the mapping of turn lanes in LA two new scenarios were identified. They were:

Lanes with restricted access

These are the areas on streets which are restricted for vehicular traffic.

screen shot 2016-03-15 at 3 36 36 pm

screen shot 2016-03-14 at 4 46 03 pm

screen shot 2016-03-14 at 4 46 29 pm

In the above cases the areas with markings on the roads are not considered as a lane

Reverse direction turn lanes

These are the lanes specifically categorised to take U-turn or reverse-turn.

screen shot 2016-03-14 at 2 25 28 pm

These were listed in Turn Lane mapping guide, QA part. Keep us posted with new scenarios so that we can add it to the mapping guide.

@maning

This comment has been minimized.

Copy link
Contributor

commented Mar 16, 2016

There were some roads that has turn lanes but don't have an actual intersection/junction. This doesn't make sense, if you see such roads make sure you add the road that intersects with them.

missing_intersections

@jothirnadh

This comment has been minimized.

Copy link

commented Mar 16, 2016

Nice catch @maning, yes we are adding the roads at the actual junctions if they are missing.

@jinalfoflia

This comment has been minimized.

Copy link

commented Mar 16, 2016

Found this scenario where a separate road is traced from the major road. This is not required until there is a physical barrier between the roads. This turn lane can be a part of the existing road itself. So this road will have the following tags turn:lanes=left|||right.

screen shot 2016-03-16 at 3 48 37 pm

@abhisheksaikia

This comment has been minimized.

Copy link
Author

commented Mar 25, 2016

As per voice with @maning and @planemad, we are scaling down the turn lanes mapping task after the ongoing LA task is completed. The priority area in LA is almost completely mapped and validated. We will not work on the next SF peninsula task on turn lanes for now.

Next actions:

  • @mapbox/team-data to complete the remaining blocks in LA turn lanes mapping task and validate them.
  • @maning, @jothirnadh and me to cleanup data in the previously completed tasks in SF and DC.
  • @jothirnadh and me to put up a detailed summary of the stats on the turn lanes added till now.
  • @jothirnadh and me to discuss the next comms on turn lanes: blog and diary posts and put forward a timeline for getting them out.

cc @lxbarth @mikelmaron

@dannykath

This comment has been minimized.

Copy link

commented Mar 29, 2016

While I was validating turn:lanes:* in L A
I found a highway:
https://www.openstreetmap.org/way/13320233/history
that doesn't match with the satellite imagery:

Bing Imagery

p

Mapbox Imagery
a

Which satellite imagery should I work with?

@mapbox/team-data

@aaronlidman

This comment has been minimized.

Copy link

commented Mar 29, 2016

@dannykath - I grew up in this area, it is changing a lot right now, but the Bing imagery is correct.

screen shot 2016-03-29 at 6 20 09 pm

Tiger also shows the correct location.

@dannykath

This comment has been minimized.

Copy link

commented Mar 29, 2016

thanks @aaronlidman 👍

@jothirnadh

This comment has been minimized.

@abhisheksaikia

This comment has been minimized.

Copy link
Author

commented Mar 30, 2016

The LA turn lanes has been completely mapped and validated by @mapbox/team-data. 💯 🚀

As discussed above, we are going to scale down our turn lanes mapping effort and stop working on it for now.

IMMEDIATE NEXT ACTIONS:

@maning, @jothirnadh and me to cleanup data in the previously completed tasks in SF and DC.

We are working on cleaning up the previous turn lanes data in SF and DC using overpass turbo.
Estimated time: 3 days

@jothirnadh and me to put up a detailed summary of the stats on the turn lanes added till now.

@jothirnadh and me to put up the stats by end of this week by working with @planemad: derive observations from the statistics and wrap up the LA turn lanes mapping effort.

@oini

This comment has been minimized.

Copy link

commented Apr 1, 2016

Statistics of Turn Lane mapping in LA:

  • Duration: February 12th to March 29th
  • Total turn lanes added: 51,385

screen shot 2016-04-01 at 4 49 03 pm

Overall Statistics for Turn Lane mapping tasks:

  • Team: ~12
  • Average hours per day per person: ~5
  • Total number of working days: 48
  • Total hours: 2880 hours
Task Area (square kilometers) Existing total turn lanes in each city Turn lane density (per square kilometer) Percentage of total turn lanes added by Team Mapbox Turn Lanes added by team in 1 hour Time taken to add 1 turn lane (minutes) Percentage of turn lanes starting with left
SF 278.66 1,780 6.39 51.97% 12.33 4.86 70.38%
DC 206.78 745 3.6 81.88% 114 0.53 67.54%
LA 7,534.92 54,161 7.19 94.87% 321.15 0.19 89.71%

Conclusion:

Thus we can make the following conclusions based on our observations for the mapping tasks in SF, DC and, LA:

  • Currently our team can add ~321.15 turn lanes in an hour
  • Average density of turn lanes in an US city is ~5.73 per square kilometer
  • Average area of a task for an US city is ~2673.45 square kilometers
  • Average percentage of turn lanes in an US city that require mapping is ~76.24%
  • With our current speed, it should take the team ~74 days to add turn lanes in top 10 US cities
  • An average of ~75.88% of all turn lanes begin with left. Thus having a plugin that automatically sets the first lane as left and provides other facilities to enhance the speed of mapping even further would be ideal

cc @abhisheksaikia @jothirnadh @planemad

@jothirnadh

This comment has been minimized.

Copy link

commented Apr 1, 2016

Woot! superb work in pulling out the stats @oini. Great team effort @mapbox/team-data 💯 .

screen shot 2016-04-01 at 5 40 09 pm

👆 hourly stats shows how our team increased the speed from 🙅 to 👍 🚀

Next actions

  • Review completed tasks once again and close the ticket for now.

cc:/ @abhisheksaikia @planemad @shvrm

@gundersen

This comment has been minimized.

Copy link
Member

commented Apr 11, 2016

An average of ~75.88% of all turn lanes begin with left. Thus having a plugin that automatically sets the first lane as left and provides other facilities to enhance the speed of mapping even further would be ideal

Fascinating

@jothirnadh

This comment has been minimized.

Copy link

commented Apr 13, 2016

Diary has been posted and all the comms are up for validation 💯.

Closing the task for now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
You can’t perform that action at this time.