Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Think about using context model for training/fine-tuning model #287

Closed
rwood-97 opened this issue Nov 14, 2023 · 3 comments · May be fixed by #296
Closed

Think about using context model for training/fine-tuning model #287

rwood-97 opened this issue Nov 14, 2023 · 3 comments · May be fixed by #296
Labels
classify Issues related to the "Classify" functionality

Comments

@rwood-97
Copy link
Collaborator

It would be good to test the 'context' version of MapReader.

  • Maybe first talk to Kapsar
  • Run some tests
@rwood-97 rwood-97 added enhancement New feature or request new feature labels Nov 14, 2023
@rwood-97 rwood-97 added this to Backlog in Project board via automation Nov 14, 2023
@rwood-97 rwood-97 added classify Issues related to the "Classify" functionality and removed enhancement New feature or request new feature labels Nov 14, 2023
@rwood-97 rwood-97 moved this from Backlog to Upcoming in Project board Nov 14, 2023
@rwood-97 rwood-97 moved this from Upcoming to In progress (now) in Project board Nov 23, 2023
@thobson88
Copy link
Contributor

Notes on hackmd: https://hackmd.io/rJPX1LAJTsu5LFbdbW0YYg

@rwood-97
Copy link
Collaborator Author

rwood-97 commented Jan 11, 2024

From meeting (11/01/2023), plan is to try an alternative approach using context in post-processing rather than during training/classification.

Consider examples (X = railspace, o = no):

o o o
o X o
o o o

^ This is likely a false positive

o o o
X X X
o o o

^ This is likely correct

o o o
o X o
o X X

^ This likely requires attention/review

This kind of post-processing can be done fairly easily using rules to pick out which ones we want to change labels for and/or review.
See notes in hackmd for more info.

Things to consider:

  • How does this generalise across other MapReader use cases? e.g. non-linear features such as buildings or trees? Any post-processing that is included into MapReader code should allow users to define their own rules for false-positives etc. to allow for different use cases

@rwood-97
Copy link
Collaborator Author

Have just merged #350 which adds functionality for using context images when training a model. Would be good to test this a bit more at some point but am closing this ticket for now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
classify Issues related to the "Classify" functionality
Projects
Project board
In progress (now)
Development

Successfully merging a pull request may close this issue.

2 participants