Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Remove TaxEntities from SGID #197

Closed
19 of 20 tasks
mheagin opened this issue Apr 19, 2022 · 21 comments
Closed
19 of 20 tasks

Remove TaxEntities from SGID #197

mheagin opened this issue Apr 19, 2022 · 21 comments
Labels
deprecation Removing data and or a service porter issue related to adding and removing data and services

Comments

@mheagin
Copy link

mheagin commented Apr 19, 2022 •
edited by jacobdadams

Summary

These are last years tax entities and are being replaced by the 2021 version. The "Rates" will not be available until September 2022.

Migration Guide

Users should point their maps to the existing, newest layer named 'UtahTaxEntities2021', 'Utah Tax Entities 2021'.
https://opendata.gis.utah.gov/datasets/utah-tax-entities-2021/explore?location=39.499688%2C-111.547240%2C-1.00

This dataset has been replaced by UtahTaxEntities2021 which is named Utah Tax Entities 2021 in the Open SGID and Utah Tax Entities 2021 in the SGID Open Data.
The replaced data is still accessible via our shelved policy in AGOL (a link to the shelved item).

Action items

  1. Assign a person who should complete the task by replacing name with their github @name.
  2. Check [x] the box when the task is completed and add the date of completion.
  3. Strike out all items that do not apply.

Soft Delete

The purpose of the soft delete is to ensure that all of our users and applications have gracefully migrated off of the dataset. Soft deletes will remain in effect for 14 days. During this time, we will have the ability to restore the dataset to its original SGID offering(s). After these 14 days, the item is then ready for a hard delete.

Note: If this dataset is being replaced, then wait until the new data is publicly available before completing these steps:

  • [ ] Prepend "(Mature Support)" to the end of the item title (, completed: 2022/00/00)
  • [ ] Remove all tags other than "Deprecated" , completed: 2022/00/00)
  • [ ] Add note to ArcGIS Online description and default popup noting when layer will be deleted and any replacement layer , completed: 2022/00/00)
  • [ ] Unshare item from Open Data (, completed: 2022/00/00)
  • Update the SGID Index row as deprecated by pasting the related Porter issue URL in the Deprecated field (@mheagin , completed: 2022/04/19)
  • [ ] Mark ArcGIS Online item as deprecated in preparation for future deletion (, completed: 2022/00/00)
    • Change Authoritative field to d in SGID.META.AGOLItems to automatically set the Deprecated AGOL flag. Allow the d to persist through one run of Auditor - currently, Auditor runs daily at 5:00am (@mheagin, completed: 2022/05/03)
      • After one successful run of Auditor, remove the row from the SGID.META.AGOLItems table. This will trigger the removal of this item in Open SGID (@jacobdadam, completed: 2022/05/17)

Hard Delete

Hard deletes are final. It is recommended to complete the soft delete process before moving on to these steps. If you decide to skip the soft delete, note that you will need to incorporate some of those steps here.

  • Manually remove data from the Internal SGID (@ZachBeck, completed: 2022/05/02)
    • Deprecated database layers can be backup up on Google Drive > AGRC Share > Team Projects > SGID > [deprecated layers]
  • Remove ArcGIS Online item: shelve please (@jacobdadams, completed: 2022/05/17)
    • Manually delete the AGOL item
    • -OR-
    • Unshare by changing the AGOL_ITEM_ID field in SGID.META.AGOLItems to something other than an Item ID and manaually changing the sharing settings (remove the item from all SGID groups, remove Public sharing),
    • -OR-
    • Shelve the data by copying the row from SGID.META.AGOLItems to the AGOLItems_shelved table in AGOL and changing the AGOL_ITEM_ID field in SGID.META.AGOLItems to shelved or some other note.
    • Deprecated AGOL items can be backup on Google Drive > AGRC Share > Team Projects > SGID > deprecated layers.
  • [ ] Remove Farm from AGOL connection (name, completed: 2022/00/00)
  • Update relevant gis.utah.gov data pages (@mheagin, completed: 2022/05/02)
  • Add this porter url to the Deprecated field of the Stewardship record (@mheagin, completed: 2022/05/02)
  • Update SGID.META.AGOLItems table (@jacobdadams , completed: 2022/05/17)
    • cut and paste row to AGOLItems_shelved table if shelving (see below)
    • set the AGOL_ITEM_ID field to hosted by <agency> for Farm from AGOL
    • set the AGOL_ITEM_ID field to exclude from AGOL to not publish to ArcGIS Online
      - [ ] Delete Google Drive data (@stdavis, completed: 2022/00/00)
  • Remove row from SGID.META.ChangeDetection (@stdavis, completed: 2022/05/16)
  • Remove data from forklift hashing and receiving (@stdavis, completed: 2022/05/16)
  • Remove row from data/hashed/changedetection.gdb/TableHashes (@stdavis, completed: 2022/05/16)

Shelve/Static

Choose one based on situation.

  • [ ] Upload to UtahAGRC/AGRC_Shelved folder in AGOL (New shelved item not already in AGOL) (name, completed: 2022/00/00)
  • Move existing AGOL item to AGRC_Shelved AGOL folder (shelving an item already in AGOL) (@jacobdadams, completed: 2022/05/17)
  • [ ] Upload to appropriate UtahAGRC/{SGID Category} folder in AGOL (for static datasets) (name, completed: 2022/00/00)

Add record to table.

  • Add record to AGOLItems_shelved table in ArcGIS Online with shelved or static in the CATEGORY field (@jacobdadams, completed: 2022/05/17)

🤖 Automation validation

  1. Assign yourself or someone to check the item by replacing name with their github @name.
  2. Check [x] the box and add the date of verification 2020/01/01 when the task is verified.
  3. Strike out all items that do not apply.

Are there service dependencies

  • Does an application depend on this data?
  • Are clients querying this data with the WebAPI?

Notification

Group Task Assignments

  1. Check [x] the box when you have assigned all the tasks relevant to your group.
@mheagin mheagin added deprecation Removing data and or a service porter issue related to adding and removing data and services labels Apr 19, 2022
@steveoh steveoh changed the title Remove <dataset name> from SGID Remove TaxEntities from SGID Apr 19, 2022
@agrc-conductor
Copy link

conductor results for tasks - 197

check status
mheagin has completed 1 out of 1 tasks 👍
@steveoh has completed 1 out of 3 tasks ⛔
@jacobdadams has completed 0 out of 1 tasks ⛔
@gregbunce has completed 0 out of 1 tasks ⛔
@rkelson has completed 0 out of 1 tasks ⛔

@agrc-conductor
Copy link

conductor results for ECONOMY.TaxEntities2020

check status
internal sgid ⛔
meta table ⛔
open sgid ⛔
open data ⛔
arcgis online ⛔
stewardship
- deprecation issue link 👍

@agrc-conductor
Copy link

conductor results for tasks - 197

check status
@jacobdadams has completed 0 out of 9 tasks ⛔
@mheagin has completed 1 out of 5 tasks ⛔
@jacobdadam has completed 0 out of 1 tasks ⛔
@ZachBeck has completed 0 out of 1 tasks ⛔
@stdavis has completed 0 out of 4 tasks ⛔
@steveoh has completed 3 out of 4 tasks ⛔
gregbunce has completed 1 out of 1 tasks 👍
@rkelson has completed 0 out of 1 tasks ⛔

@agrc-conductor
Copy link

conductor results for ECONOMY.TaxEntities2020

check status
internal sgid ⛔
meta table ⛔
open sgid ⛔
open data ⛔
arcgis online ⛔
stewardship
- deprecation issue link 👍

@mheagin
Copy link
Author

mheagin commented May 2, 2022

Afternoon All
Same thing here, I do not have Edit access to SGID.META.AGOLItems, so I can not take care of this assignment, "Change Authoritative field to d in SGID.META.AGOLItems"
again sorry.

@steveoh
Copy link
Member

steveoh commented May 2, 2022

@mheagin. I've reached out to @MichaelAGRC because everyone in the office should be able to edit that field.
Hopefully you were trying to edit with pro and not arcmap and if not you should try again.

@mheagin
Copy link
Author

mheagin commented May 2, 2022

no quick and dirty I opened arc map, I will give it another try.

@gregbunce
Copy link
Member

@mheagin you will need to make a database connection (pro or arccatalog) to the Internal db using operating system auth. then, you should have access to edit it.

image

@mheagin
Copy link
Author

mheagin commented May 3, 2022

Connection in Pro completed, edit done

@agrc-conductor
Copy link

conductor results for tasks - 197

check status
@jacobdadams has completed 0 out of 9 tasks ⛔
@mheagin has completed 4 out of 5 tasks ⛔
@jacobdadam has completed 0 out of 1 tasks ⛔
ZachBeck has completed 1 out of 1 tasks 👍
@stdavis has completed 0 out of 4 tasks ⛔
@steveoh has completed 3 out of 4 tasks ⛔
gregbunce has completed 1 out of 1 tasks 👍
@rkelson has completed 0 out of 1 tasks ⛔

@agrc-conductor
Copy link

conductor results for ECONOMY.TaxEntities2020

check status
internal sgid 👍
meta table ⛔
open sgid 👍
open data ⛔
arcgis online ⛔
stewardship
- deprecation issue link 👍

@agrc-conductor
Copy link

conductor results for tasks - 197

check status
@jacobdadams has completed 0 out of 9 tasks ⛔
@mheagin has completed 4 out of 5 tasks ⛔
@jacobdadam has completed 0 out of 1 tasks ⛔
ZachBeck has completed 1 out of 1 tasks 👍
@stdavis has completed 0 out of 3 tasks ⛔
@steveoh has completed 3 out of 4 tasks ⛔
gregbunce has completed 1 out of 1 tasks 👍
@rkelson has completed 0 out of 1 tasks ⛔

@agrc-conductor
Copy link

conductor results for ECONOMY.TaxEntities2020

check status
internal sgid 👍
meta table ⛔
open sgid 👍
open data ⛔
arcgis online ⛔
stewardship
- deprecation issue link 👍

@jacobdadams
Copy link
Member

Ok, I've switched the rows from the AGOLItems table to AGOLItems_shelved and kicked off a manual auditor for just those two rows. They are now in the shelved group and shouldn't show up in forklift/etc anymore.

I think we're good to close this, but would love a second set of eyes on everything to verify.

@stdavis
Copy link
Member

stdavis commented May 17, 2022

Seems good to me. I always like to wait for a clean conductor run.

@steveoh
Copy link
Member

steveoh commented May 17, 2022

#196 needs the same treatment right?

@jacobdadams
Copy link
Member

For some reason I keep looking right over these two when looking at the open porter issues. I've got that one updated as well.

@agrc-conductor
Copy link

conductor results for tasks - 197

check status
mheagin has completed 4 out of 4 tasks 👍
jacobdadam has completed 1 out of 1 tasks 👍
ZachBeck has completed 1 out of 1 tasks 👍
jacobdadams has completed 5 out of 5 tasks 👍
stdavis has completed 3 out of 3 tasks 👍
steveoh has completed 4 out of 4 tasks 👍
gregbunce has completed 1 out of 1 tasks 👍
@rkelson has completed 0 out of 1 tasks ⛔

@agrc-conductor
Copy link

conductor results for ECONOMY.TaxEntities2020

check status
internal sgid 👍
meta table 👍
stewardship
- deprecation issue link 👍

@steveoh
Copy link
Member

steveoh commented May 23, 2022

can this be closed?

@mheagin
Copy link
Author

mheagin commented May 23, 2022

I say close it . And thanks everybody.

@steveoh steveoh closed this as completed May 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
deprecation Removing data and or a service porter issue related to adding and removing data and services
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@steveoh @stdavis @mheagin @gregbunce @jacobdadams @agrc-conductor