The Arches team has been busy improving Arches and fixing several bugs as well. Below you'll find a listing of more changes included in the latest release.
Some of the highlights:
- Fixes issue preventing Resource editors from editing without being members of the Graph Editor group
- Improves error logging particularly for collector sync transactions
- Fixes top margin of the default report
- Fixes bug preventing app from loading without the DEFAULT_BOUNDS defined
- Deletes uploaded files when their respective tiles are deleted
- Improves v3 to v4 migration process
- Adds support for jsonl, multiprocessing data load
- Allows setup_db to be executed without superuser permissions
Users are encouraged to update at their earliest convenience. If you are upgrading from Arches 4.3, be sure to follow the project upgrade instructions to 4.4.1 before proceeding.
To upgrade you'll need to run the following commands in your activated virtual environment. Be sure to run the manage.py command from the top directory of your arches project (where manage.py is located).
pip install arches --upgrade --no-binary :all:
python manage.py migrateIf you have Arches running on a web server such as Apache, be sure to update your static files directory and restart your web server.
As always the documentation can be found at http://arches.readthedocs.io
- Add
numeralto your package.json file if you haven't added it already: cd into the directory in your project with the package.json file and runyarn add numeral. This should be located in one directory below the root (e.g. myproject/myproject/package.json)
If you are running arches from a git repo, be aware that you will need to update your Python dependencies by running (with your virtualenv activated):
pip install -r arches/install/requirements.txt- 9b005d7 update images with new terminology; fix links to rtd content
- 462bae5 remove old help-related images no longer in use
- 694f24e Cherry picks #4679 from master fixing resource editing permissions for Resource Editor, Crowdsource Editor, and Resource Reviewer groups. re #4679
- 0795174 fix issue where if DEFAULT_BOUNDS were not set then the app wouldn't load, re #4780
- f7329e6 Fixes gray margin at top of report re #4613
- 3a1cb4f Adds FK constraint to file model to tile model to ensure file records are dropped when respective tile is deleted. re #2963
- 5b89c15 Fixes issue with pre_save and post_delete signals not firing during file CRUD operations. re #2963
- 6806c04 Logs errors during sync. re archesproject/arches-collector#504
- 1e953f5 Adds console logging to a project by default. re archesproject/arches-collector#504
- 95dcf11 Prevents integrity error if tile save fails before the file datatype tries to save a file. re #2963
- 34abd86 Cherry picks commit
dd4043bfrom master (simplifies save tile error handling) - 22e1630 Calls handle_request in tile model after the tile is saved to the db so that tiles get saved before their related files. Also resaves tile after a files url is available. re #2963
- c6f8b36 Simplifies error handling in the tile view and moves tile validation prior to calling save on the tile.
- d768470 Removes extra mapping tag.
- 4f8e961 Adds session cookie name to settings and project template settings. re #4541
- a0edc7a remove unused uuid conversion method
- 7817b59 accommodate SKOS that stores prefLabels as text, not as a JSON object
- 1f0f18a explicitly remove all resources instances before testing load
- a723dc5 Prevents error when selecting groups from collector tree caused by extra tag. re #4717
- 9bfe471 Improves logging during sync, re #4837
- c5c23a8 Modifies geojson datatype to allow null values. re #4748
- 2621bca re Prevents error when saving a domain dt used in the primary discriptor fn with a value of 'None' #4725
- abaccd7 Modified date and domain list datatypes to allow null values. re #4725
- f0b4a81 Fixes error when logging a file list with files in memory. re #4853
- 19acfe3 Fixes error when validating a resource reference value that is None, re #4853
- ac9fd0e Adds support for alternate authorization header because iOS strips the 'HTTP_AUTHORIZATION' header in some API requests. re #4717
- 24a464e Modifies middleware order to try to resolve import error on travis. #4717
- 3c5b2db Handles for import error when installing using setup.py re #4717
- 5da8a20 Another attempt to run setup.py without corsheaders installed. re #4717
- df6ea75 Moves package.json from root to install directory and updates arches-project script to copy package.json to a project upon creation (cherry picked from master) re #4841
- 2368726 Adds missing js package. re #4841
- 29d3172 Removes unused middleware
- 50db174 Prevents error in date binding handler when a user clears the date picker. re #4484
- ae46fac Excepts value error in mobile survey model when start and end dates are not valid dates (such as '' and None). re #4484
- f22ae9b Fixes typo in package.json
- bd080b2 Increases max file upload size to support collector, archesproject/arches-collector#496
- 5642863 Handles saving of files for provisional editors. re #2963
- 6c42a78 Handles for cases when the model is saving data without a request (such as import) re #2963
- 352291b dates need to be not null or blank for adv. search to work, re #4872
- a8eab01 add ability to convert jsonl files re #4855
- fcb4a98 import multiple business data files from v3, accept jsonl #4855
- a6b8b40 update v3 migration tests
- 094a5ab overhaul v3 skos converter to use rdflib, improve handling of r2r relationship concepts
- ea1aa55 general print statement improvements
- 881b985 small refactor to data converter function
- 3a92d69 remove now unused lxml python dependency
- 6fd0a6c allow import of JSONL files, with optional multiprocessing #4855 #4858
- e9c8f9b update multiprocessing warning message #4858
- 358e3ff create or replace functions so they need not be removed ahead of time re #3719
- efdaff3 add setup_db command that doesn't require super user re: #3719
- 67d6747 add default settings variables to model optional pg superuser creds re #3719
- a4e95b4 deprecate old setup_db command and redirect to new one re: #3719
- 7dd010c create postgis template db in travis install re: #3719
- 0b4419a improve/fix process termination statement #3719
- eabd352 general print statement and docs improvements #3719
- 3a6b9fe fix deprecation warning as per PR comment, move to end of command #3719
- 3fb6eef remove old code unnecessary after work on #3719
- b38410b remove final psql check (psql no longer needed) re: #4803
- 9bb47b6 remove leftover import statements #3719
- db01542 support jsonl in package loading
- 43d43e0 improve handling if POSTGIS_TEMPLATE database is not present re #4944
- c196e7d update to python 3 print statements re: #4944
- e75ccc3 improve check for createdb privileges during setup_db re: #4941
Before Version Release, go through this checklist to confirm that Arches is running as intended.
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| (Test Subject) | (use indicator from list below) | (use indicator from list below) | (use indicator from list below) | (use indicator from list below) | ✅ (to confirm that the UI has rendered correctly) or ❌ (to confirm that the UI failed to render correctly) | (add ticket #, details on bug, etc.) |
When doing a test pass, consider using these status indicators:
✅ = Tested & Approved
❌ = Merge blocking
🚧 = Non-blocking bugs
🆗 = Issue has been fixed
❓ = Open question
Assigned to: Alexei
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Confirm that upgrading from the previous release is issue free | - | - | - | ? | ? | - |
Assigned to: Cyrus
Ensure that all browsers are compatible with Authentication process.
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| User can sign themselves up for a new Arches account | ✅ | ? | ? | ? | ? | - |
| User is added to default group (Crowdsource Editor) | ✅ | ? | ? | ? | ? | - |
| User can log in with their email address | ✅ | ? | ? | ? | ? | - |
| User can reset their password | ✅ | ? | ? | ? | ? | - |
| User can edit their profile (First and Last name, email address, etc...) | ✅ | ? | ? | ? | ? | - |
Assigned to: Cyrus
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Project Name - Updating name updates in index.htm and the page tab | ✅ | ? | ? | ? | ? | - |
| Web Analytics - String value inserts in base.htm at the location of this template variable:{{GOOGLE_ANALYTICS_TRACKING_ID}} | ✅ | ? | ? | ? | ? | - |
Assigned to: Cyrus
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| API Key - Key saves and API calls are successful | ✅ | ? | ? | ? | ? | - |
| Hex Grid Precision - Saves properly, but errors if precision is too high (`Exception detail: TransportError(400, u'parsing_exception', u'[geohash_grid] failed to parse field [precision]')``) | ✅ | ? | ? | ? | ? | - |
| Hex Cell Size - Changes reflected in Search results | ✅ | ? | ? | ? | ? | - |
| Default Zoom - Changes reflected in Card Config Manager | ✅ | ? | ? | ? | ? | - |
| Min Zoom - Changes reflected in Card Config Manager | ✅ | ? | ? | ? | ? | - |
| Max Zoom - Changes reflected in Card Config Manager | ✅ | ? | ? | ? | ? | - |
| Project Extent - Changes reflected in Card Config Manager | ✅ | ? | ? | ? | ? | - |
Assigned to: Galen
Basic Search Settings
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Searches per page updates properly in Search | ✅ | ? | ? | ? | ? | - |
| Number of search suggestions is reflected in search term input | ✅ | ? | ? | ? | ? | - |
Temporal Search Settings (not in use)
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Changes in time wheel color ramp are reflected in time wheel change time wheel colors (not in use) | - | - | - | - | - | - |
| Changes in time wheel config are reflected in time wheel (not in use) | - | - | - | - | - | - |
Saved Searches
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| A new search saves with a name, search url, description, and image and displays properly in the saved search page. | ✅ | ? | ? | ? | ? | - |
| Users can delete a saved search | ✅ | ? | ? | ? | ? | - |
Assigned to: Namjun
Test in the Card Configuration Manager.
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Point line and poly geoms can be created, edited, and deleted | ✅ | ? | ? | ? | ? | - |
| XY widget is working properly | ✅ | ? | ? | ? | ? | - |
| Valid geojson entered in the geojson input adds features to the map and pans to those features. If geojson is invalid user has a chance to update data. | ✅ | ? | ? | ? | ? | - |
Assigned to: Alex
Assigned to: Alex
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Settings - changes to the name and icon of a layer are reflected in the map widget overlay list and overlay library | ✅ | ? | ? | ? | ? | - |
| Deactivating/Activating a resource layer hides/shows the layer in the map widget overlay list and overlay library | ✅ | ? | ? | ? | ? | - |
| Style Settings - changes to the layer style are displayed in the layer | ✅ | ? | ? | ? | ? | - |
| Style Settings Advanced - changes to the layer style are displayed in the layer | ✅ | ? | ? | ? | ? | - |
| Activating caching adds a cache folder for a resource in your projects tile server directory | ✅ | ? | ? | ? | ? | - |
| Activating clean cache on edit updates the cache when a geometry is edited | ✅ | ? | ? | ? | ? | - |
| Setting permissions for a user or group as No Access removes the user and group from the permissions list under the permissions tab. | ✅ | ? | ? | ? | ? | - |
Assigned to: Alex
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Increasing cluster distance causes features to cluster at increased distances between them | ✅ | ? | ? | ? | ? | - |
| Increasing cluster max zoom causes clusters to be formed at higher zoom levels | ✅ | ? | ? | ? | ? | - |
| Decreasing min points to 2 points causes clusters to form with only 2 points | ✅ | ? | ? | ? | ? | - |
| Increasing vector simplification to 0.0 prevents simplification a low zoom levels | ✅ | ? | ? | ? | ? | - |
Assigned to: Alex
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Changing the default search basemap in the basemap settings is reflected on the search page | ✅ | ? | ? | ? | ? | - |
| Settings - changes to the name and icon of a layer are reflected in the map widget basemap list | ✅ | ? | ? | ? | ? | - |
| User can delete a basemap and it no longer appears in the map widget's list of basemaps | ✅ | ? | ? | ? | ? | - |
Assigned to: Alex
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Settings - changes to the name and icon of a layer are reflected in the map widget overlay list and overlay library | ✅ | ? | ? | ? | ? | - |
| User can delete an overlay and it no longer appears in the map widget overlay library | ✅ | ? | ? | ? | ? | - |
Assigned to: Cyrus
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Create_mapping_file | ✅ | ? | ? | ? | ? | - |
| Import business data (cli) | ✅ | ? | ? | ? | ? | - |
| Export business data (cli) | ✅ | ? | ? | ? | ? | - |
| Load package (cli) | ✅ | ? | ? | ? | ? | - |
| Create package (cli) | ✅ | ? | ? | ? | ? | - |
Assigned to: Galen
Confirm that the user is able to edit the following data types. Use the Test model to quickly test all ten data types. Note (GeoJson is covered by map widget testing in a different section)
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| String | ✅ | ? | ? | ? | ? | - |
| Concepts | ✅ | ? | ? | ? | ? | - |
| Domains | ✅ | ? | ? | ? | ? | - |
| Images | ✅ | ? | ? | ? | ? | - |
| Dates | ✅ | ? | ? | ? | ? | - |
| Number | ✅ | ? | ? | ? | ? | - |
| Boolean | ✅ | ? | ? | ? | ? | - |
| Resource instance type | ✅ | ? | ? | ? | ? | - |
| Node data type | ✅ | ? | ? | ? | ? | - |
Assigned to: Alexei
Updating a resource descriptor should be reflected in the following subjects.
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Search results | ✅ | - | - | ? | ? | - |
| Form headings | ✅ | - | - | ? | ? | - |
| Report headings | ✅ | - | - | ? | ? | - |
| Map popups | ✅ | - | - | ? | ? | - |
| Related resource d3 graph and listings | ✅ | - | - | ? | ? | - |
Assigned to: Cyrus
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Provisional users see indication in a widget that their tile edits were submitted | ✅ | ? | ? | ? | ? | - |
| Resource reviewers are able to identify provisional tiles and can approve/discard provisional edits | ✅ | ? | ? | ? | ? | #4950 |
| If multiple provisional editors modify a tile, a reviewer can switch between them and see edits update to reflect the selected provisional users edit | ✅ | ? | ? | ? | ? | - |
Assigned to: Galen
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| User can add a related resource | ✅ | ? | ? | ? | ? | - |
| User can delete a related resource | ✅ | ? | ? | ? | ? | - |
| User can change the properties of related resources | ✅ | ? | ? | ? | ? | - |
| User can switch between table and force directed graph | ✅ | ? | ? | ? | ? | - |
| User can page through related resources in table | ✅ | ? | ? | ? | ? | - |
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Hovering over a link in the force directed graph opens a panel with source and target node info and list each unique relationship type | ✅ | ? | ? | ? | ? | - |
| Hovering over a node highlights the adjacent links and the corresponding entry in the node list | ✅ | ? | ? | ? | ? | - |
| Hovering over a node list entry highlights the corresponding node and its adjacent links | ✅ | ? | ? | ? | ? | - |
| User can switch between table and force directed graph | ✅ | ? | ? | ? | ? | - |
| Entering text in the search field filters the list of list entries | ✅ | ? | ? | ? | ? | - |
| Overlays support custom popups | ? | ? | ? | ? | ? | - |
Assigned to: Alex
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Free text search | ✅ | - | - | ? | ? | - |
| Concept search | ✅ | - | - | ? | ? | - |
| Map search | ✅ | - | - | ? | ? | - |
| Time range based search | ✅ | - | - | ? | ? | - |
| Time wheel search | ✅ | - | - | ? | ? | - |
| Advanced search | ✅ | - | - | ? | ? | - |
| Related resource table search | 🚧 | ? | ? | ? | ? | Table filter is not available |
| Related resource graph search | ✅ | - | - | ? | ? | - |
| Resource type search | ✅ | - | - | ? | ? | - |
| Edit status search (provisional, authoritative, or both). Confirm that only resource reviewers are able to see provisional tile data | ✅ | - | - | ? | ? | - |
| Map should not zoom to points that a user is not permitted to read, nor should the search aggregation layer (e.g. hexbin or heatmap) indicate that a restricted resource is present. | ✅ | - | - | ? | ? | - |
Assigned to: Galen
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Import graph | ✅ | ? | ? | ? | ? | |
| Export graph | ✅ | ? | ? | ? | ? | - |
| Clone graph | ✅ | ? | ? | ? | ? | - |
| Delete graph | ✅ | ? | ? | ? | ? | - |
| Create branch | ✅ | ? | ? | ? | ? | - |
| Create graph | ✅ | ? | ? | ? | ? | - |
| Delete Instances | ✅ | ? | ? | ? | ? | - |
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Import graph | ✅ | ? | ? | ? | ? | Popup blocker will block the new windows for some of these functions. |
| Export graph | ✅ | ? | ? | ? | ? | - |
| Clone graph | ✅ | ? | ? | ? | ? | - |
| Delete graph | ✅ | ? | ? | ? | ? | - |
| Create branch | ✅ | ? | ? | ? | ? | - |
| Create graph | ✅ | ? | ? | ? | ? | - |
| Delete Instances | ✅ | ? | ? | ? | ? | - |
| Add/Edit cards | ✅ | ? | ? | ? | ? | - |
| Reorder widgets in card | ✅ | ? | ? | ? | ? | - |
Assigned to: Alex
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
Confirm removing read permissions removes that section from the report |
✅ | ? | ? | ? | ? | - |
Confirm removing read permissions removes that section from the form |
✅ | ? | ? | ? | ? | - |
Confirm removing read permissions removes that section from the adv. search |
✅ | ? | ? | ? | ? | - |
Confirm removing read permissions for a spatial nodegroup removes that resource type from map based search results |
✅ | ? | ? | ? | ? | - |
Confirm removing read permissions for a spatial nodegroup removes that resource type from the overlays section of the map settings |
✅ | ? | ? | ? | ? | - |
Confirm removing read permissions for a spatial nodegroup removes the map from the Map Report |
✅ | ? | ? | ? | ? | - |
Confirm removing read permissions for a date based nodegroup removes the related entries from the type dropdown in the time filter of the search page |
✅ | ? | ? | ? | ? | - |
Confirm removing read permissions for a date based nodegroup reduces the wheel count appropriately |
✅ | ? | ? | ? | ? | - |
Confirm removing write permissions but still having read permissions disallows saving that section of the form |
✅ | ? | ? | ? | ? | - |
Assigned to: Galen
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Confirm that report templates with map header gets rendered correctly | ✅ | ? | ? | ? | ? | - |
| Confirm that report templates with image header gets rendered correctly | ✅ | ? | ? | ? | ? | - |
| Confirm that report templates with no header gets rendered correctly | ✅ | ? | ? | ? | ? | #4613 |
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| String | ✅ | ? | ? | ? | ? | - |
| Concepts | ✅ | ? | ? | ? | ? | - |
| Domains | ✅ | ? | ? | ? | ? | - |
| Images | ✅ | ? | ? | ? | ? | - |
| Dates | ✅ | ? | ? | ? | ? | - |
| Number | ✅ | ? | ? | ? | ? | - |
| Boolean | ✅ | ? | ? | ? | ? | - |
| Resource instance type | ✅ | ? | ? | ? | ? | - |
| Node data type | ✅ | ? | ? | ? | ? | - |
Assigned to: Namjun
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Add scheme | ✅ | ? | ? | ? | ? | Dialogue contents do not update right away |
| Delete scheme | ✅ | ? | ? | ? | ? | - |
| Import scheme | ✅ | ? | ? | ? | ? | Does not import images |
| Export scheme | ✅ | ? | ? | ? | ? | Does not import images |
| Add top concept | ✅ | ? | ? | ? | ? | - |
| Import from SPARQL | ✅ | ? | ? | ? | ? | The list is not refreshed on import |
| Manage parents | ✅ | ? | ? | ? | ? | When polyhierachy is set, the selection not deactivated |
| Make collection | ✅ | ? | ? | ? | ? | If a user creates two collections with the same name they will not be able to delete either of them |
| Add label | ✅ | ? | ? | ? | ? | - |
| Add Note | ✅ | ? | ? | ? | ? | - |
| Add image | ✅ | ? | ? | ? | ? | - |
| Test Subject | Chrome | Safari | Firefox | IE11 | UI | Notes |
|---|---|---|---|---|---|---|
| Add collection | ✅ | ? | ? | ? | ? | - |
| Delete collection | ✅ | ? | ? | ? | ? | - |
| Export all collections | ✅ | ? | ? | ? | ? | - |
| Add dropdown entry | ✅ | ? | ? | ? | ? | - |
| Add sort order and confirm in dropdown | ✅ | ? | ? | ? | ? | In some cases custom sorting reverts to alphabetical order |