Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

QGIS 3 "unable to save auxiliary storage" #26365

Open
qgib opened this issue Mar 19, 2018 · 40 comments
Open

QGIS 3 "unable to save auxiliary storage" #26365

qgib opened this issue Mar 19, 2018 · 40 comments
Labels
Bug Either a bug report, or a bug fix. Let's hope for the latter! Project

Comments

@qgib
Copy link
Contributor

qgib commented Mar 19, 2018

Author Name: R L (R L)
Original Redmine Issue: 18477
Affected QGIS version: 3.4.1
Redmine category:project_loading/saving


Using QGIS 3, upon attempting to save the loaded project, I'll get the message "unable to save auxiliary storage" and the saving will be unsuccessful.

It doesn't have happen every time I use the program, but I can't isolate anything different about the times it does.



Related issue(s): #28647 (duplicates)
Redmine related issue(s): 20828


@qgib
Copy link
Contributor Author

qgib commented Apr 23, 2018

Author Name: Brendan Heberlein (Brendan Heberlein)


I also have experienced this issue. Running Mac OS 10.13.3 on Early 2015 MacBook Pro Retina.

@qgib
Copy link
Contributor Author

qgib commented May 8, 2018

Author Name: Cameron MacIver (Cameron MacIver)


I have the same issue. running an iMac with os 10.13.4

@qgib
Copy link
Contributor Author

qgib commented May 9, 2018

Author Name: Harrissou Santanna (@DelazJ)


Given the different OS concerned i remove the OS mention.
When it occurs, does it really prevent you to save the auxiliary storage data (hence you lose your work) or is it simply a message with no effects?


  • operating_system was changed from Windows 10 to

@qgib
Copy link
Contributor Author

qgib commented May 12, 2018

Author Name: Tommy Wahlund (Tommy Wahlund)


Same issue. Qgis 3.0.2 (revision 307d082). Windows 10. Could not isolate a reason to it either, since it only happens now and then.
The file got saved thought, so in my case the message was without effect.

@qgib
Copy link
Contributor Author

qgib commented May 31, 2018

Author Name: Calvin Thompson (Calvin Thompson)


I've experienced this issue on 2.18.16 and now 3.0.2. I often leave qgis running as I add new client properties for my lawn care company. If I forget to save this can be a nuisance since I'll have to reload all the shape files.
Just now it happened again in 3.02, however I ended task in task manager hoping an automatic backup would save me. When I reopened it was up to date. Don't know if it has no effect in 3.02 or not, but there definitely was a small panic thinking I was going to have to recreate my project file again.
Win 10

@qgib
Copy link
Contributor Author

qgib commented Jul 7, 2018

Author Name: Adam Stewart (Adam Stewart)


Also encountered this on macOS 10.13.5 with QGIS 3.2.0. Unfortunately, I have no additional info on how to reproduce it. It affects both Save and Save As. Before I tried to save, I tried to quit and it asked me if I wanted to save my changes. After seeing the error message, it no longer complained when I tried to quit, so I assume this means it actually saved and the error message is a red herring.

@qgib
Copy link
Contributor Author

qgib commented Jul 9, 2018

Author Name: Madeline Chmielinski (Madeline Chmielinski)


Encountered this on macOS 10.12.6. QGIS did not save but I was able to work around this by saving as .qgs instead of the default .qgz

@qgib
Copy link
Contributor Author

qgib commented Jul 18, 2018

Author Name: Mars Sjoden (Mars Sjoden)


QGIS version 3.2.0-Bonn
Mac 10.12.6

Same issue. Even though the same project has been saved to the same location before, this morning the error window popped up:

"unable to save auxiliary storage"

Saving as .qgs worked.

@qgib
Copy link
Contributor Author

qgib commented Jul 18, 2018

Author Name: Giovanni Manghi (@gioman)


  • version was changed from 3.0.0 to 3.2
  • category_id was changed from Unknown to Project Loading/Saving

@qgib
Copy link
Contributor Author

qgib commented Aug 16, 2018

Author Name: Kim Frankcombe (@geokimbo)


Same issue on Ubuntu 16.04 with QGIS 3.2.1. Tried save, save as, tried saving to /tmp where I know write permissions would not be an issue all no good. Change the files type to .qgs and it all worked fine. Curious that the file I originally opened was a qgs file so not sure why it wanted to change to .qgz on plain save. I just tried to repeat my steps but it now saves just fine so I can't reliably reproduce this sorry.

@qgib
Copy link
Contributor Author

qgib commented Aug 16, 2018

Author Name: Giovanni Manghi (@gioman)


  • version was changed from 3.2 to 3.2.1

@qgib
Copy link
Contributor Author

qgib commented Sep 12, 2018

Author Name: Samuel Wechsler (Samuel Wechsler)


I observed same behaviour on Windows and with QGIS3.2 only happend when trying to save to .qgz but not to .qgis (same project).

@qgib
Copy link
Contributor Author

qgib commented Sep 12, 2018

Author Name: Regis Haubourg (@haubourg)


  • priority_id was changed from Normal to High

@qgib
Copy link
Contributor Author

qgib commented Sep 12, 2018

Author Name: Regis Haubourg (@haubourg)


I just tested under ubuntu 16.04 and Windows 10 with QGIS 3.2.2. I couldn't reproduce. Can someone share a project and a dataset. We maybe have a data specific failure here


  • status_id was changed from Open to Feedback

@qgib
Copy link
Contributor Author

qgib commented Sep 18, 2018

Author Name: Sebastian Hahn (Sebastian Hahn)


I just testet with QGIS 3.2.3 under Windows 10. Saving as qgz still fails because of auxiliary storage. Saving as qgs works.

@qgib
Copy link
Contributor Author

qgib commented Sep 18, 2018

Author Name: Giovanni Manghi (@gioman)


  • version was changed from 3.2.1 to 3.2.3

@qgib
Copy link
Contributor Author

qgib commented Oct 1, 2018

Author Name: Paul Blottiere (Paul Blottiere)


I did not succeed in reproducing the error, so I opened a PR in order to add a more explicit message: #8081.

It's not a bugfix of course, but it will help us to determine the origin of the problem.

@qgib
Copy link
Contributor Author

qgib commented Oct 5, 2018

Author Name: Tom Grundy (Tom Grundy)


Same issue in 3.2.1 on Windows 10. Simple project (nevada_county_roads) and base data (Road_Centerlines) attached. Maybe a possible clue: it had been saving fine as qgz for quite a while, and after I added some rule-based symbology to Road_Centerlines, it started giving the same message. Changed from .qgz to .qgs and it saves fine. I have not tried to track it down any farther, since I need to move forward on this project with the valid .qgs workaround in place. Thanks


  • 13432 was configured as Road_Centerlines.zip
  • 13431 was configured as nevada_county_roads.zip

@qgib
Copy link
Contributor Author

qgib commented Dec 3, 2018

Author Name: Nick Hatch (Nick Hatch)


Paul Blottiere wrote:

I opened a PR in order to add a more explicit message. It's not a bugfix of course, but it will help us to determine the origin of the problem.

Thanks Paul - I think that was really helpful. Just hit this with QGIS 3.4.1-Madeira on macOS 10.12.6, the error message was: "Unable to save auxiliary storage ('Cannot open /var/folders/2l/.../T/QGIS3-duDXtB/ProjectName.qgd for input')"

I first hit this issue with QGIS 3.2.x(1?) on OS X with a long-running open project, and lost a lot of work. Upgraded to 3.4.1-Madeira - and was really cautious with saving frequently. Was away from the computer for two-weeks, when I came back the computer was in a deep hibernate state with QGIS open. Tried to save and quit, received the error.

Is it possible that the root cause here is the underlying OS cleaning up temporary files out from under QGIS?

@qgib
Copy link
Contributor Author

qgib commented Dec 5, 2018

Author Name: Giovanni Manghi (@gioman)


  • version was changed from 3.2.3 to 3.4.1

@qgib
Copy link
Contributor Author

qgib commented Jan 2, 2019

Author Name: belg4mit - (belg4mit -)


I've run into this as well. It definitely does not save the data (the file timestamp remains unmodified), yet the asterisk indicating unsaved data in the window title disappears.

Bug #28647 seems to be a duplicate of this, but it does include a work-around for those encountering it, which might also be included in a revised error dialog: Try saving as QGS instead of QGZ.

@qgib
Copy link
Contributor Author

qgib commented Feb 6, 2019

Author Name: Alister Hood (@AlisterH)


The error message indicates it is trying to save in the temporary directory e.g. C:/Users/username/AppData/Local/Temp/QGIS3-FaxmiV/
Is it right that it is trying to save there?

@qgib
Copy link
Contributor Author

qgib commented Feb 6, 2019

Author Name: Alister Hood (@AlisterH)


I guess it saves to the temporary folder and then zips it up.

Does everyone experiencing this hibernate their pc?

@qgib
Copy link
Contributor Author

qgib commented Feb 19, 2019

Author Name: Andreas Olsson (Andreas Olsson)


Same problem on Windows 10.

Error message: "Unable to save project C:*" -> "Unable to save auxiliary storage ('Cannot open C:/Users//AppData/Local/Temp/QGIS3-pbvmYI/*****.qgd for input')"

The folder isnt there, so does it fail to create it??

QGIS 3.4.4-1

It seems to be a difference using .qgs instead of qgz.

@qgib
Copy link
Contributor Author

qgib commented Mar 6, 2019

Author Name: Chris Ford (Chris Ford)


Had the same problem using 3.4.4 on mac when save as uses .qgs.qgz (suggested) or .qgz (changed to) file type. The project is not saved.

Solved by using a .gqs file type.

@qgib
Copy link
Contributor Author

qgib commented Mar 9, 2019

Author Name: Giovanni Manghi (@gioman)


@qgib qgib added Feedback Waiting on the submitter for answers Bug Either a bug report, or a bug fix. Let's hope for the latter! High Priority Project labels May 25, 2019
@Houska1
Copy link
Contributor

Houska1 commented Feb 14, 2020

Still present in 3.10.2 (OSGeo4Win). Just happened to me today; unfortunately didn't think of the qgs workaround, so lost some work.

In common with the symptoms described above (for Windows and others too), issue seems to be system hibernation and/or long elapsed calendar time with a QGIS project open (sometimes?) results in QGIS saving the project to a temp directory that doesn't exist prior to zipping to a .qgz.

Unfortunately, the error message leads one to believe it's only the auxiliary storage affected, but in fact as a result the whole project is not saved.

Quite annoying for us multitaskers; the problem is not that the old pre-hibernation changes are not saved -- hopefully we saved those long ago -- but that any changes made between returning to the open project and attempting to save it are at risk.

@Houska1
Copy link
Contributor

Houska1 commented Feb 14, 2020

Idea:
Given it may be tricky to debug exactly why and how the temp directory got zapped, could QGIS fall back to saving in a new/different directory (in my session I had no trouble creating temporary layers so it's not the whole temp directory structure being impacted!), or at least explicitly in the error message suggest saving as a .qgs?

@geokimbo
Copy link

Hibernation may be a common factor but not a required one, at least not for Ubuntu. My post back in Aug 18 was on a desktop without hibernation. It has not happened since. I upgraded to 18.04 shortly after posting - don't know if that is relevant though.

+1 for Houska1's suggestion of a more helpful error message.

@gioman gioman removed the Feedback Waiting on the submitter for answers label Feb 15, 2020
@ghost
Copy link

ghost commented Feb 17, 2020

THIS IS STILL NOT RESOLVED IN MY CASE

@ghost
Copy link

ghost commented Feb 17, 2020

Well at least 3 people have this same problem have now closed #20828 , #34462 and #34462 so its not just me @gioman has closed everyone suggesting there is more.

Further more 1 found 9 open and 16 closed https://github.com/qgis/QGIS/issues?utf8=%E2%9C%93&q=is%3Aissue+is%3Aopen+auxiliary+storage

This means that you have potential ### 28 users with this problem if they are all duplicates. Why is no support being given . Why is this QGIS procedure copying this project to a folder the QGIS team know it will get deleted from . Is that not extraordinary to you it is to me!

@mwtoews
Copy link

mwtoews commented Apr 7, 2020

This is still an annoying bug using QGIS 3.12.1-București on Windows from OSGeo4W.

The best workaround is to read the error message (e.g. see #28647) and then:

  1. Navigate to the user temporary directory cd %LOCALAPPDATA%\Temp
  2. Create the temporary folder from the error message, e.g. mkdir QGIS3-OtLGsi
  3. Create an empty file (with *.qgd extension) in the new folder from the error message, e.g. touch QGIS3-OtLGsi\project.qgd (or whatever works, such as right-click, create new text document, but then rename it)

This shouldn't be difficult to fix in the code by catching the exception to ignore the missing (and presumably cleaned-up folder) or recreate the temporary folder/file.

@rbaertsch
Copy link

I had the problem when trying to save with a full disk. Perhaps the missing file happens at that time.

@Gildae53
Copy link

Gildae53 commented Jun 2, 2020

I'm also having this problem with 3.12.2... I tried making sure Win 10 wasn't the culprit and then my Antivirus, but the problem doesn't lie there. I assume QGIS is doing this somehow. Anyone any further forward with a fix?

@brbell01
Copy link

This is still an annoying bug using QGIS 3.12.1-București on Windows from OSGeo4W.

The best workaround is to read the error message (e.g. see #28647) and then:

  1. Navigate to the user temporary directory cd %LOCALAPPDATA%\Temp
  2. Create the temporary folder from the error message, e.g. mkdir QGIS3-OtLGsi
  3. Create an empty file (with *.qgd extension) in the new folder from the error message, e.g. touch QGIS3-OtLGsi\project.qgd (or whatever works, such as right-click, create new text document, but then rename it)

This shouldn't be difficult to fix in the code by catching the exception to ignore the missing (and presumably cleaned-up folder) or recreate the temporary folder/file.

THANK YOU! This workaround did the trick and I probably saved several hours of having to recreate my map. Meanwhile, I've had this issue numerous times, now running 3.16.

@afrigeri
Copy link

This is still an annoying bug using QGIS 3.12.1-București on Windows from OSGeo4W.

The best workaround is to read the error message (e.g. see #28647) and then:

  1. Navigate to the user temporary directory cd %LOCALAPPDATA%\Temp
  2. Create the temporary folder from the error message, e.g. mkdir QGIS3-OtLGsi
  3. Create an empty file (with *.qgd extension) in the new folder from the error message, e.g. touch QGIS3-OtLGsi\project.qgd (or whatever works, such as right-click, create new text document, but then rename it)

This shouldn't be difficult to fix in the code by catching the exception to ignore the missing (and presumably cleaned-up folder) or recreate the temporary folder/file.

That worked on a stuck "unable to save auxiliary storage" 3.18

@cipri-tom
Copy link

cipri-tom commented Jun 9, 2021

This is still an annoying bug using QGIS 3.12.1-București on Windows from OSGeo4W.

The best workaround is to read the error message (e.g. see #28647) and then:

1. Navigate to the user temporary directory `cd %LOCALAPPDATA%\Temp`

2. Create the temporary folder from the error message, e.g. `mkdir QGIS3-OtLGsi`

3. Create an empty file (with *.qgd extension) in the new folder from the error message, e.g. `touch QGIS3-OtLGsi\project.qgd` (or whatever works, such as right-click, create new text document, but then rename it)

This shouldn't be difficult to fix in the code by catching the exception to ignore the missing (and presumably cleaned-up folder) or recreate the temporary folder/file.

I tried this fix on MacOS (10.15) but after creating the directories and the file, I get: "Unable to perform zip". 🤔

@mirouml
Copy link

mirouml commented Jul 5, 2021

I just got this too. QGIS version 3.16.3-Hannover on Windows 10 (10.0) - going to update to 3.20 today, and see. Anyway it is clearly related to leaving QGIS open for a long time (hours) without saving, and then trying to save project, which fortunately I do only extremely rarely.

@ghost
Copy link

ghost commented Nov 4, 2021

Getting error message "Unable to save auxiliary storage ('Cannot open /private/var/folders/8x/_4cv36hn3_l5pqm32hpwrt980000gp/T/QGIS3.iXSCWc for input')" when trying to save a project as .qgz file. Using QGIS-LTR 13.16.11-Hannover on on macOS 11.6.1.

Saving as a .qgs file does work.

@rduivenvoorde
Copy link
Contributor

Somebody in my neighbourhood was bitten by this one:

Screenshot-20220331144505-889x239

Ignore the translation, but it tells the user that QGIS cannot save the qgd (the auxiliary sqlite db from the qgz file).

And (reading the old comments above): indeed this user had left the laptop overnight unused, it has gone into hibernation, and apparently Windows has cleaned up this temporary directory and threw away the qgd file....

Reading #43560 this is partially fixed (with as drawback that you can potentially loose al your label moving work (which is saved in this qgd file....)

Mabye a better solution would be:

  • (on Windows only?): do NOT use the temporary directory which is apparently currently used to unpack the qgZ file as apparently Windows upon hibernation is cleaning up that directory
  • so either we find a directory which is NOT cleaned during hibernation, OR unzip it qgz file somewhere (next to the qgz file itself??)

Mmm, according to the interwebs, temp files should stay there forever, unless another proces (cleanup utils??) clean stuff up

So not sure if we could work around this... But I'm going to see if I can reproduce this 'hibernation issue' on a windows pc here...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Either a bug report, or a bug fix. Let's hope for the latter! Project
Projects
None yet
Development

No branches or pull requests