Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

qgis is slow to open attribute table when joining a CSV table without the "memory cache" option #19832

Closed
qgib opened this issue Nov 5, 2014 · 10 comments
Labels
Bug Either a bug report, or a bug fix. Let's hope for the latter! Vectors Related to general vector layer handling (not specific data formats)

Comments

@qgib
Copy link
Contributor

qgib commented Nov 5, 2014

Author Name: Fabien Cerbelaud (Fabien Cerbelaud)
Original Redmine Issue: 11570
Affected QGIS version: master
Redmine category:vectors


Hi, when I try to open attribute table which contain 31 000 entities it takes a lot of time because of charging only 100 entities per seconds so if I open table with a lot of entites I can't open table quickly. If I stop the process I obtain a table with for example 800 entities and I can't using field calculator because if I do that Qgis crash. In 2.2 version the open attribute table in the same shape are almost instantaneous. I don't know if it normal but it's not really helpfull to work.


@qgib
Copy link
Contributor Author

qgib commented Nov 5, 2014

Author Name: Giovanni Manghi (@gioman)


of course it is not the expected behavior but also it does not happen in a clean installation or may be is something that is data related. Please attach a sample of your data.


  • status_id was changed from Open to Feedback
  • subject was changed from open attribute table to qgis is slow to open attribute table
  • category_id was configured as Vectors

@qgib
Copy link
Contributor Author

qgib commented Nov 5, 2014

Author Name: Fabien Cerbelaud (Fabien Cerbelaud)


I can't give you sample of data because it's to big 11Mo but you can download it on https://filex.unilim.fr/get?k=d8WXmEf5lii2IF9XRNU

@qgib
Copy link
Contributor Author

qgib commented Nov 5, 2014

Author Name: Giovanni Manghi (@gioman)


table of attributes of your vector opens in a blink of eye here on both Windows and Linux and QGIS 2.6.

What OS do you use? if you are on Windows how did you installed qgis? with the psgeo4w installer or the standalone?

@qgib
Copy link
Contributor Author

qgib commented Nov 5, 2014

Author Name: Fabien Cerbelaud (Fabien Cerbelaud)


On windows 7, I used the standalone installer

@qgib
Copy link
Contributor Author

qgib commented Nov 5, 2014

Author Name: Giovanni Manghi (@gioman)


Fabien Cerbelaud wrote:

On windows 7, I used the standalone installer

so it should be a local issue. Try disable/remove any 3rd plugin, restart qgis and try again.

@qgib
Copy link
Contributor Author

qgib commented Nov 5, 2014

Author Name: Fabien Cerbelaud (Fabien Cerbelaud)


It works now after restart Qgis, I don't see something different than yesterday or today when the problem appear so I can't explain to you why it's work well now. If this problem come back I'll try to understand why before writing here again. thanks

@qgib
Copy link
Contributor Author

qgib commented Nov 5, 2014

Author Name: Giovanni Manghi (@gioman)


  • status_id was changed from Feedback to Closed
  • resolution was changed from to invalid

@qgib
Copy link
Contributor Author

qgib commented Nov 12, 2014

Author Name: Fabien Cerbelaud (Fabien Cerbelaud)


I find why I have a problem to open attribute table, it's because there is a csv join within use cache option. If I join the csv in cache there is no problem but if I join the same csv dynamically the attribute table is very slow to open. I joined to you a csv file which could be join at corine_land_cover data if you want trying.


  • status_id was changed from Closed to Reopened
  • 8067 was configured as CLC_nomenclature_05.csv

@qgib
Copy link
Contributor Author

qgib commented Nov 12, 2014

Author Name: Giovanni Manghi (@gioman)


  • subject was changed from qgis is slow to open attribute table to qgis is slow to open attribute table when joining a CSV table without the "memory cache" option
  • resolution was changed from invalid to
  • version was changed from 2.6.0 to master

@qgib
Copy link
Contributor Author

qgib commented Jun 13, 2016

Author Name: Nyall Dawson (@nyalldawson)


The cache option exists to fix this very use case. In QGIS 2.16 the cache correctly handles layer updates, so it should be used here to avoid the slow dynamic join.


  • resolution was changed from to invalid
  • status_id was changed from Reopened to Closed

@qgib qgib added Bug Either a bug report, or a bug fix. Let's hope for the latter! Vectors Related to general vector layer handling (not specific data formats) labels May 25, 2019
@qgib qgib closed this as completed May 25, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Either a bug report, or a bug fix. Let's hope for the latter! Vectors Related to general vector layer handling (not specific data formats)
Projects
None yet
Development

No branches or pull requests

1 participant