Indexing data takes a very long time

[qgib]

Author Name: Alexey T (@Xeenych)
Original Redmine Issue: 21189
Affected QGIS version: 3.4.4
Redmine category:digitising

---

I have a large project with vector DEM loaded.
When I try to edit any feature QGis starts indexing data.
First, it takes a veeery long time to index.
Second, it takes more than 8 Gigs of RAM.

Looks like QGis indexes the whole project. I believe it is sufficient to index only the canvas.

[qgib]

Author Name: Giovanni Manghi (@gioman)

---

can you attach a sample project with data?

---

• status_id was changed from Open to Feedback

[qgib]

Author Name: Alexey T (@Xeenych)

---

It is 8 Gb of DEM data in shapefiles. Snapping should be enabled. When you try to edit it, QGIS indexes it and consumes 19Gb of RAM.

[qgib]

Author Name: Giovanni Manghi (@gioman)

---

Alexey T wrote:

It is 8 Gb of DEM data in shapefiles. Snapping should be enabled. When you try to edit it, QGIS indexes it and consumes 19Gb of RAM.

a DEM is usually a raster map, in this case I guess you refer to a line vector map where lines represent the same terrain height, correct?
can we download this dataset somewhere?

---

• category_id was changed from Editing to Digitising

[qgib]

Author Name: Alexey T (@Xeenych)

---

Yes, vector lines.
Here is the dataset. 4 Gb zipped.
https://yadi.sk/d/aR605PsV-vrp2A

[qgib]

Author Name: Giovanni Manghi (@gioman)

---

Alexey T wrote:

Yes, vector lines.
Here is the dataset. 4 Gb zipped.
https://yadi.sk/d/aR605PsV-vrp2A

the dataset is split in several "small" shapes. I don't have any issues while editing any of them. Did you merged those shapes in one unique vector?

[qgib]

Author Name: Alexey T (@Xeenych)

---

No, I didn't

[qgib]

Author Name: Alexey T (@Xeenych)

---

Snapping shold be enabled.

[qgib]

Author Name: Alexey T (@Xeenych)

---

Take a look at this video
https://yadi.sk/i/-b6yBfba3W967A

[qgib]

Author Name: Giovanni Manghi (@gioman)

---

Alexey T wrote:

Snapping shold be enabled.

I'm trying with one of those shapes (a 250MB one) with snapping enabled and I don't particular issues to edit on 3.4.4 (but it seems there is a regression on master).

What are the exact steps to follow to replicate the problem?

[qgib]

Author Name: Giovanni Manghi (@gioman)

---

Alexey T wrote:

Take a look at this video
https://yadi.sk/i/-b6yBfba3W967A

sorry seen this clink only after my last comment.

[qgib]

Author Name: Giovanni Manghi (@gioman)

---

Alexey T wrote:

Take a look at this video
https://yadi.sk/i/-b6yBfba3W967A

ok I replicated, it indeed eats up all memory and eventually will crashes.

Did it worked better on 2.18?

---

• priority_id was changed from Normal to High
• crashes_corrupts_data was changed from 0 to 1
• status_id was changed from Feedback to Open

[qgib]

Author Name: Giovanni Manghi (@gioman)

---

• status_id was changed from Open to Feedback

[qgib]

Author Name: Giovanni Manghi (@gioman)

---

Did it worked better on 2.18?

I answer myself: yes. No such issue on 2.18.

---

• status_id was changed from Feedback to Open
• regression was changed from 0 to 1

[qgib]

Author Name: Loïc BARTOLETTI (@lbartoletti)

---

Can you try to enable the option "Settings->Options->Digitizing->Enable snapping on invisible features" and restart QGIS ?

[qgib]

Author Name: Giovanni Manghi (@gioman)

---

Loïc BARTOLETTI wrote:

Can you try to enable the option "Settings->Options->Digitizing->Enable snapping on invisible features" and restart QGIS ?

it does not make any difference.

[qgib]

Author Name: Giovanni Manghi (@gioman)

---

There have been a update of the linspatialindex library in osgeo4w, and now this problem is gone.

---

• resolution was changed from to fixed/implemented
• status_id was changed from Open to Closed

[qgib]

Author Name: Alexey T (@Xeenych)

---

In what version will it be fixed?

[qgib]

Author Name: Giovanni Manghi (@gioman)

---

Alexey T wrote:

In what version will it be fixed?

it is already fixed if you use the osgeo4w installer, if not yo will need to wait for the next build of the standalone installer (not sure if it was generated one in the last hours).

[qgib]

Author Name: Jürgen Fischer (@jef-n)

---

Giovanni Manghi wrote:

it is already fixed if you use the osgeo4w installer, if not yo will need to wait for the next build of the standalone installer (not sure if it was generated one in the last hours).

The standalones are regularly only updated after releases.