Processing/GRASS do not work if Windows regional settings are not set to EN #28065

qgib · 2018-10-28T09:23:00Z

Author Name: Marcin Domański (Marcin Domański)
Original Redmine Issue: 20244
Affected QGIS version: 3.4.0
Redmine category:processing/grass

Hi,

Each time I want run any Grass algorithm fromprocessing toolbox, I have this kind of error:

Traceback (most recent call last):
File "C:/OSGEO4~1/apps/qgis/./python/plugins\processing\algs\grass7\Grass7Algorithm.py", line 411, in processAlgorithm
Grass7Utils.executeGrass(self.commands, feedback, self.outputCommands)
File "C:/OSGEO4~1/apps/qgis/./python/plugins\processing\algs\grass7\Grass7Utils.py", line 369, in executeGrass
for line in iter(proc.stdout.readline, ''):
File "C:\OSGEO4~1\apps\Python37\lib\codecs.py", line 322, in decode
(result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb3 in position 50: invalid start byte

0xb3 is polish ł letter, but I don't know which data are read on this level...

error_processing_grass.jpg (Olivier ATHIMON)
error_processing_grass_witn_another_profile.jpg (Olivier ATHIMON)

Related issue(s): #28428 (duplicates)
Redmine related issue(s): 20608

The text was updated successfully, but these errors were encountered:

qgib · 2018-10-28T20:40:13Z

Author Name: Giovanni Manghi (@gioman)

do you have special chars in the datasources paths or names?

status_id was changed from Open to Feedback
easy_fix was changed from 1 to 0

qgib · 2018-10-29T23:04:13Z

Author Name: Pedro Venâncio (Pedro Venâncio)

Similar error here, on QGIS 3.4:

Traceback (most recent call last):
File "C:/OSGEO4~1/apps/qgis-rel-dev/./python/plugins\processing\algs\grass7\Grass7Algorithm.py", line 411, in processAlgorithm
Grass7Utils.executeGrass(self.commands, feedback, self.outputCommands)
File "C:/OSGEO4~1/apps/qgis-rel-dev/./python/plugins\processing\algs\grass7\Grass7Utils.py", line 372, in executeGrass
for line in iter(proc.stdout.readline, ''):
File "C:\OSGEO4~1\apps\Python37\lib\codecs.py", line 322, in decode
(result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc7 in position 4: invalid continuation byte

Giovanni, data and paths don't have any complex characters, and work well on QGIS 2.18.25.

Cleaning C:\Users\PedroVenancio\AppData\Roaming\QGIS\QGIS3\profiles\default does not solved the problem.

qgib · 2018-10-30T09:16:27Z

Author Name: Giovanni Manghi (@gioman)

priority_id was changed from Normal to High
version was changed from 3.2.3 to 3.4.0
subject was changed from UTF-8 decode error each time when I try to run any Grass algorithm to UTF-8 decode error each time when I try to run any GRASS algorithm
status_id was changed from Feedback to Open
regression was changed from 0 to 1

qgib · 2018-10-30T16:31:07Z

Author Name: Giovanni Manghi (@gioman)

I assume you are using a localized OS, can you test with an OS in English?

status_id was changed from Open to Feedback

qgib · 2018-10-30T22:31:21Z

Author Name: Pedro Venâncio (Pedro Venâncio)

Changing windows regional settings to English (United States) solves the problem!

So, the problem is related to some regional setting(s).

qgib · 2018-10-31T09:31:23Z

Author Name: Giovanni Manghi (@gioman)

subject was changed from UTF-8 decode error each time when I try to run any GRASS algorithm to Processing/GRASS do not work if Windows regional settings are not set to EN
status_id was changed from Feedback to Open

qgib · 2018-11-02T14:58:05Z

Author Name: Cong Ning (Cong Ning)

I' m a chinese. I meet the same problem on QGIS3.4. However I make sure there is no any special chars in path.(no chinese and I also try to use temporary layer)
I change the windows region to US, including system language. But the UI language still shows chinese. I think i don't install EN language package in system.
I also change QGIS locale to US.
Of couse, the prolem exists.

qgib · 2018-11-05T09:43:26Z

Author Name: Pedro Venâncio (Pedro Venâncio)

Some inputs from Nyall about this one:

I had a super-brief look into this one. For anyone's who's investigating a fix, it's something like this:

https://adminswerk.de/python3-unicodedecodeerror-popen/

(But it's not directly that -- if I do the exact same change then I get a lockup).

Hope that helps!
Nyall

http://osgeo-org.1560.x6.nabble.com/QGIS-Developer-Early-3-4-point-release-tp5383869p5384478.html

qgib · 2018-11-05T13:57:07Z

Author Name: Olivier ATHIMON (Olivier ATHIMON)

+Same problem with a french or english windows region for default profile and new profile With QGIS 3.4.1 (standalone or OSGeo4W64 installation) and Windows 7 (and 10), +when i am executing any function GRASS from processing, i have no results and this error message:+

"Traceback (most recent call last):
File "C:/PROGRA~~1/QGIS3~~1.4/apps/qgis/./python/plugins\processing\algs\grass7\Grass7Algorithm.py", line 415, in processAlgorithm
Grass7Utils.executeGrass(self.commands, feedback, self.outputCommands)
File "C:/PROGRA~~1/QGIS3~~1.4/apps/qgis/./python/plugins\processing\algs\grass7\Grass7Utils.py", line 372, in executeGrass
for line in iter(proc.stdout.readline, ''):
File "C:\PROGRA~~1\QGIS3~~1.4\apps\Python37\lib\codecs.py", line 322, in decode
(result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe9 in position 1: invalid continuation byte

Échec d'exécution au bout de 0.34 secondes

Chargement des couches de résultat
Les couches suivantes n'ont pas été générées correctement.

D:/test.tif

Vous pouvez vérifier le Panel de messages du journal dans la fenêtre principale de QGIS pour trouver plus d'informations à propos de l'exécution de l'algorithme."

It's running without problem with QGIS 2.18.25 (OSGeo4W installation) and Windows 7 (and 10)...

13681 was configured as error_processing_grass.jpg
13683 was configured as error_processing_grass_witn_another_profile.jpg

error_processing_grass.jpg (Olivier ATHIMON) - error processing grass for r.latlong with default profile
error_processing_grass_witn_another_profile.jpg (Olivier ATHIMON) - error processing grass for r.basins.fill with new profile

qgib · 2018-11-06T01:56:56Z

Author Name: Cong Ning (Cong Ning)

Well，the problem still exists in QGIS3.4.1. But I found there are no problems in QGIS3.2.3 without locale change.(Default region is China)

qgib · 2018-11-08T11:02:07Z

Author Name: mr twister (mr twister)

Same here with GRASS (Processing works fine though) with 3.4.1 on Windows 7 and de_ch as regional settings:

Starting GRASS GIS...
Traceback (most recent call last):
File "C:/OSGEO41/apps/qgis/./python/plugins\processing\algs\grass7\Grass7Algorithm.py", line 415, in processAlgorithm
Grass7Utils.executeGrass(self.commands, feedback, self.outputCommands)
File "C:/OSGEO41/apps/qgis/./python/plugins\processing\algs\grass7\Grass7Utils.py", line 372, in executeGrass
for line in iter(proc.stdout.readline, ''):
File "C:\OSGEO4~1\apps\Python37\lib\codecs.py", line 322, in decode
(result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf6 in position 81: invalid start byte

After switching OS regional setting to en_us and also QGIS locale to en_us, everything works fine. Probably related to #28165?

qgib · 2018-11-23T17:29:16Z

Author Name: Giovanni Manghi (@gioman)

category_id was changed from GRASS to Processing/GRASS

qgib · 2018-11-24T15:35:48Z

Author Name: Jürgen Fischer (@jef-n)

duplicated was configured as r.viewshed fails in Windows due to unicode #28428

qgib · 2018-11-27T07:37:12Z

Author Name: mr twister (mr twister)

For me, this issue is solved with 3.4.2. Can anybody confirm this?

qgib · 2018-11-27T09:47:19Z

Author Name: Cong Ning (Cong Ning)

Of coure, the issue is solved too in Chinese system with QGIS3.4.2.

qgib · 2018-11-27T09:58:32Z

Author Name: Nyall Dawson (@nyalldawson)

resolution was changed from to fixed/implemented
status_id was changed from Open to Closed

qgib · 2018-11-27T10:13:25Z

Author Name: Pedro Venâncio (Pedro Venâncio)

Fix confirmed also here!

Thanks!

qgib · 2018-12-10T10:01:08Z

Author Name: Pedro Venâncio (Pedro Venâncio)

Can someone with regional settings different from English test this issue again?

I'm getting a similar error, even after this 0c36b90

Traceback (most recent call last):
File "C:/OSGEO4~1/apps/qgis-rel-dev/./python/plugins\processing\algs\grass7\Grass7Algorithm.py", line 413, in processAlgorithm
Grass7Utils.executeGrass(self.commands, feedback, self.outputCommands)
File "C:/OSGEO4~1/apps/qgis-rel-dev/./python/plugins\processing\algs\grass7\Grass7Utils.py", line 375, in executeGrass
for line in iter(proc.stdout.readline, ''):
File "C:\OSGEO4~1\apps\Python37\lib\codecs.py", line 322, in decode
(result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'CP_UTF8' codec can't decode byte 0xc7 in position 4: No mapping for the Unicode character exists in the target code page.

The difference is:

UnicodeDecodeError: 'CP_UTF8' codec can't decode byte 0xc7 in position 4: No mapping for the Unicode character exists in the target code page.

qgib · 2018-12-10T10:18:26Z

Author Name: Pedro Venâncio (Pedro Venâncio)

Ok, the problem is this one, commented in this b39e5a0

qgib · 2019-01-21T22:05:35Z

Author Name: Frédéric Lévesque (Frédéric Lévesque)

Hi, is this the same problem?

I run 3.4.2 on a french canadian windows 10 machine, qgis is made portable with a batch script.

Processing algorithm…
Algorithm 'v.clean' starting…
Input parameters:
{ '-b' : False, '-c' : False, 'GRASS_MIN_AREA_PARAMETER' : 0.0001, 'GRASS_OUTPUT_TYPE_PARAMETER' : 0, 'GRASS_REGION_PARAMETER' : None, 'GRASS_SNAP_TOLERANCE_PARAMETER' : -1, 'GRASS_VECTOR_DSCO' : '', 'GRASS_VECTOR_LCO' : '', 'error' : 'C:/Users/my_username/AppData/Local/Temp/processing_287288bf2b804ee6b24c5552db1bb035/f7dda6a0a1ce48a59c7093e54c901e38/error.gpkg', 'input' : 'C:\\Users\\my_username\\Desktop\\temp\\rmareatest.shp|layername=rmareatest', 'output' : 'C:/Users/my_username/AppData/Local/Temp/processing_287288bf2b804ee6b24c5552db1bb035/5e410c8fe7594c23bf3f92bb2285e722/output.gpkg', 'threshold' : '', 'tool' : [10], 'type' : [4] }

v.in.ogr min_area=0.0001 snap=-1.0 input="C:\Users\my_username\Desktop\temp\rmareatest.shp" layer="rmareatest" output="vector_5c46404173fb23" --overwrite -o
g.region n=5062643.2 s=5048824.38 e=306671.14 w=294370.81
v.clean input=vector_5c46404173fb23 type="area" tool="rmarea" output=outputb4bb433870364941aae38cbb027e68be error=errorb4bb433870364941aae38cbb027e68be --overwrite
v.out.ogr -c type="auto" input="outputb4bb433870364941aae38cbb027e68be" output="C:\Users\my_username\AppData\Local\Temp\processing_287288bf2b804ee6b24c5552db1bb035\5e410c8fe7594c23bf3f92bb2285e722\output.gpkg" format="GPKG" --overwrite
v.out.ogr -c type="auto" input="errorb4bb433870364941aae38cbb027e68be" output="C:\Users\my_username\AppData\Local\Temp\processing_287288bf2b804ee6b24c5552db1bb035\f7dda6a0a1ce48a59c7093e54c901e38\error.gpkg" format="GPKG" --overwrite
Le chemin d'accŠs sp‚cifi‚ est introuvable.
Le chemin d'accŠs sp‚cifi‚ est introuvable.
File "C:\_Cportable\QGIS_3.4.2_x64\qgis\apps\Python37\lib\site.py", line 177
file=sys.stderr)
^
SyntaxError: invalid syntax
Appuyez sur une touche pour continuer...
Traceback (most recent call last):
File "C:\_Cportable\QGIS_3.4.2_x64\qgis/apps/qgis/./python/plugins\processing\algs\grass7\Grass7Algorithm.py", line 413, in processAlgorithm
Grass7Utils.executeGrass(self.commands, feedback, self.outputCommands)
File "C:\_Cportable\QGIS_3.4.2_x64\qgis/apps/qgis/./python/plugins\processing\algs\grass7\Grass7Utils.py", line 411, in executeGrass
startupinfo=si if isWindows() else None
File "C:\_Cportable\QGIS_3.4.2_x64\qgis\apps\Python37\lib\subprocess.py", line 756, in __init__
restore_signals, start_new_session)
File "C:\_Cportable\QGIS_3.4.2_x64\qgis\apps\Python37\lib\subprocess.py", line 1155, in _execute_child
startupinfo)
OSError: [WinError 87] Paramètre incorrect

Execution failed after 0.63 seconds

Loading resulting layers
The following layers were not correctly generated.<ul><li>C:/Users/my_username/AppData/Local/Temp/processing_287288bf2b804ee6b24c5552db1bb035/5e410c8fe7594c23bf3f92bb2285e722/output.gpkg</li><li>C:/Users/my_username/AppData/Local/Temp/processing_287288bf2b804ee6b24c5552db1bb035/f7dda6a0a1ce48a59c7093e54c901e38/error.gpkg</li></ul>You can check the 'Log Messages Panel' in QGIS main window to find more information about the execution of the algorithm.

qgib · 2019-01-22T10:47:38Z

Author Name: Jürgen Fischer (@jef-n)

description was changed from Hi,

Each time I want run any Grass algorithm fromprocessing toolbox, I have this kind of error:
"Traceback (most recent call last):
File "C:/OSGEO41/apps/qgis/./python/plugins\processing\algs\grass7\Grass7Algorithm.py", line 411, in processAlgorithm
Grass7Utils.executeGrass(self.commands, feedback, self.outputCommands)
File "C:/OSGEO41/apps/qgis/./python/plugins\processing\algs\grass7\Grass7Utils.py", line 369, in executeGrass
for line in iter(proc.stdout.readline, ''):
File "C:\OSGEO4~1\apps\Python37\lib\codecs.py", line 322, in decode
(result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb3 in position 50: invalid start byte"

0xb3 is polish ł letter, but I don't know which data are read on this level... to Hi,

Each time I want run any Grass algorithm fromprocessing toolbox, I have this kind of error:

Traceback (most recent call last):
File "C:/OSGEO4~1/apps/qgis/./python/plugins\processing\algs\grass7\Grass7Algorithm.py", line 411, in processAlgorithm
Grass7Utils.executeGrass(self.commands, feedback, self.outputCommands)
File "C:/OSGEO4~1/apps/qgis/./python/plugins\processing\algs\grass7\Grass7Utils.py", line 369, in executeGrass
for line in iter(proc.stdout.readline, ''):
File "C:\OSGEO4~1\apps\Python37\lib\codecs.py", line 322, in decode
(result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb3 in position 50: invalid start byte

0xb3 is polish ł letter, but I don't know which data are read on this level...

qgib closed this as completed Nov 27, 2018

qgib added Bug Either a bug report, or a bug fix. Let's hope for the latter! High Priority GRASS Regression Something which used to work, but doesn't anymore labels May 25, 2019

qgib mentioned this issue May 25, 2019

r.viewshed fails in Windows due to unicode #28428

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Processing/GRASS do not work if Windows regional settings are not set to EN #28065

Processing/GRASS do not work if Windows regional settings are not set to EN #28065

qgib commented Oct 28, 2018 •

edited

qgib commented Oct 28, 2018

qgib commented Oct 29, 2018

qgib commented Oct 30, 2018

qgib commented Oct 30, 2018

qgib commented Oct 30, 2018

qgib commented Oct 31, 2018

qgib commented Nov 2, 2018

qgib commented Nov 5, 2018

qgib commented Nov 5, 2018

qgib commented Nov 6, 2018

qgib commented Nov 8, 2018 •

edited

qgib commented Nov 23, 2018

qgib commented Nov 24, 2018 •

edited

qgib commented Nov 27, 2018

qgib commented Nov 27, 2018

qgib commented Nov 27, 2018

qgib commented Nov 27, 2018

qgib commented Dec 10, 2018

qgib commented Dec 10, 2018

qgib commented Jan 21, 2019

qgib commented Jan 22, 2019

Processing/GRASS do not work if Windows regional settings are not set to EN #28065

Processing/GRASS do not work if Windows regional settings are not set to EN #28065

Comments

qgib commented Oct 28, 2018 • edited

qgib commented Oct 28, 2018

qgib commented Oct 29, 2018

qgib commented Oct 30, 2018

qgib commented Oct 30, 2018

qgib commented Oct 30, 2018

qgib commented Oct 31, 2018

qgib commented Nov 2, 2018

qgib commented Nov 5, 2018

qgib commented Nov 5, 2018

qgib commented Nov 6, 2018

qgib commented Nov 8, 2018 • edited

qgib commented Nov 23, 2018

qgib commented Nov 24, 2018 • edited

qgib commented Nov 27, 2018

qgib commented Nov 27, 2018

qgib commented Nov 27, 2018

qgib commented Nov 27, 2018

qgib commented Dec 10, 2018

qgib commented Dec 10, 2018

qgib commented Jan 21, 2019

qgib commented Jan 22, 2019

qgib commented Oct 28, 2018 •

edited

qgib commented Nov 8, 2018 •

edited

qgib commented Nov 24, 2018 •

edited