UTF-8 of submit requests wrongly displayed

[jengelh]

Observed behavior

https://build.opensuse.org/request/show/730703

Expected Result

Like osc rdiff -r49:50 devel:languages:perl/perl-Cpanel-JSON-XS|grep --text 10204:

[marcus-h]

On 2019-09-13 08:20:10 -0700, jengelh wrote: Observed behavior ============ https://build.opensuse.org/request/show/730703 

This is most likely a bug in the POST /request/:id?cmd=diff route. For the details, see [1]. [1] openSUSE/osc#633

[hennevogel]

API only passes through diffs, so this might be a problem generating them in the backend.

[mlschroe]

Maybe, maybe not. Try this:

$ osc api '/request/730703?cmd=diff' -X POST
$ osc api '/source/devel:languages:perl/perl-Cpanel-JSON-XS?cmd=diff&expand=1&filelimit=10000&opackage=perl-Cpanel-JSON-XS&oproject=openSUSE%3AFactory&rev=50&tarlimit=10000' -X POST

[mlschroe]

OTOH view=xml does seem to do something wrong in the backend. So I'll add the backend label again but also keep the frontend label...

Both the backend and the frontend seem to trip over the string containing a bad UTF8 char and then doing latin1->utf8 encoding.

[perlpunk]

I tried to reproduce it but failed. This looks like expected:

[perlpunk]

Also tried to insert the wrong text first. Looks also ok:

[perlpunk]

Seems the problem was that the original file encoding was latin1. Reproduced (the other way round) by converting utf8 to latin1: