color distortion with rockchip mpp vp8 hw decoder

[naseebpanghal]

I am using mpp library to decode vp8 data, color distortion starts happening around the static part in the frame and then spread through the whole frame.

H264 part works perfect.
Is there anyone who has seen this kind of behaviour with VP8? Is there any specific setting needs to be done for VP8 in mpp?

[qvoid]

Could you upload the VP8 stream? So we can analyze it.

[naseebpanghal]

chromeEncoded.zip

[qvoid]

The file you provided can't be played by FFmpeg. Maybe it is lack of webm headers.
If you have some problem saving the VP8 stream, you can try the command below before start playing VP8 stream:

setprop mpp_debug 0x200

This will save the input stream providing to mpp under /data. It is named as mpp_dec_in_.bin.

[naseebpanghal]

setprop mpp_debug 0x200
I am sorry, i forgot to mention i am using ubuntu on rk3399 machine for my testing.
what is alternative for setprop on ubuntu? If i can set mpp_debug in mpp library, i can recompile mpp?

i dump encoded data just before feeding to mpp decoder api 'decode_put_packet'. H264 dump gets played using "ffplay chromeEncoded.h264" but webm/vp8 dump doesn't play using "ffplay chromeEncoded.webm" whereas mpp decoder can understand headers but partially, that is why it gives color distorted output.

Code snippet i am using to dump data.
std::ofstream outfile ("chromeEncoded.webm",std::ofstream::app | std::ofstream::out); outfile.write(reinterpret_cast<const char*>(encodedData), size);

encodedData -> pointer to data
size -> size of data.

Do I need to write any webm headers explicitly defore dumping it into file?

[naseebpanghal]

I think, ffmpeg on my machine is not able to understand webm stream. i found below finding
$ ffmpeg -formats | grep webm
D matroska,webm Matroska / WebM
E webm WebM
E webm_chunk WebM Chunk Muxer
DE webm_dash_manifest WebM DASH Manifest

Means default install doesn't provide webm demuxing but only muxing.

[qvoid]

Use cmd :

export mpp_debug=0x200

instead of setprop on Ubuntu.
Sorry, this won't work for VP8 decoding. You may have to add webm header before dumping into files. And the ffmpeg you install is fine with webm demuxing, since D means demux

[naseebpanghal]

There are two more thing to share:

1. Just before feeding stream to mpp decoder, if i redirect to intel decoder(another machine), there same stream works perfect.
2. If i use software decoder on rk3399 then also it works perfect. Color distortion happens with mpp.
   Seems like those decoder store information internally which mpp decoder expects with each frame or at regular interval.

As you suggested, I will try to dump data into file with webm headers.

[naseebpanghal]

2. Seems like those decoder store information internally which mpp decoder expects with each frame or at regular interval.

I have faced similar kind of issue with H264 mpp decoder.
I have some H264 encoders which send SPS/PPS only once just before first IDR, hence i parsed h264 stream and fed SPS/PPS to mpp decoder before every IDR frame. If i feed stream as it is, mpp decoder was giving some issue(there isssue was different than color distotion. i don't remember exactly, if you need i can recheck).

[naseebpanghal]

@qvoid i have dumped the vp8 stream into proper webm file using ffmpeg av_write_frame().
ffplay/vlc are able to play this file properly without any color distortion, but mpp_decoder shows color distortion.
Note:

1. just not lead to any confusion, i have dumped data into this file just before feeding to mpp_decoder. So ffplay/vlc or mpp_decoder gets same data. mpp_decoder distort color but other decoder doesn't.
2. I have noticed one more thing, when keyframe is received by mpp_decoder, colors are perfect in decoded frame but again distortion starts with subsequent frames till next keyframe and so on.

dump.zip

[qvoid]

I test the webm file you provided on my RK3328 board. The decoder works normally.
Try to feed MPP VP8 decoder with complete one frame of data each time, since MPP VP8 decoder expects that each packet is a complete frame.

[naseebpanghal]

Try to feed MPP VP8 decoder with complete one frame of data each time, since MPP VP8 decoder expects that each packet is a complete frame.

Thanks for your prompt response.
I feed data as you suggest.

I checked it on my another board. i.e RK3288. Thankfully there VP8 works normal way.
when i compared mpp version on my both the boards, i found:
RK3399: color distortion
mpi: mpp version: 0b701fe author: Lawrence-Tang DEBIAN: prepare for release_20171218-3
RK3288: color normal
mpi: mpp version: 598cae3 author: Jacob Chen DEBIAN: update rules for release_20171218-2

Now i am trying to get same version as RK3288 on RK3399 and hope it should work there.

[naseebpanghal]

i have used same mpp version 451ae59 on both the boards but RK3399 still giving color distortion and RK3288 working fine.

1. i have checked my application thoroughly, there is no path deviation in 32-bit or 64-bit compilation.
2. Now userspace librockchip_mpp.so library is same as well. I have replaced librockchip_vpu.so as well with my compiled version for commit 451ae59

Please can someone shed some light what can be the reason.

1. can it be kernel space issue?
2. Is there any other library needs to be replaced apart from librockchip_mpp.so and librockchip_vpu.so?

@qvoid , please try, webm file i shared, on RK3399 board as well if possible.

[qvoid]

Sorry for doing this test late.
I do test is on My RK3399 Android 9.0 board. Things work fine.
If the mpp library and player applications are the same between your RK3399 board and RK3288 board. Maybe it is the kernel space issue. You can try to compare files under kerne/drive/video/rockchip/vcodec.

[naseebpanghal]

Sorry for doing this test late.
I do test is on My RK3399 Android 9.0 board. Things work fine.

Thanks for doing the test.
At least i am relaxed as issue is not related to hardware.
i will focus on kernel side now to identify the root cause.

[naseebpanghal]

I do test is on My RK3399 Android 9.0 board. Things work fine.

@qvoid , may i know which player you used to play webm file on Android RK3399?