Run compiled AlexNet on VP #21

prasshantg · 2018-02-07T05:19:50Z

Instanced from #9 for AlexNet failure

JunningWu · 2018-02-09T07:31:15Z

Here, I update some Bug infomations.
when I run the compiled AlexNet with jpg or pgm image, the results are different.
CPU RAM size is 1GB.

https://github.com/JunningWu/AIChip/blob/nvdla_sw_vp_log/run_with_jpg
https://github.com/JunningWu/AIChip/blob/nvdla_sw_vp_log/run_with_pgm

Run with jpg: "unhandled level 3 translation fault" at the very begaining.
Run with pgm: "rcu_preempt self-detected stall on CPU"

I am working on it, hoping for more help.

prasshantg · 2018-02-09T12:49:23Z

Which AlexNet? Generated using NVDLA compiler?

JunningWu · 2018-02-12T02:21:29Z

@prasshantg compiled using the Caffe model and prototxt file from Model Zoo: https://github.com/BVLC/caffe/wiki/Model-Zoo#pascal-voc-2012-multilabel-classification-model

prasshantg · 2018-02-12T04:50:21Z

@JunningWu input image dimensions has to be 227x227x3 irrespective if it is .pgm or .jpg.

prasshantg · 2018-03-05T12:29:27Z

@JunningWu do you still observe any error?

yirs2001 · 2018-03-06T07:09:09Z

For 7 hours pass, it didn't finish.
The Alexnet caffe model is coming from model zoo.
And it is based on 5 Mar release.
The following is log:

./nvdla_runtime --loadable alexnet.nvdla --image 227x227.jpg

creating new runtime context...
Emulator starting
surface format: 46
dlaimg height: 227 x 227 x 3: LS: 704 SS: 0 Size: 159808
submitting tasks...
[ 6079.237142] Enter:dla_read_network_config
[ 6079.237536] Exit:dla_read_network_config status=0
[ 6079.237709] Enter: dla_initiate_processors
[ 6079.237956] Enter: dla_submit_operation
[ 6079.238108] Prepare Convolution operation index 0 ROI 0 dep_count 1
[ 6079.239516] Enter: dla_prepare_operation
[ 6079.239782] processor:Convolution group:0, rdma_group:0 available
[ 6079.240009] Enter: dla_read_config
[ 6079.241776] Exit: dla_read_config
[ 6079.241909] Exit: dla_prepare_operation status=0
[ 6079.242084] Enter: dla_program_operation
[ 6079.242231] Program Convolution operation index 0 ROI 0 Group[0]
[ 6079.244667] no desc get due to index==-1
[ 6079.245014] no desc get due to index==-1
[ 6079.245165] no desc get due to index==-1
[ 6079.245310] no desc get due to index==-1
[ 6079.245453] no desc get due to index==-1
[ 6079.245604] Enter: dla_op_programmed
[ 6079.245759] Update dependency operation index 1 ROI 0 DEP_COUNT=1
[ 6079.245969] enable SDP in dla_update_dependency as depdency are resolved
[ 6079.246191] Enter: dla_enable_operation
[ 6079.247470] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[ 6079.247833] Exit: dla_enable_operation status=0
[ 6079.247993] Exit: dla_op_programmed
[ 6079.248144] Exit: dla_program_operation status=0
[ 6079.248314] Exit: dla_submit_operation
[ 6079.248463] Enter: dla_dequeue_operation
[ 6079.248632] Dequeue op from Convolution processor, index=2 ROI=0
[ 6079.248851] Enter: dla_submit_operation
[ 6079.248992] Prepare Convolution operation index 2 ROI 0 dep_count 2
[ 6079.249216] Enter: dla_prepare_operation
[ 6079.249410] processor:Convolution group:1, rdma_group:0 available
[ 6079.249631] Enter: dla_read_config
[ 6079.251497] Exit: dla_read_config
[ 6079.253473] Exit: dla_prepare_operation status=0
[ 6079.253641] Enter: dla_program_operation
[ 6079.253790] Program Convolution operation index 2 ROI 0 Group[1]
[ 6079.255183] no desc get due to index==-1
[ 6079.256323] no desc get due to index==-1
[ 6079.256485] no desc get due to index==-1
[ 6079.256642] no desc get due to index==-1
[ 6079.256797] no desc get due to index==-1
[ 6079.256942] Enter: dla_op_programmed
[ 6079.257080] Update dependency operation index 3 ROI 0 DEP_COUNT=2
[ 6079.257286] Exit: dla_op_programmed
[ 6079.257418] Exit: dla_program_operation status=0
[ 6079.257590] Exit: dla_submit_operation
[ 6079.257726] Exit: dla_dequeue_operation
[ 6079.257887] Enter: dla_submit_operation
[ 6079.258048] Prepare SDP operation index 1 ROI 0 dep_count 0
[ 6079.258233] Enter: dla_prepare_operation
[ 6079.260075] processor:SDP group:0, rdma_group:0 available
[ 6079.260284] Enter: dla_read_config
[ 6079.262065] Exit: dla_read_config
[ 6079.262199] Exit: dla_prepare_operation status=0
[ 6079.263141] Enter: dla_program_operation
[ 6079.263317] Program SDP operation index 1 ROI 0 Group[0]
[ 6079.264099] no desc get due to index==-1
[ 6079.264246] no desc get due to index==-1
[ 6079.264398] no desc get due to index==-1
[ 6079.264551] no desc get due to index==-1
[ 6079.264711] no desc get due to index==-1
[ 6079.264863] Enter: dla_op_programmed
[ 6079.265002] Exit: dla_op_programmed
[ 6079.265139] Exit: dla_program_operation status=0
[ 6079.265308] Enter: dla_enable_operation
[ 6079.265456] Enable SDP operation index 1 ROI 0
[ 6079.265693] Enter: dla_op_enabled
[ 6079.265839] Update dependency operation index 0 ROI 0 DEP_COUNT=1
[ 6079.266058] enable Convolution in dla_update_dependency as depdency are resolved
[ 6079.267966] Enter: dla_enable_operation
[ 6079.268138] Enable Convolution operation index 0 ROI 0
[ 6079.268969] Enter: dla_op_enabled
[ 6079.269109] Exit: dla_op_enabled
[ 6079.269242] Exit: dla_enable_operation status=0
[ 6079.269416] Exit: dla_op_enabled
[ 6079.269549] Exit: dla_enable_operation status=0
[ 6079.269720] Exit: dla_submit_operation
[ 6079.269872] Enter: dla_dequeue_operation
[ 6079.270043] Dequeue op from SDP processor, index=3 ROI=0
[ 6079.270226] Enter: dla_submit_operation
[ 6079.271664] Prepare SDP operation index 3 ROI 0 dep_count 1
[ 6079.271884] Enter: dla_prepare_operation
[ 6079.325370] processor:SDP group:1, rdma_group:1 available
[ 6079.325649] Enter: dla_read_config
[ 6079.344172] Exit: dla_read_config
[ 6079.344357] Exit: dla_prepare_operation status=0
[ 6079.344549] Enter: dla_program_operation
[ 6079.344717] Program SDP operation index 3 ROI 0 Group[1]
[ 6079.351820] no desc get due to index==-1
[ 6079.352009] no desc get due to index==-1
[ 6079.353609] no desc get due to index==-1
[ 6079.353771] no desc get due to index==-1
[ 6079.353942] no desc get due to index==-1
[ 6079.354104] Enter: dla_op_programmed
[ 6079.354251] Exit: dla_op_programmed
[ 6079.355347] Exit: dla_program_operation status=0
[ 6079.355545] Exit: dla_submit_operation
[ 6079.355714] Exit: dla_dequeue_operation
[ 6079.357452] Enter: dla_submit_operation
[ 6079.357601] Prepare PDP operation index 12 ROI 0 dep_count 1
[ 6079.357811] Enter: dla_prepare_operation
[ 6079.358500] processor:PDP group:0, rdma_group:0 available
[ 6079.359662] Enter: dla_read_config
[ 6079.402418] Exit: dla_read_config
[ 6079.402601] Exit: dla_prepare_operation status=0
[ 6079.402804] Enter: dla_program_operation
[ 6079.402971] Program PDP operation index 12 ROI 0 Group[0]
[ 6079.403194] group id 0 rdma id 0
[ 6079.411055] no desc get due to index==-1
[ 6079.413466] no desc get due to index==-1
[ 6079.423818] no desc get due to index==-1
[ 6079.424659] no desc get due to index==-1
[ 6079.424841] no desc get due to index==-1
[ 6079.425011] Enter: dla_op_programmed
[ 6079.425180] Update dependency operation index 19 ROI 0 DEP_COUNT=2
[ 6079.425420] Exit: dla_op_programmed
[ 6079.425589] Exit: dla_program_operation status=0
[ 6079.425771] Exit: dla_submit_operation
[ 6079.425921] Enter: dla_dequeue_operation
[ 6079.426086] Dequeue op from PDP processor, index=19 ROI=0
[ 6079.426283] Enter: dla_submit_operation
[ 6079.427603] Prepare PDP operation index 19 ROI 0 dep_count 1
[ 6079.427821] Enter: dla_prepare_operation
[ 6079.428573] processor:PDP group:1, rdma_group:1 available
[ 6079.428768] Enter: dla_read_config
[ 6638.324370] Exit: dla_read_config
[ 6638.324602] Exit: dla_prepare_operation status=0
[ 6638.324782] Enter: dla_program_operation
[ 6638.324940] Program PDP operation index 19 ROI 0 Group[1]
[ 6638.325154] group id 1 rdma id 1
[ 6638.325930] no desc get due to index==-1
[ 6638.326201] no desc get due to index==-1
[ 6638.328309] no desc get due to index==-1
[ 6638.328523] no desc get due to index==-1
[ 6638.328706] no desc get due to index==-1
[ 6638.328869] Enter: dla_op_programmed
[ 6638.329024] Update dependency operation index 33 ROI 0 DEP_COUNT=2
[ 6638.329238] Exit: dla_op_programmed
[ 6638.329376] Exit: dla_program_operation status=0
[ 6638.329558] Exit: dla_submit_operation
[ 6638.329704] Exit: dla_dequeue_operation
[ 6638.329934] Enter: dla_submit_operation
[ 6638.330084] Prepare CDP operation index 11 ROI 0 dep_count 1
[ 6638.331538] Enter: dla_prepare_operation
[ 6638.352957] processor:CDP group:0, rdma_group:0 available
[ 6638.353901] Enter: dla_read_config
[ 6638.356471] Exit: dla_read_config
[ 6638.356668] Exit: dla_prepare_operation status=0
[ 6638.356886] Enter: dla_program_operation
[ 6638.357054] Program CDP operation index 11 ROI 0 Group[0]
[ 6638.357340] Enter: dla_cdp_program
[ 6638.357420] Enter: processor_cdp_program
[ 6638.366207] Exit: processor_cdp_program
[ 6638.366238] Exit: dla_cdp_program
[ 6638.366491] no desc get due to index==-1
[ 6638.366780] no desc get due to index==-1
[ 6638.366928] no desc get due to index==-1
[ 6638.367190] no desc get due to index==-1
[ 6638.367348] no desc get due to index==-1
[ 6638.367501] Enter: dla_op_programmed
[ 6638.367648] Update dependency operation index 18 ROI 0 DEP_COUNT=2
[ 6638.367875] Exit: dla_op_programmed
[ 6638.368010] Exit: dla_program_operation status=0
[ 6638.368177] Exit: dla_submit_operation
[ 6638.368321] Enter: dla_dequeue_operation
[ 6638.368471] Dequeue op from CDP processor, index=18 ROI=0
[ 6638.368665] Enter: dla_submit_operation
[ 6638.368813] Prepare CDP operation index 18 ROI 0 dep_count 1
[ 6638.369011] Enter: dla_prepare_operation
[ 6638.369200] processor:CDP group:1, rdma_group:1 available
[ 6638.369391] Enter: dla_read_config
[ 6638.371306] Exit: dla_read_config
[ 6638.373531] Exit: dla_prepare_operation status=0
[ 6638.373737] Enter: dla_program_operation
[ 6638.373917] Program CDP operation index 18 ROI 0 Group[1]
[ 6638.374161] Enter: dla_cdp_program
[ 6638.374206] Enter: processor_cdp_program
[ 6638.382353] Exit: processor_cdp_program
[ 6638.382583] Exit: dla_cdp_program
[ 6638.382774] no desc get due to index==-1
[ 6638.383072] no desc get due to index==-1
[ 6638.383234] no desc get due to index==-1
[ 6638.383382] no desc get due to index==-1
[ 6638.383527] no desc get due to index==-1
[ 6638.383672] no desc get due to index==-1
[ 6638.383819] Enter: dla_op_programmed
[ 6638.383960] Exit: dla_op_programmed
[ 6638.384101] Exit: dla_program_operation status=0
[ 6638.384273] Exit: dla_submit_operation
[ 6638.384416] Exit: dla_dequeue_operation
[ 6638.384568] Exit: dla_initiate_processors status=0
[ 6638.384743] Enter:dla_handle_events, processor:BDMA
[ 6638.384918] Exit:dla_handle_events, ret:0
[ 6638.385066] Enter:dla_handle_events, processor:Convolution
[ 6638.385256] Handle cdma weight done event, processor Convolution group 0
[ 6638.385483] Handle cdma data done event, processor Convolution group 0
[ 6638.385705] Handle op complete event, processor Convolution group 0
[ 6638.385922] Enter:dla_op_completion processor Convolution group0
[ 6638.386130] Completed Convolution operation index 0 ROI 0
[ 6638.386338] Update dependency operation index 2 ROI 0 DEP_COUNT=2
[ 6638.386549] 1 HWLs done, totally 42 layers
[ 6638.386702] Enter: dla_dequeue_operation
[ 6638.386850] Dequeue op from Convolution processor, index=4 ROI=0
[ 6638.387055] Enter: dla_submit_operation
[ 6638.387202] Prepare Convolution operation index 4 ROI 0 dep_count 2
[ 6638.387412] Enter: dla_prepare_operation
[ 6638.387589] processor:Convolution group:0, rdma_group:0 available
[ 6638.387798] Enter: dla_read_config
[ 6638.389618] Exit: dla_read_config
[ 6638.389763] Exit: dla_prepare_operation status=0
[ 6638.389931] Enter: dla_program_operation
[ 6638.390106] Program Convolution operation index 4 ROI 0 Group[0]
[ 6638.391528] no desc get due to index==-1
[ 6638.391782] no desc get due to index==-1
[ 6638.391941] no desc get due to index==-1
[ 6638.392093] no desc get due to index==-1
[ 6638.392246] no desc get due to index==-1
[ 6638.392399] Enter: dla_op_programmed
[ 6638.392549] Update dependency operation index 5 ROI 0 DEP_COUNT=2
[ 6638.392769] Exit: dla_op_programmed
[ 6638.392911] Exit: dla_program_operation status=0
[ 6638.393084] Exit: dla_submit_operation
[ 6638.393240] Exit: dla_dequeue_operation
[ 6638.393388] Exit:dla_op_completion processor Convolution group0 status=0
[ 6638.393613] Exit:dla_handle_events, ret:0
[ 6638.393760] Enter:dla_handle_events, processor:SDP
[ 6638.393931] Handle op complete event, processor SDP group 0
[ 6638.394127] Enter:dla_op_completion processor SDP group0
[ 6638.394312] Completed SDP operation index 1 ROI 0
[ 6638.394483] Update dependency operation index 3 ROI 0 DEP_COUNT=1
[ 6638.394693] enable SDP in dla_update_dependency as depdency are resolved
[ 6638.394916] Enter: dla_enable_operation
[ 6638.395063] Enable SDP operation index 3 ROI 0
[ 6638.395295] Enter: dla_op_enabled
[ 6638.395429] Update dependency operation index 2 ROI 0 DEP_COUNT=1
[ 6638.395639] enable Convolution in dla_update_dependency as depdency are resolved
[ 6638.395894] Enter: dla_enable_operation
[ 6638.396041] Enable Convolution operation index 2 ROI 0
[ 6638.396788] Enter: dla_op_enabled
[ 6638.396921] Exit: dla_op_enabled
[ 6638.397050] Exit: dla_enable_operation status=0
[ 6638.397213] Exit: dla_op_enabled
[ 6638.397353] Exit: dla_enable_operation status=0
[ 6638.397526] 2 HWLs done, totally 42 layers
[ 6638.397689] Enter: dla_free_op_desc op desc index 0 ROI 0
[ 6638.446321] Exit: dla_free_op_desc
[ 6638.446532] Enter: dla_dequeue_operation
[ 6638.446705] Dequeue op from SDP processor, index=5 ROI=0
[ 6638.446913] Enter: dla_submit_operation
[ 6638.447081] Prepare SDP operation index 5 ROI 0 dep_count 1
[ 6638.447294] Enter: dla_prepare_operation
[ 6638.447874] processor:SDP group:0, rdma_group:0 available
[ 6638.448067] Enter: dla_read_config
[ 6638.480722] Exit: dla_read_config
[ 6638.480880] Exit: dla_prepare_operation status=0
[ 6638.481066] Enter: dla_program_operation
[ 6638.481235] Program SDP operation index 5 ROI 0 Group[0]
[ 6638.495109] no desc get due to index==-1
[ 6638.495278] no desc get due to index==-1
[ 6638.496551] no desc get due to index==-1
[ 6638.496717] no desc get due to index==-1
[ 6638.496880] no desc get due to index==-1
[ 6638.497042] Enter: dla_op_programmed
[ 6638.497188] Exit: dla_op_programmed
[ 6638.497326] Exit: dla_program_operation status=0
[ 6638.497492] Exit: dla_submit_operation
[ 6638.497634] Exit: dla_dequeue_operation
[ 6638.497783] Enter: dla_free_op_desc op desc index 1 ROI 0
[ 6638.502012] Exit: dla_free_op_desc
[ 6638.502168] Exit:dla_op_completion processor SDP group0 status=0
[ 6638.502392] Exit:dla_handle_events, ret:0
[ 6638.502567] Enter:dla_handle_events, processor:PDP
[ 6638.502746] Exit:dla_handle_events, ret:0
[ 6638.502912] Enter:dla_handle_events, processor:CDP
[ 6638.503092] Exit:dla_handle_events, ret:0
[ 6638.503239] Enter:dla_handle_events, processor:RUBIK
[ 6638.503413] Exit:dla_handle_events, ret:0
[ 6638.508981] Enter:dla_handle_events, processor:BDMA
[ 6638.509209] Exit:dla_handle_events, ret:0
[ 6638.509372] Enter:dla_handle_events, processor:Convolution
[ 6638.509575] Handle cdma weight done event, processor Convolution group 1
[ 6638.509829] Exit:dla_handle_events, ret:0
[ 6638.510001] Enter:dla_handle_events, processor:SDP
[ 6638.510177] Exit:dla_handle_events, ret:0
[ 6638.510362] Enter:dla_handle_events, processor:PDP
[ 6638.510533] Exit:dla_handle_events, ret:0
[ 6638.510677] Enter:dla_handle_events, processor:CDP
[ 6638.510841] Exit:dla_handle_events, ret:0
[ 6638.510983] Enter:dla_handle_events, processor:RUBIK
[ 6638.511154] Exit:dla_handle_events, ret:0
[ 6638.511433] Enter:dla_handle_events, processor:BDMA
[ 6638.511609] Exit:dla_handle_events, ret:0
[ 6638.511753] Enter:dla_handle_events, processor:Convolution
[ 6638.511939] Exit:dla_handle_events, ret:0
[ 6638.512081] Enter:dla_handle_events, processor:SDP
[ 6638.512246] Exit:dla_handle_events, ret:0
[ 6638.512387] Enter:dla_handle_events, processor:PDP
[ 6638.512556] Exit:dla_handle_events, ret:0
[ 6638.512699] Enter:dla_handle_events, processor:CDP
[ 6638.512865] Exit:dla_handle_events, ret:0
[ 6638.513008] Enter:dla_handle_events, processor:RUBIK
[ 6638.513177] Exit:dla_handle_events, ret:0
[ 7197.372004] Enter:dla_handle_events, processor:BDMA
[ 7197.372270] Exit:dla_handle_events, ret:0
[ 7197.372431] Enter:dla_handle_events, processor:Convolution
[ 7197.372656] Handle cdma data done event, processor Convolution group 1
[ 7197.372896] Handle op complete event, processor Convolution group 1
[ 7197.373122] Enter:dla_op_completion processor Convolution group1
[ 7197.373336] Completed Convolution operation index 2 ROI 0
[ 7197.373529] Update dependency operation index 4 ROI 0 DEP_COUNT=2
[ 7197.373737] 3 HWLs done, totally 42 layers
[ 7197.373892] Enter: dla_dequeue_operation
[ 7197.374038] Dequeue op from Convolution processor, index=6 ROI=0
[ 7197.374243] Enter: dla_submit_operation
[ 7197.374444] Prepare Convolution operation index 6 ROI 0 dep_count 2
[ 7197.374657] Enter: dla_prepare_operation
[ 7197.374834] processor:Convolution group:1, rdma_group:0 available
[ 7197.375046] Enter: dla_read_config
[ 7197.376820] Exit: dla_read_config
[ 7197.376963] Exit: dla_prepare_operation status=0
[ 7197.377142] Enter: dla_program_operation
[ 7197.377295] Program Convolution operation index 6 ROI 0 Group[1]
[ 7197.378600] no desc get due to index==-1
[ 7197.378853] no desc get due to index==-1
[ 7197.379011] no desc get due to index==-1
[ 7197.379164] no desc get due to index==-1
[ 7197.379316] no desc get due to index==-1
[ 7197.379471] Enter: dla_op_programmed
[ 7197.379621] Update dependency operation index 7 ROI 0 DEP_COUNT=2
[ 7197.379841] Exit: dla_op_programmed
[ 7197.379974] Exit: dla_program_operation status=0
[ 7197.380135] Exit: dla_submit_operation
[ 7197.380273] Exit: dla_dequeue_operation
[ 7197.380417] Exit:dla_op_completion processor Convolution group1 status=0
[ 7197.380641] Exit:dla_handle_events, ret:0
[ 7197.380787] Enter:dla_handle_events, processor:SDP
[ 7197.380957] Handle op complete event, processor SDP group 1
[ 7197.381146] Enter:dla_op_completion processor SDP group1
[ 7197.381328] Completed SDP operation index 3 ROI 0
[ 7197.381495] Update dependency operation index 5 ROI 0 DEP_COUNT=1
[ 7197.381722] enable SDP in dla_update_dependency as depdency are resolved
[ 7197.381942] Enter: dla_enable_operation
[ 7197.382083] Enable SDP operation index 5 ROI 0
[ 7197.382311] Enter: dla_op_enabled
[ 7197.382442] Update dependency operation index 4 ROI 0 DEP_COUNT=1
[ 7197.382643] enable Convolution in dla_update_dependency as depdency are resolved
[ 7197.382888] Enter: dla_enable_operation
[ 7197.383030] Enable Convolution operation index 4 ROI 0
[ 7197.383729] Enter: dla_op_enabled
[ 7197.383871] Exit: dla_op_enabled
[ 7197.384006] Exit: dla_enable_operation status=0
[ 7197.384180] Exit: dla_op_enabled
[ 7197.384317] Exit: dla_enable_operation status=0
[ 7197.384493] 4 HWLs done, totally 42 layers
[ 7197.384661] Enter: dla_free_op_desc op desc index 2 ROI 0
[ 7197.434916] Exit: dla_free_op_desc
[ 7197.435125] Enter: dla_dequeue_operation
[ 7197.435285] Dequeue op from SDP processor, index=7 ROI=0
[ 7197.435494] Enter: dla_submit_operation
[ 7197.435654] Prepare SDP operation index 7 ROI 0 dep_count 1
[ 7197.435874] Enter: dla_prepare_operation
[ 7197.436354] processor:SDP group:1, rdma_group:1 available
[ 7197.436562] Enter: dla_read_config
[ 7197.449373] Exit: dla_read_config
[ 7197.449524] Exit: dla_prepare_operation status=0
[ 7197.449704] Enter: dla_program_operation
[ 7197.449868] Program SDP operation index 7 ROI 0 Group[1]
[ 7197.461563] no desc get due to index==-1
[ 7197.461738] no desc get due to index==-1
[ 7197.462566] no desc get due to index==-1
[ 7197.462726] no desc get due to index==-1
[ 7197.462882] no desc get due to index==-1
[ 7197.463039] Enter: dla_op_programmed
[ 7197.463186] Exit: dla_op_programmed
[ 7197.463330] Exit: dla_program_operation status=0
[ 7197.463504] Exit: dla_submit_operation
[ 7197.463658] Exit: dla_dequeue_operation
[ 7197.463814] Enter: dla_free_op_desc op desc index 3 ROI 0
[ 7197.464694] Exit: dla_free_op_desc
[ 7197.464840] Exit:dla_op_completion processor SDP group1 status=0
[ 7197.465060] Exit:dla_handle_events, ret:0
[ 7197.465217] Enter:dla_handle_events, processor:PDP
[ 7197.465402] Exit:dla_handle_events, ret:0
[ 7197.465558] Enter:dla_handle_events, processor:CDP
[ 7197.465739] Exit:dla_handle_events, ret:0
[ 7197.465896] Enter:dla_handle_events, processor:RUBIK
[ 7197.466083] Exit:dla_handle_events, ret:0
[ 7197.494961] Enter:dla_handle_events, processor:BDMA
[ 7197.495203] Exit:dla_handle_events, ret:0
[ 7197.495365] Enter:dla_handle_events, processor:Convolution
[ 7197.495570] Handle cdma weight done event, processor Convolution group 0
[ 7197.495820] Exit:dla_handle_events, ret:0
[ 7197.495990] Enter:dla_handle_events, processor:SDP
[ 7197.496164] Exit:dla_handle_events, ret:0
[ 7197.496309] Enter:dla_handle_events, processor:PDP
[ 7197.496476] Exit:dla_handle_events, ret:0
[ 7197.496623] Enter:dla_handle_events, processor:CDP
[ 7197.496791] Exit:dla_handle_events, ret:0
[ 7197.496936] Enter:dla_handle_events, processor:RUBIK
[ 7197.497105] Exit:dla_handle_events, ret:0
[ 7756.142060] Enter:dla_handle_events, processor:BDMA
[ 7756.142349] Exit:dla_handle_events, ret:0
[ 7756.142515] Enter:dla_handle_events, processor:Convolution
[ 7756.142721] Handle cdma data done event, processor Convolution group 0
[ 7756.142956] Handle op complete event, processor Convolution group 0
[ 7756.143184] Enter:dla_op_completion processor Convolution group0
[ 7756.143405] Completed Convolution operation index 4 ROI 0
[ 7756.143602] Update dependency operation index 6 ROI 0 DEP_COUNT=2
[ 7756.143808] 5 HWLs done, totally 42 layers
[ 7756.143963] Enter: dla_dequeue_operation
[ 7756.144112] Dequeue op from Convolution processor, index=8 ROI=0
[ 7756.144320] Enter: dla_submit_operation
[ 7756.144467] Prepare Convolution operation index 8 ROI 0 dep_count 2
[ 7756.144707] Enter: dla_prepare_operation
[ 7756.144888] processor:Convolution group:0, rdma_group:0 available
[ 7756.145101] Enter: dla_read_config
[ 7756.146935] Exit: dla_read_config
[ 7756.147084] Exit: dla_prepare_operation status=0
[ 7756.147264] Enter: dla_program_operation
[ 7756.147425] Program Convolution operation index 8 ROI 0 Group[0]
[ 7756.148840] no desc get due to index==-1
[ 7756.148999] no desc get due to index==-1
[ 7756.149151] no desc get due to index==-1
[ 7756.149306] no desc get due to index==-1
[ 7756.149460] no desc get due to index==-1
[ 7756.149619] Enter: dla_op_programmed
[ 7756.149770] Update dependency operation index 13 ROI 0 DEP_COUNT=3
[ 7756.149997] Update dependency operation index 9 ROI 0 DEP_COUNT=2
[ 7756.150223] Exit: dla_op_programmed
[ 7756.150357] Exit: dla_program_operation status=0
[ 7756.150522] Exit: dla_submit_operation
[ 7756.150663] Exit: dla_dequeue_operation
[ 7756.150810] Exit:dla_op_completion processor Convolution group0 status=0
[ 7756.151035] Exit:dla_handle_events, ret:0
[ 7756.151178] Enter:dla_handle_events, processor:SDP
[ 7756.151346] Handle op complete event, processor SDP group 0
[ 7756.151536] Enter:dla_op_completion processor SDP group0
[ 7756.151716] Completed SDP operation index 5 ROI 0
[ 7756.151886] Update dependency operation index 7 ROI 0 DEP_COUNT=1
[ 7756.152089] enable SDP in dla_update_dependency as depdency are resolved
[ 7756.152330] Enter: dla_enable_operation
[ 7756.152471] Enable SDP operation index 7 ROI 0
[ 7756.152704] Enter: dla_op_enabled
[ 7756.152835] Update dependency operation index 6 ROI 0 DEP_COUNT=1
[ 7756.153036] enable Convolution in dla_update_dependency as depdency are resolved
[ 7756.153285] Enter: dla_enable_operation
[ 7756.153426] Enable Convolution operation index 6 ROI 0
[ 7756.154128] Enter: dla_op_enabled
[ 7756.154269] Exit: dla_op_enabled
[ 7756.154405] Exit: dla_enable_operation status=0
[ 7756.154579] Exit: dla_op_enabled
[ 7756.154714] Exit: dla_enable_operation status=0
[ 7756.154892] 6 HWLs done, totally 42 layers
[ 7756.155058] Enter: dla_free_op_desc op desc index 4 ROI 0
[ 7756.204348] Exit: dla_free_op_desc
[ 7756.204555] Enter: dla_dequeue_operation
[ 7756.204707] Dequeue op from SDP processor, index=9 ROI=0
[ 7756.204890] Enter: dla_submit_operation
[ 7756.205033] Prepare SDP operation index 9 ROI 0 dep_count 1
[ 7756.205237] Enter: dla_prepare_operation
[ 7756.205692] processor:SDP group:0, rdma_group:0 available
[ 7756.205883] Enter: dla_read_config
[ 7756.219261] Exit: dla_read_config
[ 7756.219428] Exit: dla_prepare_operation status=0
[ 7756.219614] Enter: dla_program_operation
[ 7756.219784] Program SDP operation index 9 ROI 0 Group[0]
[ 7756.231609] no desc get due to index==-1
[ 7756.231778] no desc get due to index==-1
[ 7756.232610] no desc get due to index==-1
[ 7756.232767] no desc get due to index==-1
[ 7756.232919] no desc get due to index==-1
[ 7756.233072] Enter: dla_op_programmed
[ 7756.233219] Exit: dla_op_programmed
[ 7756.233363] Exit: dla_program_operation status=0
[ 7756.233539] Exit: dla_submit_operation
[ 7756.233690] Exit: dla_dequeue_operation
[ 7756.233848] Enter: dla_free_op_desc op desc index 5 ROI 0
[ 7756.236453] Exit: dla_free_op_desc
[ 7756.236615] Exit:dla_op_completion processor SDP group0 status=0
[ 7756.236839] Exit:dla_handle_events, ret:0
[ 7756.237014] Enter:dla_handle_events, processor:PDP
[ 7756.237205] Exit:dla_handle_events, ret:0
[ 7756.237352] Enter:dla_handle_events, processor:CDP
[ 7756.237525] Exit:dla_handle_events, ret:0
[ 7756.237676] Enter:dla_handle_events, processor:RUBIK
[ 7756.237851] Exit:dla_handle_events, ret:0
[ 7756.246919] Enter:dla_handle_events, processor:BDMA
[ 7756.247159] Exit:dla_handle_events, ret:0
[ 7756.247325] Enter:dla_handle_events, processor:Convolution
[ 7756.247526] Handle cdma weight done event, processor Convolution group 1
[ 7756.247794] Exit:dla_handle_events, ret:0
[ 7756.247972] Enter:dla_handle_events, processor:SDP
[ 7756.248161] Exit:dla_handle_events, ret:0
[ 7756.248315] Enter:dla_handle_events, processor:PDP
[ 7756.248485] Exit:dla_handle_events, ret:0
[ 7756.248641] Enter:dla_handle_events, processor:CDP
[ 7756.248812] Exit:dla_handle_events, ret:0
[ 7756.248960] Enter:dla_handle_events, processor:RUBIK
[ 7756.249137] Exit:dla_handle_events, ret:0
[ 8314.739496] Enter:dla_handle_events, processor:BDMA
[ 8314.739747] Exit:dla_handle_events, ret:0
[ 8314.739888] Enter:dla_handle_events, processor:Convolution
[ 8314.740068] Handle cdma data done event, processor Convolution group 1
[ 8314.740281] Handle op complete event, processor Convolution group 1
[ 8314.740487] Enter:dla_op_completion processor Convolution group1
[ 8314.740723] Completed Convolution operation index 6 ROI 0
[ 8314.740924] Update dependency operation index 8 ROI 0 DEP_COUNT=2
[ 8314.741129] 7 HWLs done, totally 42 layers
[ 8314.741283] Enter: dla_dequeue_operation
[ 8314.741432] Dequeue op from Convolution processor, index=13 ROI=0
[ 8314.741654] Enter: dla_submit_operation
[ 8314.741797] Prepare Convolution operation index 13 ROI 0 dep_count 2
[ 8314.742001] Enter: dla_prepare_operation
[ 8314.742194] processor:Convolution group:1, rdma_group:0 available
[ 8314.742476] Enter: dla_read_config
[ 8314.744427] Exit: dla_read_config
[ 8314.744589] Exit: dla_prepare_operation status=0
[ 8314.744769] Enter: dla_program_operation
[ 8314.744928] Program Convolution operation index 13 ROI 0 Group[1]
[ 8314.746312] no desc get due to index==-1
[ 8314.746645] no desc get due to index==-1
[ 8314.746803] no desc get due to index==-1
[ 8314.746958] no desc get due to index==-1
[ 8314.747111] no desc get due to index==-1
[ 8314.747265] Enter: dla_op_programmed
[ 8314.747417] Update dependency operation index 14 ROI 0 DEP_COUNT=2
[ 8314.747641] Exit: dla_op_programmed
[ 8314.747785] Exit: dla_program_operation status=0
[ 8314.747954] Exit: dla_submit_operation
[ 8314.748097] Exit: dla_dequeue_operation
[ 8314.748246] Exit:dla_op_completion processor Convolution group1 status=0
[ 8314.748473] Exit:dla_handle_events, ret:0
[ 8314.748628] Enter:dla_handle_events, processor:SDP
[ 8314.748798] Handle op complete event, processor SDP group 1
[ 8314.748993] Enter:dla_op_completion processor SDP group1
[ 8314.749181] Completed SDP operation index 7 ROI 0
[ 8314.749352] Update dependency operation index 9 ROI 0 DEP_COUNT=1
[ 8314.749562] enable SDP in dla_update_dependency as depdency are resolved
[ 8314.749786] Enter: dla_enable_operation
[ 8314.749934] Enable SDP operation index 9 ROI 0
[ 8314.750166] Enter: dla_op_enabled
[ 8314.750300] Update dependency operation index 8 ROI 0 DEP_COUNT=1
[ 8314.750510] enable Convolution in dla_update_dependency as depdency are resolved
[ 8314.750766] Enter: dla_enable_operation
[ 8314.750912] Enable Convolution operation index 8 ROI 0
[ 8314.751637] Enter: dla_op_enabled
[ 8314.751789] Exit: dla_op_enabled
[ 8314.751923] Exit: dla_enable_operation status=0
[ 8314.752096] Exit: dla_op_enabled
[ 8314.752231] Exit: dla_enable_operation status=0
[ 8314.752405] 8 HWLs done, totally 42 layers
[ 8314.752573] Enter: dla_free_op_desc op desc index 6 ROI 0
[ 8314.790598] Exit: dla_free_op_desc
[ 8314.790799] Enter: dla_dequeue_operation
[ 8314.790968] Dequeue op from SDP processor, index=10 ROI=0
[ 8314.791173] Enter: dla_submit_operation
[ 8314.791337] Prepare SDP operation index 10 ROI 0 dep_count 1
[ 8314.791544] Enter: dla_prepare_operation
[ 8314.792101] processor:SDP group:1, rdma_group:1 available
[ 8314.792304] Enter: dla_read_config
[ 8314.808819] Exit: dla_read_config
[ 8314.808970] Exit: dla_prepare_operation status=0
[ 8314.809151] Enter: dla_program_operation
[ 8314.809316] Program SDP operation index 10 ROI 0 Group[1]
[ 8314.813202] no desc get due to index==-1
[ 8314.813370] no desc get due to index==-1
[ 8314.813529] no desc get due to index==-1
[ 8314.813690] no desc get due to index==-1
[ 8314.813850] no desc get due to index==-1
[ 8314.814005] Enter: dla_op_programmed
[ 8314.814152] Update dependency operation index 14 ROI 0 DEP_COUNT=1
[ 8314.814379] enable SDP in dla_update_dependency as depdency are resolved
[ 8314.814617] Enter: dla_enable_operation
[ 8314.814772] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[ 8314.815069] Exit: dla_enable_operation status=0
[ 8314.815230] Exit: dla_op_programmed
[ 8314.815362] Exit: dla_program_operation status=0
[ 8314.815524] Exit: dla_submit_operation
[ 8314.815665] Exit: dla_dequeue_operation
[ 8314.815809] Enter: dla_free_op_desc op desc index 7 ROI 0
[ 8314.816873] Exit: dla_free_op_desc
[ 8314.817021] Exit:dla_op_completion processor SDP group1 status=0
[ 8314.817240] Exit:dla_handle_events, ret:0
[ 8314.817398] Enter:dla_handle_events, processor:PDP
[ 8314.817581] Exit:dla_handle_events, ret:0
[ 8314.817739] Enter:dla_handle_events, processor:CDP
[ 8314.817919] Exit:dla_handle_events, ret:0
[ 8314.818064] Enter:dla_handle_events, processor:RUBIK
[ 8314.818236] Exit:dla_handle_events, ret:0
[ 8641.153531] Enter:dla_handle_events, processor:BDMA
[ 8641.153797] Exit:dla_handle_events, ret:0
[ 8641.153950] Enter:dla_handle_events, processor:Convolution
[ 8641.154132] Handle cdma weight done event, processor Convolution group 0
[ 8641.154404] Handle cdma data done event, processor Convolution group 0
[ 8641.154616] Handle op complete event, processor Convolution group 0
[ 8641.154821] Enter:dla_op_completion processor Convolution group0
[ 8641.155018] Completed Convolution operation index 8 ROI 0
[ 8641.155202] 9 HWLs done, totally 42 layers
[ 8641.155349] Enter: dla_dequeue_operation
[ 8641.155492] Dequeue op from Convolution processor, index=15 ROI=0
[ 8641.155692] Enter: dla_submit_operation
[ 8641.155835] Prepare Convolution operation index 15 ROI 0 dep_count 2
[ 8641.156039] Enter: dla_prepare_operation
[ 8641.156236] processor:Convolution group:0, rdma_group:0 available
[ 8641.156450] Enter: dla_read_config
[ 8641.158234] Exit: dla_read_config
[ 8641.158370] Exit: dla_prepare_operation status=0
[ 8641.158535] Enter: dla_program_operation
[ 8641.158682] Program Convolution operation index 15 ROI 0 Group[0]
[ 8641.159982] no desc get due to index==-1
[ 8641.160228] no desc get due to index==-1
[ 8641.160392] no desc get due to index==-1
[ 8641.160553] no desc get due to index==-1
[ 8641.160711] no desc get due to index==-1
[ 8641.160861] Enter: dla_op_programmed
[ 8641.160997] Update dependency operation index 20 ROI 0 DEP_COUNT=3
[ 8641.161202] Update dependency operation index 16 ROI 0 DEP_COUNT=2
[ 8641.161405] Exit: dla_op_programmed
[ 8641.161536] Exit: dla_program_operation status=0
[ 8641.161697] Exit: dla_submit_operation
[ 8641.161837] Exit: dla_dequeue_operation
[ 8641.161982] Exit:dla_op_completion processor Convolution group0 status=0
[ 8641.162204] Exit:dla_handle_events, ret:0
[ 8641.162348] Enter:dla_handle_events, processor:SDP
[ 8641.162518] Handle op complete event, processor SDP group 0
[ 8641.162706] Enter:dla_op_completion processor SDP group0
[ 8641.162890] Completed SDP operation index 9 ROI 0
[ 8641.163056] Update dependency operation index 10 ROI 0 DEP_COUNT=1
[ 8641.163258] enable SDP in dla_update_dependency as depdency are resolved
[ 8641.163476] Enter: dla_enable_operation
[ 8641.163619] Enable SDP operation index 10 ROI 0
[ 8641.163845] Enter: dla_op_enabled
[ 8641.163975] Exit: dla_op_enabled
[ 8641.164100] Exit: dla_enable_operation status=0
[ 8641.164261] 10 HWLs done, totally 42 layers
[ 8641.164415] Enter: dla_free_op_desc op desc index 8 ROI 0
[ 8641.208252] Exit: dla_free_op_desc
[ 8641.208472] Enter: dla_dequeue_operation
[ 8641.208649] Dequeue op from SDP processor, index=14 ROI=0
[ 8641.208852] Enter: dla_submit_operation
[ 8641.209021] Prepare SDP operation index 14 ROI 0 dep_count 0
[ 8641.209227] Enter: dla_prepare_operation
[ 8641.210709] processor:SDP group:0, rdma_group:0 available
[ 8641.210923] Enter: dla_read_config
[ 8641.266622] Exit: dla_read_config
[ 8641.266847] Exit: dla_prepare_operation status=0
[ 8641.267023] Enter: dla_program_operation
[ 8641.267207] Program SDP operation index 14 ROI 0 Group[0]
[ 8641.288142] no desc get due to index==-1
[ 8641.288308] no desc get due to index==-1
[ 8641.288453] no desc get due to index==-1
[ 8641.288629] no desc get due to index==-1
[ 8641.288789] no desc get due to index==-1
[ 8641.288942] Enter: dla_op_programmed
[ 8641.289081] Update dependency operation index 16 ROI 0 DEP_COUNT=1
[ 8641.289289] enable SDP in dla_update_dependency as depdency are resolved
[ 8641.289509] Enter: dla_enable_operation
[ 8641.289652] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[ 8641.289952] Exit: dla_enable_operation status=0
[ 8641.290113] Exit: dla_op_programmed
[ 8641.290244] Exit: dla_program_operation status=0
[ 8641.290407] Enter: dla_enable_operation
[ 8641.290551] Enable SDP operation index 14 ROI 0
[ 8641.292622] Enter: dla_op_enabled
[ 8641.292776] Update dependency operation index 13 ROI 0 DEP_COUNT=2
[ 8641.293001] Exit: dla_op_enabled
[ 8641.293144] Exit: dla_enable_operation status=0
[ 8641.293322] Exit: dla_submit_operation
[ 8641.293478] Exit: dla_dequeue_operation
[ 8641.293633] Enter: dla_free_op_desc op desc index 9 ROI 0
[ 8641.312258] Exit: dla_free_op_desc
[ 8641.312415] Exit:dla_op_completion processor SDP group0 status=0
[ 8641.312635] Exit:dla_handle_events, ret:0
[ 8641.312801] Enter:dla_handle_events, processor:PDP
[ 8641.312989] Exit:dla_handle_events, ret:0
[ 8641.313152] Enter:dla_handle_events, processor:CDP
[ 8641.313333] Exit:dla_handle_events, ret:0
[ 8641.313498] Enter:dla_handle_events, processor:RUBIK
[ 8641.313671] Exit:dla_handle_events, ret:0
[ 8646.049700] Enter:dla_handle_events, processor:BDMA
[ 8646.049963] Exit:dla_handle_events, ret:0
[ 8646.050118] Enter:dla_handle_events, processor:Convolution
[ 8646.050339] Exit:dla_handle_events, ret:0
[ 8646.050526] Enter:dla_handle_events, processor:SDP
[ 8646.050742] Handle op complete event, processor SDP group 1
[ 8646.050939] Enter:dla_op_completion processor SDP group1
[ 8646.051128] Completed SDP operation index 10 ROI 0
[ 8646.051301] Update dependency operation index 11 ROI 0 DEP_COUNT=1
[ 8646.051507] enable CDP in dla_update_dependency as depdency are resolved
[ 8646.051752] Enter: dla_enable_operation
[ 8646.051922] Enable CDP operation index 11 ROI 0
[ 8646.052194] Enter: dla_cdp_enable
[ 8646.052439] Exit: dla_cdp_enable
[ 8646.052618] Enter: dla_op_enabled
[ 8646.052747] Exit: dla_op_enabled
[ 8646.052871] Exit: dla_enable_operation status=0
[ 8646.053034] 11 HWLs done, totally 42 layers
[ 8646.053206] Enter: dla_dequeue_operation
[ 8646.053353] Dequeue op from SDP processor, index=16 ROI=0
[ 8646.053540] Enter: dla_submit_operation
[ 8646.053684] Prepare SDP operation index 16 ROI 0 dep_count 0
[ 8646.053875] Enter: dla_prepare_operation
[ 8646.104105] processor:SDP group:1, rdma_group:1 available
[ 8646.104354] Enter: dla_read_config
[ 8678.844865] Exit: dla_read_config
[ 8678.845120] Exit: dla_prepare_operation status=0
[ 8678.845336] Enter: dla_program_operation
[ 8678.845505] Program SDP operation index 16 ROI 0 Group[1]
[ 8678.846441] no desc get due to index==-1
[ 8678.846608] no desc get due to index==-1
[ 8678.846891] no desc get due to index==-1
[ 8678.847068] no desc get due to index==-1
[ 8678.847231] no desc get due to index==-1
[ 8678.847388] Enter: dla_op_programmed
[ 8678.847542] Exit: dla_op_programmed
[ 8678.847683] Exit: dla_program_operation status=0
[ 8678.847865] Enter: dla_enable_operation
[ 8678.848023] Enable SDP operation index 16 ROI 0
[ 8678.848268] Enter: dla_op_enabled
[ 8678.848405] Update dependency operation index 15 ROI 0 DEP_COUNT=2
[ 8678.848641] Exit: dla_op_enabled
[ 8678.848771] Exit: dla_enable_operation status=0
[ 8678.848942] Exit: dla_submit_operation
[ 8678.849085] Exit: dla_dequeue_operation
[ 8678.849236] Enter: dla_free_op_desc op desc index 10 ROI 0
[ 8678.850173] Exit: dla_free_op_desc
[ 8678.850333] Exit:dla_op_completion processor SDP group1 status=0
[ 8678.850579] Exit:dla_handle_events, ret:0
[ 8678.850752] Enter:dla_handle_events, processor:PDP
[ 8678.850951] Exit:dla_handle_events, ret:0
[ 8678.851129] Enter:dla_handle_events, processor:CDP
[ 8678.851319] Exit:dla_handle_events, ret:0
[ 8678.851474] Enter:dla_handle_events, processor:RUBIK
[ 8678.851661] Exit:dla_handle_events, ret:0
[ 8678.858626] Enter:dla_handle_events, processor:BDMA
[ 8678.858856] Exit:dla_handle_events, ret:0
[ 8678.859037] Enter:dla_handle_events, processor:Convolution
[ 8678.859249] Exit:dla_handle_events, ret:0
[ 8678.859410] Enter:dla_handle_events, processor:SDP
[ 8678.859604] Exit:dla_handle_events, ret:0
[ 8678.859776] Enter:dla_handle_events, processor:PDP
[ 8678.859998] Exit:dla_handle_events, ret:0
[ 8678.860162] Enter:dla_handle_events, processor:CDP
[ 8678.860383] Handle op complete event, processor CDP group 0
[ 8678.860601] Enter:dla_op_completion processor CDP group0
[ 8678.860812] Completed CDP operation index 11 ROI 0
[ 8678.861006] Update dependency operation index 12 ROI 0 DEP_COUNT=1
[ 8678.861212] enable PDP in dla_update_dependency as depdency are resolved
[ 8678.861451] Enter: dla_enable_operation
[ 8678.861615] Enable PDP operation index 12 ROI 0
[ 8678.861801] group id 0 rdma id 0
[ 8678.861991] rdma needed 1
[ 8678.862146] Enter: dla_op_enabled
[ 8678.862327] Exit: dla_op_enabled
[ 8678.862461] Exit: dla_enable_operation status=0
[ 8678.862636] 12 HWLs done, totally 42 layers
[ 8678.862805] Enter: dla_dequeue_operation
[ 8678.862950] exit CDP as there's no further operation
[ 8678.863131] Exit: dla_dequeue_operation
[ 8678.863297] Enter: dla_free_op_desc op desc index 11 ROI 0
[ 8678.914995] Exit: dla_free_op_desc
[ 8678.915202] Exit:dla_op_completion processor CDP group0 status=0
[ 8678.915448] Exit:dla_handle_events, ret:0
[ 8678.915622] Enter:dla_handle_events, processor:RUBIK
[ 8678.915812] Exit:dla_handle_events, ret:0
[ 8685.580270] Enter:dla_handle_events, processor:BDMA
[ 8685.580551] Exit:dla_handle_events, ret:0
[ 8685.580735] Enter:dla_handle_events, processor:Convolution
[ 8685.580956] Exit:dla_handle_events, ret:0
[ 8685.581114] Enter:dla_handle_events, processor:SDP
[ 8685.581328] Exit:dla_handle_events, ret:0
[ 8685.581494] Enter:dla_handle_events, processor:PDP
[ 8685.581670] Handle op complete event, processor PDP group 0
[ 8685.581867] Enter:dla_op_completion processor PDP group0
[ 8685.582079] Completed PDP operation index 12 ROI 0
[ 8685.582273] Update dependency operation index 13 ROI 0 DEP_COUNT=1
[ 8685.582528] enable Convolution in dla_update_dependency as depdency are resolved
[ 8685.582789] Enter: dla_enable_operation
[ 8685.582934] Enable Convolution operation index 13 ROI 0
[ 8685.583352] Enter: dla_op_enabled
[ 8685.583490] Exit: dla_op_enabled
[ 8685.583618] Exit: dla_enable_operation status=0
[ 8685.583788] 13 HWLs done, totally 42 layers
[ 8685.583942] Enter: dla_dequeue_operation
[ 8685.584115] Dequeue op from PDP processor, index=33 ROI=0
[ 8685.584309] Enter: dla_submit_operation
[ 8685.584454] Prepare PDP operation index 33 ROI 0 dep_count 1
[ 8685.584666] Enter: dla_prepare_operation
[ 8685.617603] processor:PDP group:0, rdma_group:0 available
[ 8685.617829] Enter: dla_read_config
[ 8685.640261] Exit: dla_read_config
[ 8685.640417] Exit: dla_prepare_operation status=0
[ 8685.640640] Enter: dla_program_operation
[ 8685.640823] Program PDP operation index 33 ROI 0 Group[0]
[ 8685.641032] group id 0 rdma id 0
[ 8685.645627] no desc get due to index==-1
[ 8685.646583] no desc get due to index==-1
[ 8685.646753] no desc get due to index==-1
[ 8685.646929] no desc get due to index==-1
[ 8685.647093] no desc get due to index==-1
[ 8685.647257] no desc get due to index==-1
[ 8685.647432] Enter: dla_op_programmed
[ 8685.647580] Exit: dla_op_programmed
[ 8685.647730] Exit: dla_program_operation status=0
[ 8685.647917] Exit: dla_submit_operation
[ 8685.648072] Exit: dla_dequeue_operation
[ 8685.648244] Enter: dla_free_op_desc op desc index 12 ROI 0
[ 8685.649300] Exit: dla_free_op_desc
[ 8685.649447] Exit:dla_op_completion processor PDP group0 status=0
[ 8685.649674] Exit:dla_handle_events, ret:0
[ 8685.649840] Enter:dla_handle_events, processor:CDP
[ 8685.650026] Exit:dla_handle_events, ret:0
[ 8685.650181] Enter:dla_handle_events, processor:RUBIK
[ 8685.650393] Exit:dla_handle_events, ret:0
[ 8865.862128] Enter:dla_handle_events, processor:BDMA
[ 8865.862431] Exit:dla_handle_events, ret:0
[ 8865.862601] Enter:dla_handle_events, processor:Convolution
[ 8865.862822] Handle cdma weight done event, processor Convolution group 1
[ 8865.863074] Handle cdma data done event, processor Convolution group 1
[ 8865.863310] Handle op complete event, processor Convolution group 1
[ 8865.863543] Enter:dla_op_completion processor Convolution group1
[ 8865.863765] Completed Convolution operation index 13 ROI 0
[ 8865.863979] Update dependency operation index 15 ROI 0 DEP_COUNT=1
[ 8865.864208] enable Convolution in dla_update_dependency as depdency are resolved
[ 8865.864478] Enter: dla_enable_operation
[ 8865.864648] Enable Convolution operation index 15 ROI 0
[ 8865.865124] Enter: dla_op_enabled
[ 8865.865282] Exit: dla_op_enabled
[ 8865.865437] Exit: dla_enable_operation status=0
[ 8865.865619] 14 HWLs done, totally 42 layers
[ 8865.865801] Enter: dla_dequeue_operation
[ 8865.865965] Dequeue op from Convolution processor, index=20 ROI=0
[ 8865.866207] Enter: dla_submit_operation
[ 8865.866363] Prepare Convolution operation index 20 ROI 0 dep_count 2
[ 8865.866598] Enter: dla_prepare_operation
[ 8865.874924] processor:Convolution group:1, rdma_group:0 available
[ 8865.875157] Enter: dla_read_config
[ 8865.920503] Exit: dla_read_config
[ 8865.920705] Exit: dla_prepare_operation status=0
[ 8865.920926] Enter: dla_program_operation
[ 8865.921107] Program Convolution operation index 20 ROI 0 Group[1]
[ 8865.928881] no desc get due to index==-1
[ 8865.932622] no desc get due to index==-1
[ 8865.932788] no desc get due to index==-1
[ 8865.932959] no desc get due to index==-1
[ 8865.933120] no desc get due to index==-1
[ 8865.933285] Enter: dla_op_programmed
[ 8865.933449] Update dependency operation index 23 ROI 0 DEP_COUNT=3
[ 8865.933680] Update dependency operation index 21 ROI 0 DEP_COUNT=2
[ 8865.933911] Exit: dla_op_programmed
[ 8865.934053] Exit: dla_program_operation status=0
[ 8865.934226] Exit: dla_submit_operation
[ 8865.934368] Exit: dla_dequeue_operation
[ 8865.934529] Exit:dla_op_completion processor Convolution group1 status=0
[ 8865.934769] Exit:dla_handle_events, ret:0
[ 8865.934919] Enter:dla_handle_events, processor:SDP
[ 8865.935101] Handle op complete event, processor SDP group 0
[ 8865.935313] Enter:dla_op_completion processor SDP group0
[ 8865.935512] Completed SDP operation index 14 ROI 0
[ 8865.935685] 15 HWLs done, totally 42 layers
[ 8865.935858] Enter: dla_free_op_desc op desc index 13 ROI 0
[ 8865.936845] Exit: dla_free_op_desc
[ 8865.937022] Enter: dla_dequeue_operation
[ 8865.937185] Dequeue op from SDP processor, index=17 ROI=0
[ 8865.937404] Enter: dla_submit_operation
[ 8865.937577] Prepare SDP operation index 17 ROI 0 dep_count 1
[ 8865.937811] Enter: dla_prepare_operation
[ 8865.938389] processor:SDP group:0, rdma_group:0 available
[ 8865.938589] Enter: dla_read_config
[ 8865.960247] Exit: dla_read_config
[ 8865.960388] Exit: dla_prepare_operation status=0
[ 8865.960575] Enter: dla_program_operation
[ 8865.960723] Program SDP operation index 17 ROI 0 Group[0]
[ 8865.970248] no desc get due to index==-1
[ 8865.970412] no desc get due to index==-1
[ 8865.970561] no desc get due to index==-1
[ 8865.970708] no desc get due to index==-1
[ 8865.970855] no desc get due to index==-1
[ 8865.971001] Enter: dla_op_programmed
[ 8865.971143] Update dependency operation index 21 ROI 0 DEP_COUNT=1
[ 8865.971355] enable SDP in dla_update_dependency as depdency are resolved
[ 8865.971580] Enter: dla_enable_operation
[ 8865.971723] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[ 8865.972024] Exit: dla_enable_operation status=0
[ 8865.972191] Exit: dla_op_programmed
[ 8865.972325] Exit: dla_program_operation status=0
[ 8865.972490] Exit: dla_submit_operation
[ 8865.972635] Exit: dla_dequeue_operation
[ 8865.972784] Enter: dla_free_op_desc op desc index 14 ROI 0
[ 8865.976702] Exit: dla_free_op_desc
[ 8865.976853] Exit:dla_op_completion processor SDP group0 status=0
[ 8865.977063] Exit:dla_handle_events, ret:0
[ 8865.977214] Enter:dla_handle_events, processor:PDP
[ 8865.977386] Exit:dla_handle_events, ret:0
[ 8865.977537] Enter:dla_handle_events, processor:CDP
[ 8865.977711] Exit:dla_handle_events, ret:0
[ 8865.977859] Enter:dla_handle_events, processor:RUBIK
[ 8865.978037] Exit:dla_handle_events, ret:0
[ 9046.193581] Enter:dla_handle_events, processor:BDMA
[ 9046.193852] Exit:dla_handle_events, ret:0
[ 9046.194004] Enter:dla_handle_events, processor:Convolution
[ 9046.194199] Handle cdma weight done event, processor Convolution group 0
[ 9046.194482] Handle cdma data done event, processor Convolution group 0
[ 9046.194706] Handle op complete event, processor Convolution group 0
[ 9046.194928] Enter:dla_op_completion processor Convolution group0
[ 9046.195132] Completed Convolution operation index 15 ROI 0
[ 9046.195325] 16 HWLs done, totally 42 layers
[ 9046.195491] Enter: dla_dequeue_operation
[ 9046.195632] Dequeue op from Convolution processor, index=23 ROI=0
[ 9046.195853] Enter: dla_submit_operation
[ 9046.196009] Prepare Convolution operation index 23 ROI 0 dep_count 2
[ 9046.196223] Enter: dla_prepare_operation
[ 9046.196459] processor:Convolution group:0, rdma_group:0 available
[ 9046.196734] Enter: dla_read_config
[ 9046.199000] Exit: dla_read_config
[ 9046.199146] Exit: dla_prepare_operation status=0
[ 9046.199318] Enter: dla_program_operation
[ 9046.199470] Program Convolution operation index 23 ROI 0 Group[0]
[ 9046.200888] no desc get due to index==-1
[ 9046.201273] no desc get due to index==-1
[ 9046.201448] no desc get due to index==-1
[ 9046.201612] no desc get due to index==-1
[ 9046.201773] no desc get due to index==-1
[ 9046.201928] Enter: dla_op_programmed
[ 9046.202068] Update dependency operation index 24 ROI 0 DEP_COUNT=2
[ 9046.202278] Exit: dla_op_programmed
[ 9046.202413] Exit: dla_program_operation status=0
[ 9046.202580] Exit: dla_submit_operation
[ 9046.202721] Exit: dla_dequeue_operation
[ 9046.202870] Exit:dla_op_completion processor Convolution group0 status=0
[ 9046.203121] Exit:dla_handle_events, ret:0
[ 9046.203289] Enter:dla_handle_events, processor:SDP
[ 9046.203469] Handle op complete event, processor SDP group 1
[ 9046.203668] Enter:dla_op_completion processor SDP group1
[ 9046.203870] Completed SDP operation index 16 ROI 0
[ 9046.204062] Update dependency operation index 17 ROI 0 DEP_COUNT=1
[ 9046.204291] enable SDP in dla_update_dependency as depdency are resolved
[ 9046.204539] Enter: dla_enable_operation
[ 9046.204684] Enable SDP operation index 17 ROI 0
[ 9046.204968] Enter: dla_op_enabled
[ 9046.205124] Exit: dla_op_enabled
[ 9046.205259] Exit: dla_enable_operation status=0
[ 9046.205425] 17 HWLs done, totally 42 layers
[ 9046.205589] Enter: dla_free_op_desc op desc index 15 ROI 0
[ 9046.236497] Exit: dla_free_op_desc
[ 9046.236714] Enter: dla_dequeue_operation
[ 9046.236893] Dequeue op from SDP processor, index=21 ROI=0
[ 9046.237088] Enter: dla_submit_operation
[ 9046.237271] Prepare SDP operation index 21 ROI 0 dep_count 0
[ 9046.237499] Enter: dla_prepare_operation
[ 9046.238878] processor:SDP group:1, rdma_group:1 available
[ 9046.239097] Enter: dla_read_config
[ 9046.294515] Exit: dla_read_config
[ 9046.294747] Exit: dla_prepare_operation status=0
[ 9046.294949] Enter: dla_program_operation
[ 9046.295112] Program SDP operation index 21 ROI 0 Group[1]
[ 9046.315282] no desc get due to index==-1
[ 9046.315458] no desc get due to index==-1
[ 9046.320621] no desc get due to index==-1
[ 9046.320794] no desc get due to index==-1
[ 9046.320977] no desc get due to index==-1
[ 9046.321139] Enter: dla_op_programmed
[ 9046.321311] Exit: dla_op_programmed
[ 9046.321473] Exit: dla_program_operation status=0
[ 9046.321654] Enter: dla_enable_operation
[ 9046.321818] Enable SDP operation index 21 ROI 0
[ 9046.324285] Enter: dla_op_enabled
[ 9046.324431] Update dependency operation index 20 ROI 0 DEP_COUNT=2
[ 9046.324666] Exit: dla_op_enabled
[ 9046.324793] Exit: dla_enable_operation status=0
[ 9046.324974] Exit: dla_submit_operation
[ 9046.325135] Exit: dla_dequeue_operation
[ 9046.325278] Enter: dla_free_op_desc op desc index 16 ROI 0
[ 9046.343677] Exit: dla_free_op_desc
[ 9046.343825] Exit:dla_op_completion processor SDP group1 status=0
[ 9046.344050] Exit:dla_handle_events, ret:0
[ 9046.344197] Enter:dla_handle_events, processor:PDP
[ 9046.344386] Exit:dla_handle_events, ret:0
[ 9046.344558] Enter:dla_handle_events, processor:CDP
[ 9046.344740] Exit:dla_handle_events, ret:0
[ 9046.344896] Enter:dla_handle_events, processor:RUBIK
[ 9046.345090] Exit:dla_handle_events, ret:0
[ 9049.373320] Enter:dla_handle_events, processor:BDMA
[ 9049.373593] Exit:dla_handle_events, ret:0
[ 9049.373771] Enter:dla_handle_events, processor:Convolution
[ 9049.373986] Exit:dla_handle_events, ret:0
[ 9049.374133] Enter:dla_handle_events, processor:SDP
[ 9049.374375] Handle op complete event, processor SDP group 0
[ 9049.374577] Enter:dla_op_completion processor SDP group0
[ 9049.374775] Completed SDP operation index 17 ROI 0
[ 9049.374972] Update dependency operation index 18 ROI 0 DEP_COUNT=1
[ 9049.375201] enable CDP in dla_update_dependency as depdency are resolved
[ 9049.375437] Enter: dla_enable_operation
[ 9049.375580] Enable CDP operation index 18 ROI 0
[ 9049.375801] Enter: dla_cdp_enable
[ 9049.375993] Exit: dla_cdp_enable
[ 9049.376139] Enter: dla_op_enabled
[ 9049.376267] Exit: dla_op_enabled
[ 9049.376392] Exit: dla_enable_operation status=0
[ 9049.376564] 18 HWLs done, totally 42 layers
[ 9049.376719] Enter: dla_dequeue_operation
[ 9049.376866] Dequeue op from SDP processor, index=22 ROI=0
[ 9049.377053] Enter: dla_submit_operation
[ 9049.377198] Prepare SDP operation index 22 ROI 0 dep_count 1
[ 9049.377390] Enter: dla_prepare_operation
[ 9049.402374] processor:SDP group:0, rdma_group:0 available
[ 9049.402577] Enter: dla_read_config
[ 9049.721746] Exit: dla_read_config
[ 9049.721925] Exit: dla_prepare_operation status=0
[ 9049.722129] Enter: dla_program_operation
[ 9049.722295] Program SDP operation index 22 ROI 0 Group[0]
[ 9070.911153] no desc get due to index==-1
[ 9070.911418] no desc get due to index==-1
[ 9070.911591] no desc get due to index==-1
[ 9070.911757] no desc get due to index==-1
[ 9070.911934] no desc get due to index==-1
[ 9070.912106] Enter: dla_op_programmed
[ 9070.912253] Update dependency operation index 24 ROI 0 DEP_COUNT=1
[ 9070.912472] enable SDP in dla_update_dependency as depdency are resolved
[ 9070.912717] Enter: dla_enable_operation
[ 9070.912870] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[ 9070.913188] Exit: dla_enable_operation status=0
[ 9070.913372] Exit: dla_op_programmed
[ 9070.913503] Exit: dla_program_operation status=0
[ 9070.913687] Exit: dla_submit_operation
[ 9070.913839] Exit: dla_dequeue_operation
[ 9070.913989] Enter: dla_free_op_desc op desc index 17 ROI 0
[ 9070.914549] Exit: dla_free_op_desc
[ 9070.914709] Exit:dla_op_completion processor SDP group0 status=0
[ 9070.914930] Exit:dla_handle_events, ret:0
[ 9070.915081] Enter:dla_handle_events, processor:PDP
[ 9070.915257] Exit:dla_handle_events, ret:0
[ 9070.915422] Enter:dla_handle_events, processor:CDP
[ 9070.915601] Exit:dla_handle_events, ret:0
[ 9070.915753] Enter:dla_handle_events, processor:RUBIK
[ 9070.915944] Exit:dla_handle_events, ret:0
[ 9070.922563] Enter:dla_handle_events, processor:BDMA
[ 9070.922778] Exit:dla_handle_events, ret:0
[ 9070.922944] Enter:dla_handle_events, processor:Convolution
[ 9070.923152] Exit:dla_handle_events, ret:0
[ 9070.923294] Enter:dla_handle_events, processor:SDP
[ 9070.923482] Exit:dla_handle_events, ret:0
[ 9070.923635] Enter:dla_handle_events, processor:PDP
[ 9070.923809] Exit:dla_handle_events, ret:0
[ 9070.923974] Enter:dla_handle_events, processor:CDP
[ 9070.924150] Handle op complete event, processor CDP group 1
[ 9070.924345] Enter:dla_op_completion processor CDP group1
[ 9070.924537] Completed CDP operation index 18 ROI 0
[ 9070.924722] Update dependency operation index 19 ROI 0 DEP_COUNT=1
[ 9070.924950] enable PDP in dla_update_dependency as depdency are resolved
[ 9070.925186] Enter: dla_enable_operation
[ 9070.925328] Enable PDP operation index 19 ROI 0
[ 9070.925509] group id 1 rdma id 1
[ 9070.925702] rdma needed 1
[ 9070.925865] Enter: dla_op_enabled
[ 9070.926002] Exit: dla_op_enabled
[ 9070.926136] Exit: dla_enable_operation status=0
[ 9070.926326] 19 HWLs done, totally 42 layers
[ 9070.926498] Enter: dla_dequeue_operation
[ 9070.926662] exit CDP as there's no further operation
[ 9070.926835] Exit: dla_dequeue_operation
[ 9070.926997] Enter: dla_free_op_desc op desc index 18 ROI 0
[ 9070.965702] Exit: dla_free_op_desc
[ 9070.965904] Exit:dla_op_completion processor CDP group1 status=0
[ 9070.966139] Exit:dla_handle_events, ret:0
[ 9070.966300] Enter:dla_handle_events, processor:RUBIK
[ 9070.966488] Exit:dla_handle_events, ret:0
[ 9075.213402] Enter:dla_handle_events, processor:BDMA
[ 9075.213681] Exit:dla_handle_events, ret:0
[ 9075.213839] Enter:dla_handle_events, processor:Convolution
[ 9075.214040] Exit:dla_handle_events, ret:0
[ 9075.214195] Enter:dla_handle_events, processor:SDP
[ 9075.214388] Exit:dla_handle_events, ret:0
[ 9075.214554] Enter:dla_handle_events, processor:PDP
[ 9075.214808] Handle op complete event, processor PDP group 1
[ 9075.215029] Enter:dla_op_completion processor PDP group1
[ 9075.215212] Completed PDP operation index 19 ROI 0
[ 9075.215402] Update dependency operation index 20 ROI 0 DEP_COUNT=1
[ 9075.215622] enable Convolution in dla_update_dependency as depdency are resolved
[ 9075.215886] Enter: dla_enable_operation
[ 9075.216025] Enable Convolution operation index 20 ROI 0
[ 9075.216482] Enter: dla_op_enabled
[ 9075.216634] Exit: dla_op_enabled
[ 9075.216764] Exit: dla_enable_operation status=0
[ 9075.216935] 20 HWLs done, totally 42 layers
[ 9075.217093] Enter: dla_dequeue_operation
[ 9075.217240] exit PDP as there's no further operation
[ 9075.217418] Exit: dla_dequeue_operation
[ 9075.217567] Enter: dla_free_op_desc op desc index 19 ROI 0
[ 9075.247941] Exit: dla_free_op_desc
[ 9075.248112] Exit:dla_op_completion processor PDP group1 status=0
[ 9075.248333] Exit:dla_handle_events, ret:0
[ 9075.248493] Enter:dla_handle_events, processor:CDP
[ 9075.248686] Exit:dla_handle_events, ret:0
[ 9075.248843] Enter:dla_handle_events, processor:RUBIK
[ 9075.249031] Exit:dla_handle_events, ret:0
[ 9280.614287] Enter:dla_handle_events, processor:BDMA
[ 9280.614556] Exit:dla_handle_events, ret:0
[ 9280.614715] Enter:dla_handle_events, processor:Convolution
[ 9280.614923] Handle cdma weight done event, processor Convolution group 1
[ 9280.615164] Handle cdma data done event, processor Convolution group 1
[ 9280.615382] Handle op complete event, processor Convolution group 1
[ 9280.615588] Enter:dla_op_completion processor Convolution group1
[ 9280.615789] Completed Convolution operation index 20 ROI 0
[ 9280.615979] 21 HWLs done, totally 42 layers
[ 9280.616129] Enter: dla_dequeue_operation
[ 9280.616272] Dequeue op from Convolution processor, index=25 ROI=0
[ 9280.616473] Enter: dla_submit_operation
[ 9280.616623] Prepare Convolution operation index 25 ROI 0 dep_count 2
[ 9280.616850] Enter: dla_prepare_operation
[ 9280.617068] processor:Convolution group:1, rdma_group:0 available
[ 9280.617280] Enter: dla_read_config
[ 9280.619153] Exit: dla_read_config
[ 9280.619294] Exit: dla_prepare_operation status=0
[ 9280.619461] Enter: dla_program_operation
[ 9280.619611] Program Convolution operation index 25 ROI 0 Group[1]
[ 9280.620989] no desc get due to index==-1
[ 9280.621319] no desc get due to index==-1
[ 9280.621495] no desc get due to index==-1
[ 9280.621656] no desc get due to index==-1
[ 9280.621798] no desc get due to index==-1
[ 9280.621961] Enter: dla_op_programmed
[ 9280.622107] Update dependency operation index 28 ROI 0 DEP_COUNT=3
[ 9280.622336] Update dependency operation index 26 ROI 0 DEP_COUNT=2
[ 9280.622549] Exit: dla_op_programmed
[ 9280.622692] Exit: dla_program_operation status=0
[ 9280.622863] Exit: dla_submit_operation
[ 9280.623009] Exit: dla_dequeue_operation
[ 9280.623166] Exit:dla_op_completion processor Convolution group1 status=0
[ 9280.623404] Exit:dla_handle_events, ret:0
[ 9280.623547] Enter:dla_handle_events, processor:SDP
[ 9280.623727] Handle op complete event, processor SDP group 1
[ 9280.623921] Enter:dla_op_completion processor SDP group1
[ 9280.624119] Completed SDP operation index 21 ROI 0
[ 9280.624290] Update dependency operation index 22 ROI 0 DEP_COUNT=1
[ 9280.624518] enable SDP in dla_update_dependency as depdency are resolved
[ 9280.624765] Enter: dla_enable_operation
[ 9280.624929] Enable SDP operation index 22 ROI 0
[ 9280.625176] Enter: dla_op_enabled
[ 9280.625307] Exit: dla_op_enabled
[ 9280.625451] Exit: dla_enable_operation status=0
[ 9280.625633] 22 HWLs done, totally 42 layers
[ 9280.625786] Enter: dla_free_op_desc op desc index 20 ROI 0
[ 9280.639551] Exit: dla_free_op_desc
[ 9280.639701] Enter: dla_dequeue_operation
[ 9280.639861] Dequeue op from SDP processor, index=24 ROI=0
[ 9280.640057] Enter: dla_submit_operation
[ 9280.640222] Prepare SDP operation index 24 ROI 0 dep_count 0
[ 9280.640434] Enter: dla_prepare_operation
[ 9280.641917] processor:SDP group:1, rdma_group:1 available
[ 9280.642130] Enter: dla_read_config
[ 9280.696448] Exit: dla_read_config
[ 9280.696633] Exit: dla_prepare_operation status=0
[ 9280.696835] Enter: dla_program_operation
[ 9280.697012] Program SDP operation index 24 ROI 0 Group[1]
[ 9280.707881] no desc get due to index==-1
[ 9280.708047] no desc get due to index==-1
[ 9280.708217] no desc get due to index==-1
[ 9280.708383] no desc get due to index==-1
[ 9280.708558] no desc get due to index==-1
[ 9280.708722] Enter: dla_op_programmed
[ 9280.708871] Update dependency operation index 26 ROI 0 DEP_COUNT=1
[ 9280.709092] enable SDP in dla_update_dependency as depdency are resolved
[ 9280.709331] Enter: dla_enable_operation
[ 9280.709484] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[ 9280.709811] Exit: dla_enable_operation status=0
[ 9280.709974] Exit: dla_op_programmed
[ 9280.710109] Exit: dla_program_operation status=0
[ 9280.710275] Enter: dla_enable_operation
[ 9280.710422] Enable SDP operation index 24 ROI 0
[ 9280.711312] Enter: dla_op_enabled
[ 9280.711457] Update dependency operation index 23 ROI 0 DEP_COUNT=2
[ 9280.711686] Exit: dla_op_enabled
[ 9280.711820] Exit: dla_enable_operation status=0
[ 9280.711994] Exit: dla_submit_operation
[ 9280.712143] Exit: dla_dequeue_operation
[ 9280.712301] Enter: dla_free_op_desc op desc index 21 ROI 0
[ 9280.715316] Exit: dla_free_op_desc
[ 9280.715519] Exit:dla_op_completion processor SDP group1 status=0
[ 9280.715744] Exit:dla_handle_events, ret:0
[ 9280.715898] Enter:dla_handle_events, processor:PDP
[ 9280.716076] Exit:dla_handle_events, ret:0
[ 9280.716241] Enter:dla_handle_events, processor:CDP
[ 9280.716418] Exit:dla_handle_events, ret:0
[ 9280.716596] Enter:dla_handle_events, processor:RUBIK
[ 9280.716788] Exit:dla_handle_events, ret:0
[ 9281.750573] Enter:dla_handle_events, processor:BDMA
[ 9281.750840] Exit:dla_handle_events, ret:0
[ 9281.750997] Enter:dla_handle_events, processor:Convolution
[ 9281.751196] Exit:dla_handle_events, ret:0
[ 9281.751353] Enter:dla_handle_events, processor:SDP
[ 9281.751551] Handle op complete event, processor SDP group 0
[ 9281.751761] Enter:dla_op_completion processor SDP group0
[ 9281.751954] Completed SDP operation index 22 ROI 0
[ 9281.752147] Update dependency operation index 23 ROI 0 DEP_COUNT=1
[ 9281.752370] enable Convolution in dla_update_dependency as depdency are resolved
[ 9281.752652] Enter: dla_enable_operation
[ 9281.752807] Enable Convolution operation index 23 ROI 0
[ 9281.753217] Enter: dla_op_enabled
[ 9281.753365] Exit: dla_op_enabled
[ 9281.753489] Exit: dla_enable_operation status=0
[ 9281.753672] 23 HWLs done, totally 42 layers
[ 9281.753845] Enter: dla_dequeue_operation
[ 9281.753992] Dequeue op from SDP processor, index=26 ROI=0
[ 9281.754192] Enter: dla_submit_operation
[ 9281.754377] Prepare SDP operation index 26 ROI 0 dep_count 0
[ 9281.754584] Enter: dla_prepare_operation
[ 9281.775988] processor:SDP group:0, rdma_group:0 available
[ 9281.776181] Enter: dla_read_config
[ 9281.796012] Exit: dla_read_config
[ 9281.796172] Exit: dla_prepare_operation status=0
[ 9281.796358] Enter: dla_program_operation
[ 9281.796515] Program SDP operation index 26 ROI 0 Group[0]
[ 9281.801335] no desc get due to index==-1
[ 9281.801503] no desc get due to index==-1
[ 9281.802399] no desc get due to index==-1
[ 9281.802558] no desc get due to index==-1
[ 9281.802711] no desc get due to index==-1
[ 9281.802865] Enter: dla_op_programmed
[ 9281.803013] Exit: dla_op_programmed
[ 9281.803158] Exit: dla_program_operation status=0
[ 9281.803333] Enter: dla_enable_operation
[ 9281.803500] Enable SDP operation index 26 ROI 0
[ 9281.804066] Enter: dla_op_enabled
[ 9281.804207] Update dependency operation index 25 ROI 0 DEP_COUNT=2
[ 9281.804426] Exit: dla_op_enabled
[ 9281.804567] Exit: dla_enable_operation status=0
[ 9281.804741] Exit: dla_submit_operation
[ 9281.804892] Exit: dla_dequeue_operation
[ 9281.805048] Enter: dla_free_op_desc op desc index 22 ROI 0
[ 9281.806137] Exit: dla_free_op_desc
[ 9281.806280] Exit:dla_op_completion processor SDP group0 status=0
[ 9281.806496] Exit:dla_handle_events, ret:0
[ 9281.806653] Enter:dla_handle_events, processor:PDP
[ 9281.806835] Exit:dla_handle_events, ret:0
[ 9281.806991] Enter:dla_handle_events, processor:CDP
[ 9281.807171] Exit:dla_handle_events, ret:0
[ 9281.807328] Enter:dla_handle_events, processor:RUBIK
[ 9281.807541] Exit:dla_handle_events, ret:0
[ 9356.925045] Enter:dla_handle_events, processor:BDMA
[ 9356.925321] Exit:dla_handle_events, ret:0
[ 9356.925506] Enter:dla_handle_events, processor:Convolution
[ 9356.925730] Handle cdma weight done event, processor Convolution group 0
[ 9356.925991] Handle cdma data done event, processor Convolution group 0
[ 9356.926225] Handle op complete event, processor Convolution group 0
[ 9356.926499] Enter:dla_op_completion processor Convolution group0
[ 9356.926708] Completed Convolution operation index 23 ROI 0
[ 9356.926900] Update dependency operation index 25 ROI 0 DEP_COUNT=1
[ 9356.927112] enable Convolution in dla_update_dependency as depdency are resolved
[ 9356.927367] Enter: dla_enable_operation
[ 9356.927514] Enable Convolution operation index 25 ROI 0
[ 9356.927927] Enter: dla_op_enabled
[ 9356.928059] Exit: dla_op_enabled
[ 9356.928185] Exit: dla_enable_operation status=0
[ 9356.928351] 24 HWLs done, totally 42 layers
[ 9356.928517] Enter: dla_dequeue_operation
[ 9356.928681] Dequeue op from Convolution processor, index=28 ROI=0
[ 9356.928909] Enter: dla_submit_operation
[ 9356.929054] Prepare Convolution operation index 28 ROI 0 dep_count 2
[ 9356.929265] Enter: dla_prepare_operation
[ 9356.937943] processor:Convolution group:0, rdma_group:0 available
[ 9356.938145] Enter: dla_read_config
[ 9356.969988] Exit: dla_read_config
[ 9356.970155] Exit: dla_prepare_operation status=0
[ 9356.970357] Enter: dla_program_operation
[ 9356.970521] Program Convolution operation index 28 ROI 0 Group[0]
[ 9356.971575] Assertion Fail("/home/secondary/OpenDLA/kmd-release/dla-open/kmd/port/linux/../../firmware/conv.c"333):(reg == ((((0UL)))))
[ 9356.971604] Exit: dla_program_operation status=-3
[ 9356.972198] Exit: dla_submit_operation
[ 9356.972351] Exit: dla_dequeue_operation
[ 9356.972506] Exit:dla_op_completion processor Convolution group0 status=-3
[ 9356.972771] Exit:dla_handle_events, ret:fffffffd
[ 9356.972950] Enter:dla_handle_events, processor:SDP
[ 9356.973129] Handle op complete event, processor SDP group 1
[ 9356.973338] Enter:dla_op_completion processor SDP group1
[ 9356.973533] Completed SDP operation index 24 ROI 0
[ 9356.973707] Skip update as engine has reported error
[ 9356.973903] 25 HWLs done, totally 42 layers
[ 9356.974069] Enter: dla_free_op_desc op desc index 23 ROI 0
[ 9356.978669] Exit: dla_free_op_desc
[ 9356.978813] Enter: dla_dequeue_operation
[ 9356.978984] Skip dequeue op as engine has reported error
[ 9356.979190] Exit: dla_dequeue_operation
[ 9356.979364] Enter: dla_free_op_desc op desc index 24 ROI 0
[ 9356.980340] Exit: dla_free_op_desc
[ 9356.980488] Exit:dla_op_completion processor SDP group1 status=0
[ 9356.980710] Exit:dla_handle_events, ret:0
[ 9356.980882] Enter:dla_handle_events, processor:PDP
[ 9356.981067] Exit:dla_handle_events, ret:0
[ 9356.981225] Enter:dla_handle_events, processor:CDP
[ 9356.981407] Exit:dla_handle_events, ret:0
[ 9356.981565] Enter:dla_handle_events, processor:RUBIK
[ 9356.981757] Exit:dla_handle_events, ret:0
[ 9432.118052] Enter:dla_handle_events, processor:BDMA
[ 9432.118327] Exit:dla_handle_events, ret:0
[ 9432.118495] Enter:dla_handle_events, processor:Convolution
[ 9432.118690] Handle cdma weight done event, processor Convolution group 0
[ 9432.118914] Skip update as engine has reported error
[ 9432.119094] Handle cdma data done event, processor Convolution group 0
[ 9432.119314] Skip update as engine has reported error
[ 9432.119494] Handle op complete event, processor Convolution group 0
[ 9432.119704] Enter:dla_op_completion processor Convolution group0
[ 9432.119905] Completed Convolution operation index 28 ROI 0
[ 9432.120090] Skip update as engine has reported error
[ 9432.120261] 26 HWLs done, totally 42 layers
[ 9432.120431] Enter: dla_dequeue_operation
[ 9432.120611] Skip dequeue op as engine has reported error
[ 9432.120799] Exit: dla_dequeue_operation
[ 9432.120941] Exit:dla_op_completion processor Convolution group0 status=0
[ 9432.121159] Handle cdma weight done event, processor Convolution group 1
[ 9432.121372] Skip update as engine has reported error
[ 9432.121541] Handle cdma data done event, processor Convolution group 1
[ 9432.121753] Skip update as engine has reported error
[ 9432.121924] Handle op complete event, processor Convolution group 1
[ 9432.122127] Enter:dla_op_completion processor Convolution group1
[ 9432.122343] Completed Convolution operation index 25 ROI 0
[ 9432.122524] Skip update as engine has reported error
[ 9432.122704] 27 HWLs done, totally 42 layers
[ 9432.122863] Enter: dla_free_op_desc op desc index 28 ROI 0
[ 9432.123635] Exit: dla_free_op_desc
[ 9432.123811] Enter: dla_dequeue_operation
[ 9432.123966] Skip dequeue op as engine has reported error
[ 9432.124160] Exit: dla_dequeue_operation
[ 9432.124315] Exit:dla_op_completion processor Convolution group1 status=0
[ 9432.124559] Exit:dla_handle_events, ret:0
[ 9432.124710] Enter:dla_handle_events, processor:SDP
[ 9432.124885] Handle op complete event, processor SDP group 0
[ 9432.125089] Enter:dla_op_completion processor SDP group0
[ 9432.125291] Completed SDP operation index 26 ROI 0
[ 9432.125465] Skip update as engine has reported error
[ 9432.125652] 28 HWLs done, totally 42 layers
[ 9432.125825] Enter: dla_free_op_desc op desc index 27 ROI 0
[ 9432.126118] Exit: dla_free_op_desc
[ 9432.126268] Enter: dla_free_op_desc op desc index 25 ROI 0
[ 9432.126554] Exit: dla_free_op_desc
[ 9432.126690] Enter: dla_dequeue_operation
[ 9432.126854] Skip dequeue op as engine has reported error
[ 9432.127058] Exit: dla_dequeue_operation
[ 9432.127202] Enter: dla_free_op_desc op desc index 26 ROI 0
[ 9432.127510] Exit: dla_free_op_desc
[ 9432.127655] Exit:dla_op_completion processor SDP group0 status=0
[ 9432.127888] Exit:dla_handle_events, ret:0
[ 9432.128053] Enter:dla_handle_events, processor:PDP
[ 9432.128232] Exit:dla_handle_events, ret:0
[ 9432.128385] Enter:dla_handle_events, processor:CDP
[ 9432.128576] Exit:dla_handle_events, ret:0
[ 9432.128732] Enter:dla_handle_events, processor:RUBIK
[ 9432.128915] Exit:dla_handle_events, ret:0

prasshantg · 2018-03-06T10:51:16Z

@yirs2001 please recheck with latest, one fix was missing.

yirs2001 · 2018-03-07T01:38:43Z

After pull commit 0bf766e (kmd: fix bug in register field value computation), It can run to end (Test pass).
But, couple times of " INFO: rcu_preempt self-detected stall on CPU" happen.

Issue command: ./nvdla_runtime --loadable alexnet.nvdla --image 227x227.jpg
The following is part of log:
[56213.755342] Exit: dla_program_operation status=0
[56213.755551] Enter: dla_enable_operation
[56213.755737] Enable SDP operation index 1 ROI 0
[56213.756029] Enter: dla_op_enabled
[56213.756194] Update dependency operation index 0 ROI 0 DEP_COUNT=1
[56213.756434] enable Convolution in dla_update_dependency as depdency are resolved
[56213.756727] Enter: dla_enable_operation
[56213.756894] Enable Convolution operation index 0 ROI 0
[56213.853675] Enter: dla_op_enabled
[56213.853924] Exit: dla_op_enabled
[56213.854061] Exit: dla_enable_operation status=0
[56213.854257] Exit: dla_op_enabled
[56213.854412] Exit: dla_enable_operation status=0
[56213.854601] Exit: dla_submit_operation
[56213.855837] Enter: dla_dequeue_operation
[56213.856074] Dequeue op from SDP processor, index=3 ROI=0
[56213.856308] Enter: dla_submit_operation
[56213.856480] Prepare SDP operation index 3 ROI 0 dep_count 1
[56213.856710] Enter: dla_prepare_operation
[56214.883220] processor:SDP group:0, rdma_group:0 available
[56214.912056] Enter: dla_read_config
[56747.547944] Exit: dla_read_config
[56747.548204] Exit: dla_prepare_operation status=0
[56747.548403] Enter: dla_program_operation
[56747.548578] Program SDP operation index 3 ROI 0 Group[0]
[56747.549384] no desc get due to index==-1
[56747.549572] no desc get due to index==-1
[56747.549892] no desc get due to index==-1
[56747.550095] no desc get due to index==-1
[56747.550297] no desc get due to index==-1
[56747.550473] Enter: dla_op_programmed
[56747.550623] Exit: dla_op_programmed
[56747.552945] Exit: dla_program_operation status=0
[56747.553198] Exit: dla_submit_operation
[56747.553377] Exit: dla_dequeue_operation
[56747.553678] Enter: dla_submit_operation
[56747.553783] Prepare PDP operation index 12 ROI 0 dep_count 1
[56747.553893] Enter: dla_prepare_operation
[56747.588661] processor:PDP group:1, rdma_group:1 available
[56747.588992] Enter: dla_read_config
[56747.591577] Exit: dla_read_config
[56747.605389] Exit: dla_prepare_operation status=0
[56747.605647] Enter: dla_program_operation
[56747.605835] Program PDP operation index 12 ROI 0 Group[1]
[56747.606068] group id 1 rdma id 1
[56747.608368] no desc get due to index==-1
[56747.608758] no desc get due to index==-1
[56747.609061] no desc get due to index==-1
[56747.609245] no desc get due to index==-1
[56747.609424] no desc get due to index==-1
[56747.609605] Enter: dla_op_programmed
[56747.609779] Update dependency operation index 19 ROI 0 DEP_COUNT=2
[56747.610061] Exit: dla_op_programmed
[56747.610236] Exit: dla_program_operation status=0
[56747.610442] Exit: dla_submit_operation
[56747.610610] Enter: dla_dequeue_operation
[56747.612096] Dequeue op from PDP processor, index=19 ROI=0
[56747.612354] Enter: dla_submit_operation
[56747.612539] Prepare PDP operation index 19 ROI 0 dep_count 1
[56747.612771] Enter: dla_prepare_operation
[56747.613008] processor:PDP group:0, rdma_group:0 available
[56747.613235] Enter: dla_read_config
[56747.615054] Exit: dla_read_config
[56747.616308] Exit: dla_prepare_operation status=0
[56747.616524] Enter: dla_program_operation
[56747.616698] Program PDP operation index 19 ROI 0 Group[0]
[56747.616917] group id 0 rdma id 0
[56747.617770] no desc get due to index==-1
[56747.618068] no desc get due to index==-1
[56747.618385] no desc get due to index==-1
[56747.618577] no desc get due to index==-1
[56747.619872] no desc get due to index==-1
[56747.620073] Enter: dla_op_programmed
[56747.620237] Update dependency operation index 33 ROI 0 DEP_COUNT=2
[56747.620481] Exit: dla_op_programmed
[56747.620638] Exit: dla_program_operation status=0
[56747.620833] Exit: dla_submit_operation
[56747.620996] Exit: dla_dequeue_operation
[56747.621291] Enter: dla_submit_operation
[56747.621466] Prepare CDP operation index 11 ROI 0 dep_count 1
[56747.621694] Enter: dla_prepare_operation
[56747.643191] processor:CDP group:0, rdma_group:0 available
[56747.644880] Enter: dla_read_config
[56747.646560] Exit: dla_read_config
[56747.647407] Exit: dla_prepare_operation status=0
[56747.647643] Enter: dla_program_operation
[56747.647822] Program CDP operation index 11 ROI 0 Group[0]
[56747.659634] Enter: dla_cdp_program
[56747.660030] Enter: processor_cdp_program
[56747.683851] Exit: processor_cdp_program
[56747.683869] Exit: dla_cdp_program
[56747.684078] no desc get due to index==-1
[56747.684420] no desc get due to index==-1
[56747.684603] no desc get due to index==-1
[56747.684909] no desc get due to index==-1
[56747.685092] no desc get due to index==-1
[56747.685270] Enter: dla_op_programmed
[56747.685431] Update dependency operation index 18 ROI 0 DEP_COUNT=2
[56747.685675] Exit: dla_op_programmed
[56747.685833] Exit: dla_program_operation status=0
[56747.686050] Exit: dla_submit_operation
[56747.686218] Enter: dla_dequeue_operation
[56747.686401] Dequeue op from CDP processor, index=18 ROI=0
[56747.686636] Enter: dla_submit_operation
[56747.688717] Prepare CDP operation index 18 ROI 0 dep_count 1
[56747.688961] Enter: dla_prepare_operation
[56747.697237] processor:CDP group:1, rdma_group:1 available
[56747.698353] Enter: dla_read_config
[56747.700709] Exit: dla_read_config
[56747.700933] Exit: dla_prepare_operation status=0
[56747.701145] Enter: dla_program_operation
[56747.701323] Program CDP operation index 18 ROI 0 Group[1]
[56747.701616] Enter: dla_cdp_program
[56747.701667] Enter: processor_cdp_program
[56747.709593] Exit: processor_cdp_program
[56747.709609] Exit: dla_cdp_program
[56747.709810] no desc get due to index==-1
[56747.710125] no desc get due to index==-1
[56747.710313] no desc get due to index==-1
[56747.710483] no desc get due to index==-1
[56747.711549] no desc get due to index==-1
[56747.711745] no desc get due to index==-1
[56747.711914] Enter: dla_op_programmed
[56747.712085] Exit: dla_op_programmed
[56747.712245] Exit: dla_program_operation status=0
[56747.712441] Exit: dla_submit_operation
[56747.712618] Exit: dla_dequeue_operation
[56747.712789] Exit: dla_initiate_processors status=0
[56747.713002] Enter:dla_handle_events, processor:BDMA
[56747.713209] Exit:dla_handle_events, ret:0
[56747.713380] Enter:dla_handle_events, processor:Convolution
[56747.713600] Handle cdma weight done event, processor Convolution group 1
[56747.713859] Handle cdma data done event, processor Convolution group 1
[56747.714131] Handle op complete event, processor Convolution group 1
[56747.714397] Enter:dla_op_completion processor Convolution group1
[56747.714654] Completed Convolution operation index 0 ROI 0
[56747.714884] Update dependency operation index 2 ROI 0 DEP_COUNT=2
[56747.715122] 1 HWLs done, totally 42 layers
[56747.715298] Enter: dla_dequeue_operation
[56747.715469] Dequeue op from Convolution processor, index=4 ROI=0
[56747.715729] Enter: dla_submit_operation
[56747.715911] Prepare Convolution operation index 4 ROI 0 dep_count 2
[56747.716167] Enter: dla_prepare_operation
[56747.716393] processor:Convolution group:1, rdma_group:0 available
[56747.716634] Enter: dla_read_config
[56747.718263] Exit: dla_read_config
[56747.718498] Exit: dla_prepare_operation status=0
[56747.718715] Enter: dla_program_operation
[56747.718895] Program Convolution operation index 4 ROI 0 Group[1]
[56747.720334] no desc get due to index==-1
[56747.720616] no desc get due to index==-1
[56747.720800] no desc get due to index==-1
[56747.720981] no desc get due to index==-1
[56747.721154] no desc get due to index==-1
[56747.721334] Enter: dla_op_programmed
[56747.721499] Update dependency operation index 5 ROI 0 DEP_COUNT=2
[56747.721747] Exit: dla_op_programmed
[56747.721909] Exit: dla_program_operation status=0
[56747.722100] Exit: dla_submit_operation
[56747.722259] Exit: dla_dequeue_operation
[56747.722428] Exit:dla_op_completion processor Convolution group1 status=0
[56747.722686] Exit:dla_handle_events, ret:0
[56747.722856] Enter:dla_handle_events, processor:SDP
[56747.723052] Handle op complete event, processor SDP group 1
[56747.723273] Enter:dla_op_completion processor SDP group1
[56747.723489] Completed SDP operation index 1 ROI 0
[56747.723680] Update dependency operation index 3 ROI 0 DEP_COUNT=1
[56747.723927] enable SDP in dla_update_dependency as depdency are resolved
[56747.724186] Enter: dla_enable_operation
[56747.724356] Enable SDP operation index 3 ROI 0
[56747.724641] Enter: dla_op_enabled
[56747.724796] Update dependency operation index 2 ROI 0 DEP_COUNT=1
[56747.725039] enable Convolution in dla_update_dependency as depdency are resolved
[56747.725336] Enter: dla_enable_operation
[56747.725503] Enable Convolution operation index 2 ROI 0
[56747.726342] Enter: dla_op_enabled
[56747.726494] Exit: dla_op_enabled
[56747.726641] Exit: dla_enable_operation status=0
[56747.726827] Exit: dla_op_enabled
[56747.726984] Exit: dla_enable_operation status=0
[56747.727180] 2 HWLs done, totally 42 layers
[56747.727369] Enter: dla_free_op_desc op desc index 0 ROI 0
[56747.875982] Exit: dla_free_op_desc
[56747.876217] Enter: dla_dequeue_operation
[56747.876396] Dequeue op from SDP processor, index=5 ROI=0
[56747.876624] Enter: dla_submit_operation
[56747.876799] Prepare SDP operation index 5 ROI 0 dep_count 1
[56747.877022] Enter: dla_prepare_operation
[56747.877956] processor:SDP group:1, rdma_group:1 available
[56747.878231] Enter: dla_read_config
[56747.913899] Exit: dla_read_config
[56747.914181] Exit: dla_prepare_operation status=0
[56747.914416] Enter: dla_program_operation
[56747.914623] Program SDP operation index 5 ROI 0 Group[1]
[56747.939734] no desc get due to index==-1
[56747.939965] no desc get due to index==-1
[56747.941401] no desc get due to index==-1
[56747.941590] no desc get due to index==-1
[56747.941753] no desc get due to index==-1
[56747.941925] Enter: dla_op_programmed
[56747.942086] Exit: dla_op_programmed
[56747.942249] Exit: dla_program_operation status=0
[56747.942451] Exit: dla_submit_operation
[56747.942606] Exit: dla_dequeue_operation
[56747.942760] Enter: dla_free_op_desc op desc index 1 ROI 0
[56747.947510] Exit: dla_free_op_desc
[56747.947671] Exit:dla_op_completion processor SDP group1 status=0
[56747.947893] Exit:dla_handle_events, ret:0
[56747.948061] Enter:dla_handle_events, processor:PDP
[56747.948253] Exit:dla_handle_events, ret:0
[56747.948420] Enter:dla_handle_events, processor:CDP
[56747.948607] Exit:dla_handle_events, ret:0
[56747.948770] Enter:dla_handle_events, processor:RUBIK
[56747.948982] Exit:dla_handle_events, ret:0
[56747.959544] Enter:dla_handle_events, processor:BDMA
[56747.959821] Exit:dla_handle_events, ret:0
[56747.959992] Enter:dla_handle_events, processor:Convolution
[56747.960213] Handle cdma weight done event, processor Convolution group 0
[56747.960475] Exit:dla_handle_events, ret:0
[56747.960635] Enter:dla_handle_events, processor:SDP
[56747.960826] Exit:dla_handle_events, ret:0
[56747.960986] Enter:dla_handle_events, processor:PDP
[56747.961183] Exit:dla_handle_events, ret:0
[56747.961352] Enter:dla_handle_events, processor:CDP
[56747.961545] Exit:dla_handle_events, ret:0
[56747.961718] Enter:dla_handle_events, processor:RUBIK
[56747.961913] Exit:dla_handle_events, ret:0
[57275.040486] Enter:dla_handle_events, processor:BDMA
[57275.040827] Exit:dla_handle_events, ret:0
[57275.041095] Enter:dla_handle_events, processor:Convolution
[57275.041390] Handle cdma data done event, processor Convolution group 0
[57275.041744] Handle op complete event, processor Convolution group 0
[57275.042070] Enter:dla_op_completion processor Convolution group0
[57275.042387] Completed Convolution operation index 2 ROI 0
[57275.042694] Update dependency operation index 4 ROI 0 DEP_COUNT=2
[57275.043034] 3 HWLs done, totally 42 layers
[57275.043268] Enter: dla_dequeue_operation
[57275.043487] Dequeue op from Convolution processor, index=6 ROI=0
[57275.043798] Enter: dla_submit_operation
[57275.044016] Prepare Convolution operation index 6 ROI 0 dep_count 2
[57275.044339] Enter: dla_prepare_operation
[57275.044648] processor:Convolution group:0, rdma_group:0 available
[57275.044992] Enter: dla_read_config
[57275.047279] Exit: dla_read_config
[57275.047482] Exit: dla_prepare_operation status=0
[57275.047731] Enter: dla_program_operation
[57275.047958] Program Convolution operation index 6 ROI 0 Group[0]
[57275.049701] no desc get due to index==-1
[57275.050058] no desc get due to index==-1
[57275.050305] no desc get due to index==-1
[57275.050488] no desc get due to index==-1
[57275.050668] no desc get due to index==-1
[57275.050848] Enter: dla_op_programmed
[57275.051017] Update dependency operation index 7 ROI 0 DEP_COUNT=2
[57275.051262] Exit: dla_op_programmed
[57275.051426] Exit: dla_program_operation status=0
[57275.051624] Exit: dla_submit_operation
[57275.051794] Exit: dla_dequeue_operation
[57275.051970] Exit:dla_op_completion processor Convolution group0 status=0
[57275.052230] Exit:dla_handle_events, ret:0
[57275.052402] Enter:dla_handle_events, processor:SDP
[57275.052611] Handle op complete event, processor SDP group 0
[57275.052838] Enter:dla_op_completion processor SDP group0
[57275.053054] Completed SDP operation index 3 ROI 0
[57275.053251] Update dependency operation index 5 ROI 0 DEP_COUNT=1
[57275.053494] enable SDP in dla_update_dependency as depdency are resolved
[57275.053761] Enter: dla_enable_operation
[57275.053930] Enable SDP operation index 5 ROI 0
[57275.054231] Enter: dla_op_enabled
[57275.054386] Update dependency operation index 4 ROI 0 DEP_COUNT=1
[57275.054625] enable Convolution in dla_update_dependency as depdency are resolved
[57275.054918] Enter: dla_enable_operation
[57275.055081] Enable Convolution operation index 4 ROI 0
[57275.056225] Enter: dla_op_enabled
[57275.056405] Exit: dla_op_enabled
[57275.056555] Exit: dla_enable_operation status=0
[57275.056755] Exit: dla_op_enabled
[57275.056910] Exit: dla_enable_operation status=0
[57275.057118] 4 HWLs done, totally 42 layers
[57275.057303] Enter: dla_free_op_desc op desc index 2 ROI 0
[57275.215878] Exit: dla_free_op_desc
[57275.216135] Enter: dla_dequeue_operation
[57275.216373] Dequeue op from SDP processor, index=7 ROI=0
[57275.216600] Enter: dla_submit_operation
[57275.216773] Prepare SDP operation index 7 ROI 0 dep_count 1
[57275.216997] Enter: dla_prepare_operation
[57275.217576] processor:SDP group:0, rdma_group:0 available
[57275.217804] Enter: dla_read_config
[57275.260767] Exit: dla_read_config
[57275.260954] Exit: dla_prepare_operation status=0
[57275.261142] Enter: dla_program_operation
[57275.261310] Program SDP operation index 7 ROI 0 Group[0]
[57275.266737] no desc get due to index==-1
[57275.266932] no desc get due to index==-1
[57275.281582] no desc get due to index==-1
[57275.281826] no desc get due to index==-1
[57275.282004] no desc get due to index==-1
[57275.282182] Enter: dla_op_programmed
[57275.282360] Exit: dla_op_programmed
[57275.282523] Exit: dla_program_operation status=0
[57275.282721] Exit: dla_submit_operation
[57275.282888] Exit: dla_dequeue_operation
[57275.283050] Enter: dla_free_op_desc op desc index 3 ROI 0
[57275.284580] Exit: dla_free_op_desc
[57275.284756] Exit:dla_op_completion processor SDP group0 status=0
[57275.285001] Exit:dla_handle_events, ret:0
[57275.285172] Enter:dla_handle_events, processor:PDP
[57275.285372] Exit:dla_handle_events, ret:0
[57275.285547] Enter:dla_handle_events, processor:CDP
[57275.285740] Exit:dla_handle_events, ret:0
[57275.285912] Enter:dla_handle_events, processor:RUBIK
[57275.286111] Exit:dla_handle_events, ret:0
[57275.297181] Enter:dla_handle_events, processor:BDMA
[57275.297450] Exit:dla_handle_events, ret:0
[57275.297617] Enter:dla_handle_events, processor:Convolution
[57275.297831] Handle cdma weight done event, processor Convolution group 1
[57275.298119] Exit:dla_handle_events, ret:0
[57275.298287] Enter:dla_handle_events, processor:SDP
[57275.298488] Exit:dla_handle_events, ret:0
[57275.298671] Enter:dla_handle_events, processor:PDP
[57275.298874] Exit:dla_handle_events, ret:0
[57275.299036] Enter:dla_handle_events, processor:CDP
[57275.299231] Exit:dla_handle_events, ret:0
[57275.299395] Enter:dla_handle_events, processor:RUBIK
[57275.299597] Exit:dla_handle_events, ret:0
[57803.829012] Enter:dla_handle_events, processor:BDMA
[57803.829329] Exit:dla_handle_events, ret:0
[57803.829522] Enter:dla_handle_events, processor:Convolution
[57803.829765] Handle cdma data done event, processor Convolution group 1
[57803.830034] Handle op complete event, processor Convolution group 1
[57803.830282] Enter:dla_op_completion processor Convolution group1
[57803.830520] Completed Convolution operation index 4 ROI 0
[57803.830782] Update dependency operation index 6 ROI 0 DEP_COUNT=2
[57803.831021] 5 HWLs done, totally 42 layers
[57803.831200] Enter: dla_dequeue_operation
[57803.831369] Dequeue op from Convolution processor, index=8 ROI=0
[57803.831614] Enter: dla_submit_operation
[57803.831782] Prepare Convolution operation index 8 ROI 0 dep_count 2
[57803.832030] Enter: dla_prepare_operation
[57803.832260] processor:Convolution group:1, rdma_group:0 available
[57803.832506] Enter: dla_read_config
[57803.834307] Exit: dla_read_config
[57803.834409] Exit: dla_prepare_operation status=0
[57803.834513] Enter: dla_program_operation
[57803.834607] Program Convolution operation index 8 ROI 0 Group[1]
[57803.835921] no desc get due to index==-1
[57803.836022] no desc get due to index==-1
[57803.836112] no desc get due to index==-1
[57803.836200] no desc get due to index==-1
[57803.836288] no desc get due to index==-1
[57803.836377] Enter: dla_op_programmed
[57803.836465] Update dependency operation index 13 ROI 0 DEP_COUNT=3
[57803.836588] Update dependency operation index 9 ROI 0 DEP_COUNT=2
[57803.836708] Exit: dla_op_programmed
[57803.836793] Exit: dla_program_operation status=0
[57803.836892] Exit: dla_submit_operation
[57803.836980] Exit: dla_dequeue_operation
[57803.837073] Exit:dla_op_completion processor Convolution group1 status=0
[57803.837203] Exit:dla_handle_events, ret:0
[57803.837292] Enter:dla_handle_events, processor:SDP
[57803.837395] Handle op complete event, processor SDP group 1
[57803.837509] Enter:dla_op_completion processor SDP group1
[57803.837619] Completed SDP operation index 5 ROI 0
[57803.837726] Update dependency operation index 7 ROI 0 DEP_COUNT=1
[57803.837837] enable SDP in dla_update_dependency as depdency are resolved
[57803.837954] Enter: dla_enable_operation
[57803.838038] Enable SDP operation index 7 ROI 0
[57803.838331] Enter: dla_op_enabled
[57803.838518] Update dependency operation index 6 ROI 0 DEP_COUNT=1
[57803.838765] enable Convolution in dla_update_dependency as depdency are resolved
[57803.839057] Enter: dla_enable_operation
[57803.839224] Enable Convolution operation index 6 ROI 0
[57803.840035] Enter: dla_op_enabled
[57803.840194] Exit: dla_op_enabled
[57803.840349] Exit: dla_enable_operation status=0
[57803.840540] Exit: dla_op_enabled
[57803.840693] Exit: dla_enable_operation status=0
[57803.840892] 6 HWLs done, totally 42 layers
[57803.841080] Enter: dla_free_op_desc op desc index 4 ROI 0
[57804.019890] Exit: dla_free_op_desc
[57804.020236] Enter: dla_dequeue_operation
[57804.020532] Dequeue op from SDP processor, index=9 ROI=0
[57804.020902] Enter: dla_submit_operation
[57804.021202] Prepare SDP operation index 9 ROI 0 dep_count 1
[57804.021600] Enter: dla_prepare_operation
[57804.022644] processor:SDP group:1, rdma_group:1 available
[57804.023055] Enter: dla_read_config
[57804.077820] Exit: dla_read_config
[57804.078070] Exit: dla_prepare_operation status=0
[57804.078376] Enter: dla_program_operation
[57804.078615] Program SDP operation index 9 ROI 0 Group[1]
[57804.098632] no desc get due to index==-1
[57804.098895] no desc get due to index==-1
[57804.100736] no desc get due to index==-1
[57804.100982] no desc get due to index==-1
[57804.101217] no desc get due to index==-1
[57804.101445] Enter: dla_op_programmed
[57804.101657] Exit: dla_op_programmed
[57804.101861] Exit: dla_program_operation status=0
[57804.102116] Exit: dla_submit_operation
[57804.102348] Exit: dla_dequeue_operation
[57804.102524] Enter: dla_free_op_desc op desc index 5 ROI 0
[57804.107269] Exit: dla_free_op_desc
[57804.107441] Exit:dla_op_completion processor SDP group1 status=0
[57804.107683] Exit:dla_handle_events, ret:0
[57804.107850] Enter:dla_handle_events, processor:PDP
[57804.108040] Exit:dla_handle_events, ret:0
[57804.108203] Enter:dla_handle_events, processor:CDP
[57804.108397] Exit:dla_handle_events, ret:0
[57804.108561] Enter:dla_handle_events, processor:RUBIK
[57804.108769] Exit:dla_handle_events, ret:0
[57804.118438] Enter:dla_handle_events, processor:BDMA
[57804.118766] Exit:dla_handle_events, ret:0
[57804.118969] Enter:dla_handle_events, processor:Convolution
[57804.119189] Handle cdma weight done event, processor Convolution group 0
[57804.119462] Exit:dla_handle_events, ret:0
[57804.119625] Enter:dla_handle_events, processor:SDP
[57804.119821] Exit:dla_handle_events, ret:0
[58330.164742] Enter:dla_handle_events, processor:PDP
[58330.165003] Exit:dla_handle_events, ret:0
[58330.165200] Enter:dla_handle_events, processor:CDP
[58330.165435] Exit:dla_handle_events, ret:0
[58330.165634] Enter:dla_handle_events, processor:RUBIK
[58330.165866] Exit:dla_handle_events, ret:0
[58330.186767] INFO: rcu_preempt self-detected stall on CPU
[58330.240228] 0-...: (1 ticks this GP) idle=b66/140000000000001/0 softirq=9490/9490 fqs=0
[58330.240800] (t=131512 jiffies g=4075 c=4074 q=1)
[58330.250408] rcu_preempt kthread starved for 131512 jiffies! g4075 c4074 f0x0 RCU_GP_WAIT_FQS(3) ->state=0x1
[58330.269831] rcu_preempt S 0 8 2 0x00000000
[58330.270244] Call trace:
[58330.289588] [] __switch_to+0x90/0xb0
[58330.293466] [] __schedule+0x19c/0x5e0
[58330.293877] [] schedule+0x38/0xa0
[58330.294235] [] schedule_timeout+0x12c/0x280
[58330.294918] [] rcu_gp_kthread+0x504/0x750
[58330.295439] [] kthread+0xfc/0x130
[58330.295660] [] ret_from_fork+0x10/0x50
[58330.308439] Task dump for CPU 0:
[58330.308613] nvdla_runtime R running task 0 1300 1259 0x0000000a
[58330.308914] Call trace:
[58330.309054] [] dump_backtrace+0x0/0x230
[58330.309304] [] show_stack+0x14/0x20
[58330.309653] [] sched_show_task+0x118/0x180
[58330.309903] [] dump_cpu_task+0x40/0x50
[58330.310136] [] rcu_dump_cpu_stacks+0x94/0xdc
[58330.310395] [] rcu_check_callbacks+0x7dc/0x9b0
[58330.310663] [] update_process_times+0x2c/0x60
[58330.311656] [] tick_sched_handle.isra.5+0x30/0x50
[58330.311944] [] tick_sched_timer+0x40/0x90
[58330.312199] [] __hrtimer_run_queues+0xec/0x160
[58330.312478] [] hrtimer_interrupt+0xa4/0x220
[58330.313107] [] arch_timer_handler_virt+0x30/0x40
[58330.313380] [] handle_percpu_devid_irq+0x78/0x130
[58330.313649] [] generic_handle_irq+0x24/0x40
[58330.313930] [] __handle_domain_irq+0x5c/0xc0
[58330.314201] [] gic_handle_irq+0x58/0xb0
[58330.328450] Exception stack(0xffff80003da53af0 to 0xffff80003da53c20)
[58330.328747] 3ae0: ffff80003bf13828 0000000000000140
[58330.329089] 3b00: 0000000000000064 ffffffffffffffff 0000000000000000 0000000000000000
[58330.329424] 3b20: 0000000000000cf3 ffff000009008380 6e6576655f656c64 00000000000287ea
[58330.329762] 3b40: ffff000008541c60 ffff000009008000 ffff000008f02450 ffff000009008790
[58330.330101] 3b60: ffff00000900838d ffff00008900837f ffff000008202f20 0000ffff8b2a3550
[58330.330428] 3b80: 0000000000000006 0000000000000000 ffff80003bf13828 0000000000000140
[58330.330738] 3ba0: ffff80003bf13818 ffff80003bf13848 ffff80003da53d80 ffff80003ca80a00
[58330.331047] 3bc0: ffff80003b80f800 00000000c0106440 0000000000000010 ffff80003da53c20
[58330.331372] 3be0: ffff000000abe6f4 ffff80003da53c20 ffff000008995830 0000000020000145
[58330.331682] 3c00: 00000000c0106440 0000000000000010 0001000000000000 ffff000000ac1158
[58330.332002] [] el1_irq+0xb4/0x128
[58330.332214] [] _raw_spin_unlock_irqrestore+0x10/0x50
[58330.337606] [] nvdla_submit+0xf0/0x1b0 [opendla]
[58330.338140] [] drm_ioctl_kernel+0x6c/0xd4 [drm]
[58330.338624] [] drm_ioctl+0x298/0x3c4 [drm]
[58330.339269] [] do_vfs_ioctl+0xa4/0x750
[58330.339509] [] SyS_ioctl+0x8c/0xa0
[58330.339724] [] el0_svc_naked+0x24/0x28
:cs[58330.385709] Enter:dla_handle_events, processor:BDMA
[58330.385982] Exit:dla_handle_events, ret:0
[58330.386169] Enter:dla_handle_events, processor:Convolution
[58330.386397] Handle cdma data done event, processor Convolution group 0
[58330.386661] Handle op complete event, processor Convolution group 0
[58330.386918] Enter:dla_op_completion processor Convolution group0
[58330.387163] Completed Convolution operation index 6 ROI 0
[58330.387384] Update dependency operation index 8 ROI 0 DEP_COUNT=2
[58330.387622] 7 HWLs done, totally 42 layers
[58330.387799] Enter: dla_dequeue_operation
[58330.387965] Dequeue op from Convolution processor, index=13 ROI=0
[58330.388208] Enter: dla_submit_operation
[58330.388377] Prepare Convolution operation index 13 ROI 0 dep_count 2
[58330.388625] Enter: dla_prepare_operation
[58330.388900] processor:Convolution group:0, rdma_group:0 available
[58330.389162] Enter: dla_read_config
[58330.390963] Exit: dla_read_config
[58330.391056] Exit: dla_prepare_operation status=0
[58330.391148] Enter: dla_program_operation
[58330.391233] Program Convolution operation index 13 ROI 0 Group[0]
[58330.392588] no desc get due to index==-1
[58330.392923] no desc get due to index==-1
[58330.393130] no desc get due to index==-1
[58330.393315] no desc get due to index==-1
[58330.393496] no desc get due to index==-1
[58330.393677] Enter: dla_op_programmed
[58330.393842] Update dependency operation index 14 ROI 0 DEP_COUNT=2
[58330.394101] Exit: dla_op_programmed
[58330.394254] Exit: dla_program_operation status=0
[58330.394469] Exit: dla_submit_operation
[58330.394644] Exit: dla_dequeue_operation
[58330.394826] Exit:dla_op_completion processor Convolution group0 status=0
[58330.395092] Exit:dla_handle_events, ret:0
[58330.395260] Enter:dla_handle_events, processor:SDP
[58330.395460] Handle op complete event, processor SDP group 0
[58330.395684] Enter:dla_op_completion processor SDP group0
[58330.395916] Completed SDP operation index 7 ROI 0
[58330.396121] Update dependency operation index 9 ROI 0 DEP_COUNT=1
[58330.396371] enable SDP in dla_update_dependency as depdency are resolved
[58330.396649] Enter: dla_enable_operation
[58330.396816] Enable SDP operation index 9 ROI 0
[58330.397095] Enter: dla_op_enabled
[58330.397249] Update dependency operation index 8 ROI 0 DEP_COUNT=1
[58330.397520] enable Convolution in dla_update_dependency as depdency are resolved
[58330.397833] Enter: dla_enable_operation
[58330.398007] Enable Convolution operation index 8 ROI 0
[58330.398844] Enter: dla_op_enabled
[58330.399002] Exit: dla_op_enabled
[58330.399173] Exit: dla_enable_operation status=0
[58330.399378] Exit: dla_op_enabled
[58330.399524] Exit: dla_enable_operation status=0
[58330.399728] 8 HWLs done, totally 42 layers
[58330.399912] Enter: dla_free_op_desc op desc index 6 ROI 0
[58330.457716] Exit: dla_free_op_desc
[58330.457946] Enter: dla_dequeue_operation
[58330.458130] Dequeue op from SDP processor, index=10 ROI=0
[58330.458380] Enter: dla_submit_operation
[58330.458553] Prepare SDP operation index 10 ROI 0 dep_count 1
[58330.458780] Enter: dla_prepare_operation
[58330.459376] processor:SDP group:0, rdma_group:0 available
[58330.459650] Enter: dla_read_config
[58330.478323] Exit: dla_read_config
[58330.478490] Exit: dla_prepare_operation status=0
[58330.478701] Enter: dla_program_operation
[58330.478864] Program SDP operation index 10 ROI 0 Group[0]
[58330.486141] no desc get due to index==-1
[58330.486348] no desc get due to index==-1
[58330.486542] no desc get due to index==-1
[58330.486740] no desc get due to index==-1
[58330.486920] no desc get due to index==-1
[58330.487085] Enter: dla_op_programmed
[58330.487253] Update dependency operation index 14 ROI 0 DEP_COUNT=1
[58330.487507] enable SDP in dla_update_dependency as depdency are resolved
[58330.487777] Enter: dla_enable_operation
[58330.487936] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[58330.488283] Exit: dla_enable_operation status=0
[58330.488460] Exit: dla_op_programmed
[58330.488613] Exit: dla_program_operation status=0
[58330.488799] Exit: dla_submit_operation
[58330.488980] Exit: dla_dequeue_operation
[58330.489153] Enter: dla_free_op_desc op desc index 7 ROI 0
[58330.490918] Exit: dla_free_op_desc
[58330.491090] Exit:dla_op_completion processor SDP group0 status=0
[58330.491334] Exit:dla_handle_events, ret:0
[58330.491502] Enter:dla_handle_events, processor:PDP
[58330.491701] Exit:dla_handle_events, ret:0
[58330.491869] Enter:dla_handle_events, processor:CDP
[58330.492062] Exit:dla_handle_events, ret:0
[58330.492222] Enter:dla_handle_events, processor:RUBIK
[58330.492408] Exit:dla_handle_events, ret:0
[58636.568761] Enter:dla_handle_events, processor:BDMA
[58636.569070] Exit:dla_handle_events, ret:0
[58636.569235] Enter:dla_handle_events, processor:Convolution
[58636.569465] Handle cdma weight done event, processor Convolution group 1
[58636.569734] Handle cdma data done event, processor Convolution group 1
[58636.570001] Handle op complete event, processor Convolution group 1
[58636.570247] Enter:dla_op_completion processor Convolution group1
[58636.570495] Completed Convolution operation index 8 ROI 0
[58636.570744] 9 HWLs done, totally 42 layers
[58636.570925] Enter: dla_dequeue_operation
[58636.571098] Dequeue op from Convolution processor, index=15 ROI=0
[58636.571343] Enter: dla_submit_operation
[58636.571512] Prepare Convolution operation index 15 ROI 0 dep_count 2
[58636.571764] Enter: dla_prepare_operation
[58636.572047] processor:Convolution group:1, rdma_group:0 available
[58636.572313] Enter: dla_read_config
[58636.574112] Exit: dla_read_config
[58636.574287] Exit: dla_prepare_operation status=0
[58636.574487] Enter: dla_program_operation
[58636.574665] Program Convolution operation index 15 ROI 0 Group[1]
[58636.576045] no desc get due to index==-1
[58636.576317] no desc get due to index==-1
[58636.576489] no desc get due to index==-1
[58636.576662] no desc get due to index==-1
[58636.576834] no desc get due to index==-1
[58636.577005] Enter: dla_op_programmed
[58636.577165] Update dependency operation index 20 ROI 0 DEP_COUNT=3
[58636.577409] Update dependency operation index 16 ROI 0 DEP_COUNT=2
[58636.577656] Exit: dla_op_programmed
[58636.577808] Exit: dla_program_operation status=0
[58636.577999] Exit: dla_submit_operation
[58636.578165] Exit: dla_dequeue_operation
[58636.578335] Exit:dla_op_completion processor Convolution group1 status=0
[58636.578595] Exit:dla_handle_events, ret:0
[58636.578769] Enter:dla_handle_events, processor:SDP
[58636.578969] Handle op complete event, processor SDP group 1
[58636.579192] Enter:dla_op_completion processor SDP group1
[58636.579409] Completed SDP operation index 9 ROI 0
[58636.579606] Update dependency operation index 10 ROI 0 DEP_COUNT=1
[58636.579851] enable SDP in dla_update_dependency as depdency are resolved
[58636.580111] Enter: dla_enable_operation
[58636.580282] Enable SDP operation index 10 ROI 0
[58636.580573] Enter: dla_op_enabled
[58636.580667] Exit: dla_op_enabled
[58636.580746] Exit: dla_enable_operation status=0
[58636.580841] 10 HWLs done, totally 42 layers
[58636.580934] Enter: dla_free_op_desc op desc index 8 ROI 0
[58637.256142] Exit: dla_free_op_desc
[58637.256342] Enter: dla_dequeue_operation
[58637.256493] Dequeue op from SDP processor, index=14 ROI=0
[58637.256666] Enter: dla_submit_operation
[58637.256809] Prepare SDP operation index 14 ROI 0 dep_count 0
[58637.256986] Enter: dla_prepare_operation
[58637.259882] processor:SDP group:1, rdma_group:1 available
[58637.260075] Enter: dla_read_config
[58642.253328] Exit: dla_read_config
[58642.253611] Exit: dla_prepare_operation status=0
[58642.253816] Enter: dla_program_operation
[58642.254003] Program SDP operation index 14 ROI 0 Group[1]
[58642.259172] no desc get due to index==-1
[58642.259364] no desc get due to index==-1
[58642.259537] no desc get due to index==-1
[58642.259706] no desc get due to index==-1
[58642.259874] no desc get due to index==-1
[58642.260044] Enter: dla_op_programmed
[58642.260208] Update dependency operation index 16 ROI 0 DEP_COUNT=1
[58642.276546] enable SDP in dla_update_dependency as depdency are resolved
[58642.276870] Enter: dla_enable_operation
[58642.277046] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[58642.277423] Exit: dla_enable_operation status=0
[58642.277627] Exit: dla_op_programmed
[58642.277790] Exit: dla_program_operation status=0
[58642.277998] Enter: dla_enable_operation
[58642.278188] Enable SDP operation index 14 ROI 0
[58642.278621] Enter: dla_op_enabled
[58642.278787] Update dependency operation index 13 ROI 0 DEP_COUNT=2
[58642.279038] Exit: dla_op_enabled
[58642.279183] Exit: dla_enable_operation status=0
[58642.279374] Exit: dla_submit_operation
[58642.279539] Exit: dla_dequeue_operation
[58642.279709] Enter: dla_free_op_desc op desc index 9 ROI 0
[58642.280802] Exit: dla_free_op_desc
[58642.280977] Exit:dla_op_completion processor SDP group1 status=0
[58642.281237] Exit:dla_handle_events, ret:0
[58642.281425] Enter:dla_handle_events, processor:PDP
[58642.281639] Exit:dla_handle_events, ret:0
[58642.281818] Enter:dla_handle_events, processor:CDP
[58642.282025] Exit:dla_handle_events, ret:0
[58642.282217] Enter:dla_handle_events, processor:RUBIK
[58642.282432] Exit:dla_handle_events, ret:0
^[[B[58642.292881] Enter:dla_handle_events, processor:BDMA
[58642.293140] Exit:dla_handle_events, ret:0
[58642.293318] Enter:dla_handle_events, processor:Convolution
[58642.293550] Exit:dla_handle_events, ret:0
[58642.293722] Enter:dla_handle_events, processor:SDP
[58642.293923] Handle op complete event, processor SDP group 0
[58642.294154] Enter:dla_op_completion processor SDP group0
[58642.294383] Completed SDP operation index 10 ROI 0
[58642.294589] Update dependency operation index 11 ROI 0 DEP_COUNT=1
[58642.294887] enable CDP in dla_update_dependency as depdency are resolved
[58642.295146] Enter: dla_enable_operation
[58642.295316] Enable CDP operation index 11 ROI 0
[58642.295591] Enter: dla_cdp_enable
[58642.295795] Exit: dla_cdp_enable
[58642.295945] Enter: dla_op_enabled
[58642.296094] Exit: dla_op_enabled
[58642.296242] Exit: dla_enable_operation status=0
[58642.296436] 11 HWLs done, totally 42 layers
[58642.296618] Enter: dla_dequeue_operation
[58642.296794] Dequeue op from SDP processor, index=16 ROI=0
[58642.297008] Enter: dla_submit_operation
[58642.297177] Prepare SDP operation index 16 ROI 0 dep_count 0
[58642.297399] Enter: dla_prepare_operation
[58642.446259] processor:SDP group:0, rdma_group:0 available
[58642.446572] Enter: dla_read_config
[58676.179348] Exit: dla_read_config
[58676.179485] Exit: dla_prepare_operation status=0
[58676.179582] Enter: dla_program_operation
[58676.179668] Program SDP operation index 16 ROI 0 Group[0]
[58676.180503] no desc get due to index==-1
[58676.180705] no desc get due to index==-1
[58676.181007] no desc get due to index==-1
[58676.181216] no desc get due to index==-1
[58676.181395] no desc get due to index==-1
[58676.181571] Enter: dla_op_programmed
[58676.181739] Exit: dla_op_programmed
[58676.181905] Exit: dla_program_operation status=0
[58676.182109] Enter: dla_enable_operation
[58676.182287] Enable SDP operation index 16 ROI 0
[58676.182577] Enter: dla_op_enabled
[58676.182756] Update dependency operation index 15 ROI 0 DEP_COUNT=2
[58676.183026] Exit: dla_op_enabled
[58676.183185] Exit: dla_enable_operation status=0
[58676.183379] Exit: dla_submit_operation
[58676.183553] Exit: dla_dequeue_operation
[58676.183760] Enter: dla_free_op_desc op desc index 10 ROI 0
[58676.184753] Exit: dla_free_op_desc
[58676.184913] Exit:dla_op_completion processor SDP group0 status=0
[58676.185194] Exit:dla_handle_events, ret:0
[58676.185378] Enter:dla_handle_events, processor:PDP
[58676.185599] Exit:dla_handle_events, ret:0
[58676.185781] Enter:dla_handle_events, processor:CDP
[58676.185994] Exit:dla_handle_events, ret:0
[58676.186181] Enter:dla_handle_events, processor:RUBIK
[58676.186404] Exit:dla_handle_events, ret:0
[58676.186679] INFO: rcu_preempt self-detected stall on CPU
[58676.186961] 0-...: (1 ticks this GP) idle=b6e/140000000000001/0 softirq=9498/9498 fqs=0
[58676.187312] (t=8474 jiffies g=4081 c=4080 q=1)
[58676.187551] rcu_preempt kthread starved for 8474 jiffies! g4081 c4080 f0x0 RCU_GP_WAIT_FQS(3) ->state=0x1
[58676.187946] rcu_preempt S 0 8 2 0x00000000
[58676.188190] Call trace:
[58676.188348] [] __switch_to+0x90/0xb0
[58676.188596] [] __schedule+0x19c/0x5e0
[58676.188829] [] schedule+0x38/0xa0
[58676.189058] [] schedule_timeout+0x12c/0x280
[58676.189313] [] rcu_gp_kthread+0x504/0x750
[58676.189571] [] kthread+0xfc/0x130
[58676.189789] [] ret_from_fork+0x10/0x50
[58676.190073] Task dump for CPU 0:
[58676.190231] nvdla_runtime R running task 0 1300 1259 0x0000000a
[58676.190537] Call trace:
[58676.190685] [] dump_backtrace+0x0/0x230
[58676.190926] [] show_stack+0x14/0x20
[58676.191146] [] sched_show_task+0x118/0x180
[58676.191411] [] dump_cpu_task+0x40/0x50
[58676.191645] [] rcu_dump_cpu_stacks+0x94/0xdc
[58676.191902] [] rcu_check_callbacks+0x7dc/0x9b0
[58676.192162] [] update_process_times+0x2c/0x60
[58676.192417] [] tick_sched_handle.isra.5+0x30/0x50
[58676.192688] [] tick_sched_timer+0x40/0x90
[58676.192931] [] __hrtimer_run_queues+0xec/0x160
[58676.193196] [] hrtimer_interrupt+0xa4/0x220
[58676.193448] [] arch_timer_handler_virt+0x30/0x40
[58676.193729] [] handle_percpu_devid_irq+0x78/0x130
[58676.193991] [] generic_handle_irq+0x24/0x40
[58676.194228] [] __handle_domain_irq+0x5c/0xc0
[58676.194500] [] gic_handle_irq+0x58/0xb0
[58676.194721] Exception stack(0xffff80003da53af0 to 0xffff80003da53c20)
[58676.194991] 3ae0: ffff80003bf13828 0000000000000140
[58676.195325] 3b00: 000000000000006a 0000000000000007 0000000000000001 0000000000000000
[58676.195664] 3b20: 0000000000000e11 ffff000009008380 3a746572202c7374 000000000002d824
[58676.195995] 3b40: ffff000008541c60 ffff000009008000 ffff000008f02450 ffff000009008790
[58676.196335] 3b60: ffff00000900838d ffff00008900837f ffff00000812af90 0000ffff8b3ca200
[58676.196667] 3b80: 0000000000000006 0000000000000000 ffff80003bf13828 0000000000000140
[58676.196988] 3ba0: ffff80003bf13818 ffff80003bf13848 ffff80003da53d80 ffff80003ca80a00
[58676.197312] 3bc0: ffff80003b80f800 00000000c0106440 0000000000000010 ffff80003da53c20
[58676.197653] 3be0: ffff000000abe6f4 ffff80003da53c20 ffff000008995830 0000000020000145
[58676.197981] 3c00: 00000000c0106440 0000000000000010 0001000000000000 ffff000000abe6cc
[58676.198310] [] el1_irq+0xb4/0x128
[58676.198525] [] _raw_spin_unlock_irqrestore+0x10/0x50
[58676.198848] [] nvdla_submit+0xf0/0x1b0 [opendla]
[58676.199345] [] drm_ioctl_kernel+0x6c/0xd4 [drm]
[58676.199804] [] drm_ioctl+0x298/0x3c4 [drm]
[58676.200059] [] do_vfs_ioctl+0xa4/0x750
[58676.200294] [] SyS_ioctl+0x8c/0xa0
[58676.200517] [] el0_svc_naked+0x24/0x28
[58676.213079] Enter:dla_handle_events, processor:BDMA
[58676.213352] Exit:dla_handle_events, ret:0
[58676.213544] Enter:dla_handle_events, processor:Convolution
[58676.213771] Exit:dla_handle_events, ret:0
[58676.213955] Enter:dla_handle_events, processor:SDP
[58676.214160] Exit:dla_handle_events, ret:0
[58676.214341] Enter:dla_handle_events, processor:PDP
[58676.214540] Exit:dla_handle_events, ret:0
[58676.214795] Enter:dla_handle_events, processor:CDP
[58676.215031] Handle op complete event, processor CDP group 0
[58676.215264] Enter:dla_op_completion processor CDP group0
[58676.234027] Completed CDP operation index 11 ROI 0
[58676.234288] Update dependency operation index 12 ROI 0 DEP_COUNT=1
[58676.234564] enable PDP in dla_update_dependency as depdency are resolved
[58676.234851] Enter: dla_enable_operation
[58676.235043] Enable PDP operation index 12 ROI 0
[58676.235255] group id 1 rdma id 1
[58676.235506] rdma needed 1
[58676.250307] Enter: dla_op_enabled
[58676.250406] Exit: dla_op_enabled
[58676.250489] Exit: dla_enable_operation status=0
[58676.250594] 12 HWLs done, totally 42 layers
[58676.250691] Enter: dla_dequeue_operation
[58676.250780] exit CDP as there's no further operation
[58676.250882] Exit: dla_dequeue_operation
[58676.250973] Enter: dla_free_op_desc op desc index 11 ROI 0
[58676.545179] Exit: dla_free_op_desc
[58676.545382] Exit:dla_op_completion processor CDP group0 status=0
[58676.545632] Exit:dla_handle_events, ret:0
[58676.545800] Enter:dla_handle_events, processor:RUBIK
[58676.545986] Exit:dla_handle_events, ret:0
[58684.782366] Enter:dla_handle_events, processor:BDMA
[58684.782546] Exit:dla_handle_events, ret:0
[58684.782667] Enter:dla_handle_events, processor:Convolution
[58684.782927] Exit:dla_handle_events, ret:0
[58684.783108] Enter:dla_handle_events, processor:SDP
[58684.783318] Exit:dla_handle_events, ret:0
[58684.783499] Enter:dla_handle_events, processor:PDP
[58684.783712] Handle op complete event, processor PDP group 1
[58684.783949] Enter:dla_op_completion processor PDP group1
[58684.784181] Completed PDP operation index 12 ROI 0
[58684.784386] Update dependency operation index 13 ROI 0 DEP_COUNT=1
[58684.784626] enable Convolution in dla_update_dependency as depdency are resolved
[58684.784913] Enter: dla_enable_operation
[58684.785078] Enable Convolution operation index 13 ROI 0
[58684.785656] Enter: dla_op_enabled
[58684.785818] Exit: dla_op_enabled
[58684.785972] Exit: dla_enable_operation status=0
[58684.786167] 13 HWLs done, totally 42 layers
[58684.786356] Enter: dla_dequeue_operation
[58684.786527] Dequeue op from PDP processor, index=33 ROI=0
[58684.786743] Enter: dla_submit_operation
[58684.786915] Prepare PDP operation index 33 ROI 0 dep_count 1
[58684.787140] Enter: dla_prepare_operation
[58684.826381] processor:PDP group:1, rdma_group:1 available
[58684.826651] Enter: dla_read_config
[58684.857108] Exit: dla_read_config
[58684.857286] Exit: dla_prepare_operation status=0
[58684.857489] Enter: dla_program_operation
[58684.857670] Program PDP operation index 33 ROI 0 Group[1]
[58684.857890] group id 1 rdma id 1
[58684.863146] no desc get due to index==-1
[58684.864232] no desc get due to index==-1
[58684.864415] no desc get due to index==-1
[58684.864581] no desc get due to index==-1
[58684.864746] no desc get due to index==-1
[58684.864911] no desc get due to index==-1
[58684.865079] Enter: dla_op_programmed
[58684.865236] Exit: dla_op_programmed
[58684.865387] Exit: dla_program_operation status=0
[58684.865585] Exit: dla_submit_operation
[58684.865753] Exit: dla_dequeue_operation
[58684.865923] Enter: dla_free_op_desc op desc index 12 ROI 0
[58684.867130] Exit: dla_free_op_desc
[58684.867356] Exit:dla_op_completion processor PDP group1 status=0
[58684.867628] Exit:dla_handle_events, ret:0
[58684.867821] Enter:dla_handle_events, processor:CDP
[58684.868039] Exit:dla_handle_events, ret:0
[58684.868217] Enter:dla_handle_events, processor:RUBIK
[58684.868450] Exit:dla_handle_events, ret:0
[58854.781560] Enter:dla_handle_events, processor:BDMA
[58854.781911] Exit:dla_handle_events, ret:0
[58854.782093] Enter:dla_handle_events, processor:Convolution
[58854.782366] Handle cdma weight done event, processor Convolution group 0
[58854.782651] Handle cdma data done event, processor Convolution group 0
[58854.782920] Handle op complete event, processor Convolution group 0
[58854.783201] Enter:dla_op_completion processor Convolution group0
[58854.783463] Completed Convolution operation index 13 ROI 0
[58854.783712] Update dependency operation index 15 ROI 0 DEP_COUNT=1
[58854.783980] enable Convolution in dla_update_dependency as depdency are resolved
[58854.784288] Enter: dla_enable_operation
[58854.784463] Enable Convolution operation index 15 ROI 0
[58854.784944] Enter: dla_op_enabled
[58854.785106] Exit: dla_op_enabled
[58854.785249] Exit: dla_enable_operation status=0
[58854.785454] 14 HWLs done, totally 42 layers
[58854.785646] Enter: dla_dequeue_operation
[58854.785828] Dequeue op from Convolution processor, index=20 ROI=0
[58854.786085] Enter: dla_submit_operation
[58854.786262] Prepare Convolution operation index 20 ROI 0 dep_count 2
[58854.786528] Enter: dla_prepare_operation
[58854.795293] processor:Convolution group:0, rdma_group:0 available
[58854.795549] Enter: dla_read_config
[58854.850838] Exit: dla_read_config
[58854.851114] Exit: dla_prepare_operation status=0
[58854.851327] Enter: dla_program_operation
[58854.851509] Program Convolution operation index 20 ROI 0 Group[0]
[58854.859915] no desc get due to index==-1
[58854.864116] no desc get due to index==-1
[58854.864324] no desc get due to index==-1
[58854.864521] no desc get due to index==-1
[58854.864690] no desc get due to index==-1
[58854.864858] Enter: dla_op_programmed
[58854.865020] Update dependency operation index 23 ROI 0 DEP_COUNT=3
[58854.865276] Update dependency operation index 21 ROI 0 DEP_COUNT=2
[58854.865528] Exit: dla_op_programmed
[58854.865681] Exit: dla_program_operation status=0
[58854.865869] Exit: dla_submit_operation
[58854.866037] Exit: dla_dequeue_operation
[58854.866209] Exit:dla_op_completion processor Convolution group0 status=0
[58854.866480] Exit:dla_handle_events, ret:0
[58854.866651] Enter:dla_handle_events, processor:SDP
[58854.866849] Handle op complete event, processor SDP group 1
[58854.867069] Enter:dla_op_completion processor SDP group1
[58854.867285] Completed SDP operation index 14 ROI 0
[58854.867489] 15 HWLs done, totally 42 layers
[58854.867669] Enter: dla_free_op_desc op desc index 13 ROI 0
[58854.868788] Exit: dla_free_op_desc
[58854.868960] Enter: dla_dequeue_operation
[58854.869142] Dequeue op from SDP processor, index=17 ROI=0
[58854.869370] Enter: dla_submit_operation
[58854.869544] Prepare SDP operation index 17 ROI 0 dep_count 1
[58854.869780] Enter: dla_prepare_operation
[58854.870449] processor:SDP group:1, rdma_group:1 available
[58854.870684] Enter: dla_read_config
[58854.894490] Exit: dla_read_config
[58854.894695] Exit: dla_prepare_operation status=0
[58854.894888] Enter: dla_program_operation
[58854.895059] Program SDP operation index 17 ROI 0 Group[1]
[58854.904573] no desc get due to index==-1
[58854.904762] no desc get due to index==-1
[58854.904952] no desc get due to index==-1
[58854.905115] no desc get due to index==-1
[58854.905272] no desc get due to index==-1
[58854.905431] Enter: dla_op_programmed
[58854.905592] Update dependency operation index 21 ROI 0 DEP_COUNT=1
[58854.905826] enable SDP in dla_update_dependency as depdency are resolved
[58854.906096] Enter: dla_enable_operation
[58854.906260] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[58854.906607] Exit: dla_enable_operation status=0
[58854.906791] Exit: dla_op_programmed
[58854.906942] Exit: dla_program_operation status=0
[58854.907127] Exit: dla_submit_operation
[58854.907287] Exit: dla_dequeue_operation
[58854.907454] Enter: dla_free_op_desc op desc index 14 ROI 0
[58854.911390] Exit: dla_free_op_desc
[58854.911553] Exit:dla_op_completion processor SDP group1 status=0
[58854.911796] Exit:dla_handle_events, ret:0
[58854.911960] Enter:dla_handle_events, processor:PDP
[58854.912156] Exit:dla_handle_events, ret:0
[58854.912323] Enter:dla_handle_events, processor:CDP
[58854.912518] Exit:dla_handle_events, ret:0
[58854.912686] Enter:dla_handle_events, processor:RUBIK
[58854.912891] Exit:dla_handle_events, ret:0
[59023.616028] Enter:dla_handle_events, processor:BDMA
[59023.616436] Exit:dla_handle_events, ret:0
[59023.632619] Enter:dla_handle_events, processor:Convolution
[59023.632868] Handle cdma weight done event, processor Convolution group 1
[59023.633153] Handle cdma data done event, processor Convolution group 1
[59023.633430] Handle op complete event, processor Convolution group 1
[59023.633692] Enter:dla_op_completion processor Convolution group1
[59023.633948] Completed Convolution operation index 15 ROI 0
[59023.634186] 16 HWLs done, totally 42 layers
[59023.634385] Enter: dla_dequeue_operation
[59023.634557] Dequeue op from Convolution processor, index=23 ROI=0
[59023.634800] Enter: dla_submit_operation
[59023.634971] Prepare Convolution operation index 23 ROI 0 dep_count 2
[59023.635216] Enter: dla_prepare_operation
[59023.635438] processor:Convolution group:1, rdma_group:0 available
[59023.635682] Enter: dla_read_config
[59023.637470] Exit: dla_read_config
[59023.637638] Exit: dla_prepare_operation status=0
[59023.637853] Enter: dla_program_operation
[59023.638023] Program Convolution operation index 23 ROI 0 Group[1]
[59023.639393] no desc get due to index==-1
[59023.639729] no desc get due to index==-1
[59023.639903] no desc get due to index==-1
[59023.640074] no desc get due to index==-1
[59023.640234] no desc get due to index==-1
[59023.640403] Enter: dla_op_programmed
[59023.640561] Update dependency operation index 24 ROI 0 DEP_COUNT=2
[59023.640804] Exit: dla_op_programmed
[59023.640964] Exit: dla_program_operation status=0
[59023.641162] Exit: dla_submit_operation
[59023.641325] Exit: dla_dequeue_operation
[59023.641496] Exit:dla_op_completion processor Convolution group1 status=0
[59023.641763] Exit:dla_handle_events, ret:0
[59023.641934] Enter:dla_handle_events, processor:SDP
[59023.642133] Handle op complete event, processor SDP group 0
[59023.642365] Enter:dla_op_completion processor SDP group0
[59023.642585] Completed SDP operation index 16 ROI 0
[59023.642789] Update dependency operation index 17 ROI 0 DEP_COUNT=1
[59023.643037] enable SDP in dla_update_dependency as depdency are resolved
[59023.643303] Enter: dla_enable_operation
[59023.643470] Enable SDP operation index 17 ROI 0
[59023.643744] Enter: dla_op_enabled
[59023.643898] Exit: dla_op_enabled
[59023.644042] Exit: dla_enable_operation status=0
[59023.644230] 17 HWLs done, totally 42 layers
[59023.644410] Enter: dla_free_op_desc op desc index 15 ROI 0
[59023.677444] Exit: dla_free_op_desc
[59023.677693] Enter: dla_dequeue_operation
[59023.677888] Dequeue op from SDP processor, index=21 ROI=0
[59023.678126] Enter: dla_submit_operation
[59023.678321] Prepare SDP operation index 21 ROI 0 dep_count 0
[59023.678569] Enter: dla_prepare_operation
[59023.680022] processor:SDP group:0, rdma_group:0 available
[59023.680287] Enter: dla_read_config
[59023.736105] Exit: dla_read_config
[59023.736280] Exit: dla_prepare_operation status=0
[59023.736484] Enter: dla_program_operation
[59023.736662] Program SDP operation index 21 ROI 0 Group[0]
[59023.757521] no desc get due to index==-1
[59023.757699] no desc get due to index==-1
[59023.763129] no desc get due to index==-1
[59023.763308] no desc get due to index==-1
[59023.763477] no desc get due to index==-1
[59023.763662] Enter: dla_op_programmed
[59023.763834] Exit: dla_op_programmed
[59023.763993] Exit: dla_program_operation status=0
[59023.764198] Enter: dla_enable_operation
[59023.764376] Enable SDP operation index 21 ROI 0
[59023.766657] Enter: dla_op_enabled
[59023.766821] Update dependency operation index 20 ROI 0 DEP_COUNT=2
[59023.767080] Exit: dla_op_enabled
[59023.767233] Exit: dla_enable_operation status=0
[59023.767438] Exit: dla_submit_operation
[59023.767613] Exit: dla_dequeue_operation
[59023.767792] Enter: dla_free_op_desc op desc index 16 ROI 0
[59023.786068] Exit: dla_free_op_desc
[59023.786244] Exit:dla_op_completion processor SDP group0 status=0
[59023.786497] Exit:dla_handle_events, ret:0
[59023.786657] Enter:dla_handle_events, processor:PDP
[59023.786866] Exit:dla_handle_events, ret:0
[59023.787043] Enter:dla_handle_events, processor:CDP
[59023.787247] Exit:dla_handle_events, ret:0
[59023.787418] Enter:dla_handle_events, processor:RUBIK
[59023.787617] Exit:dla_handle_events, ret:0
[59026.763759] Enter:dla_handle_events, processor:BDMA
[59026.764075] Exit:dla_handle_events, ret:0
[59026.764258] Enter:dla_handle_events, processor:Convolution
[59026.764506] Exit:dla_handle_events, ret:0
[59026.764689] Enter:dla_handle_events, processor:SDP
[59026.764896] Handle op complete event, processor SDP group 1
[59026.765140] Enter:dla_op_completion processor SDP group1
[59026.765370] Completed SDP operation index 17 ROI 0
[59026.765576] Update dependency operation index 18 ROI 0 DEP_COUNT=1
[59026.765840] enable CDP in dla_update_dependency as depdency are resolved
[59026.766128] Enter: dla_enable_operation
[59026.766308] Enable CDP operation index 18 ROI 0
[59026.766576] Enter: dla_cdp_enable
[59026.766820] Exit: dla_cdp_enable
[59026.766979] Enter: dla_op_enabled
[59026.767133] Exit: dla_op_enabled
[59026.767292] Exit: dla_enable_operation status=0
[59026.767492] 18 HWLs done, totally 42 layers
[59026.767688] Enter: dla_dequeue_operation
[59026.767865] Dequeue op from SDP processor, index=22 ROI=0
[59026.768097] Enter: dla_submit_operation
[59026.768283] Prepare SDP operation index 22 ROI 0 dep_count 1
[59026.768518] Enter: dla_prepare_operation
[59026.795375] processor:SDP group:1, rdma_group:1 available
[59026.795678] Enter: dla_read_config
[59027.104044] Exit: dla_read_config
[59027.104263] Exit: dla_prepare_operation status=0
[59027.104459] Enter: dla_program_operation
[59027.104651] Program SDP operation index 22 ROI 0 Group[1]
[59048.429575] no desc get due to index==-1
[59048.429889] no desc get due to index==-1
[59048.430093] no desc get due to index==-1
[59048.430260] no desc get due to index==-1
[59048.430450] no desc get due to index==-1
[59048.430630] Enter: dla_op_programmed
[59048.430794] Update dependency operation index 24 ROI 0 DEP_COUNT=1
[59048.431052] enable SDP in dla_update_dependency as depdency are resolved
[59048.431335] Enter: dla_enable_operation
[59048.431511] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[59048.431878] Exit: dla_enable_operation status=0
[59048.432071] Exit: dla_op_programmed
[59048.432236] Exit: dla_program_operation status=0
[59048.432450] Exit: dla_submit_operation
[59048.432620] Exit: dla_dequeue_operation
[59048.432797] Enter: dla_free_op_desc op desc index 17 ROI 0
[59048.433381] Exit: dla_free_op_desc
[59048.433554] Exit:dla_op_completion processor SDP group1 status=0
[59048.433810] Exit:dla_handle_events, ret:0
[59048.433990] Enter:dla_handle_events, processor:PDP
[59048.434199] Exit:dla_handle_events, ret:0
[59048.434389] Enter:dla_handle_events, processor:CDP
[59048.434598] Exit:dla_handle_events, ret:0
[59048.434781] Enter:dla_handle_events, processor:RUBIK
[59048.434984] Exit:dla_handle_events, ret:0
[59048.441737] Enter:dla_handle_events, processor:BDMA
[59048.442008] Exit:dla_handle_events, ret:0
[59048.442183] Enter:dla_handle_events, processor:Convolution
[59048.442410] Exit:dla_handle_events, ret:0
[59048.442577] Enter:dla_handle_events, processor:SDP
[59048.442820] Exit:dla_handle_events, ret:0
[59048.442997] Enter:dla_handle_events, processor:PDP
[59048.443194] Exit:dla_handle_events, ret:0
[59048.443364] Enter:dla_handle_events, processor:CDP
[59048.443570] Handle op complete event, processor CDP group 1
[59048.443801] Enter:dla_op_completion processor CDP group1
[59048.444020] Completed CDP operation index 18 ROI 0
[59048.444221] Update dependency operation index 19 ROI 0 DEP_COUNT=1
[59048.444466] enable PDP in dla_update_dependency as depdency are resolved
[59048.444727] Enter: dla_enable_operation
[59048.444899] Enable PDP operation index 19 ROI 0
[59048.445086] group id 0 rdma id 0
[59048.445328] rdma needed 1
[59048.445453] Enter: dla_op_enabled
[59048.445541] Exit: dla_op_enabled
[59048.445619] Exit: dla_enable_operation status=0
[59048.445723] 19 HWLs done, totally 42 layers
[59048.445816] Enter: dla_dequeue_operation
[59048.445901] exit CDP as there's no further operation
[59048.446011] Exit: dla_dequeue_operation
[59048.446104] Enter: dla_free_op_desc op desc index 18 ROI 0
[59048.486901] Exit: dla_free_op_desc
[59048.487203] Exit:dla_op_completion processor CDP group1 status=0
[59048.487445] Exit:dla_handle_events, ret:0
[59048.487619] Enter:dla_handle_events, processor:RUBIK
[59048.487821] Exit:dla_handle_events, ret:0
[59053.066461] Enter:dla_handle_events, processor:BDMA
[59053.066782] Exit:dla_handle_events, ret:0
[59053.066967] Enter:dla_handle_events, processor:Convolution
[59053.067219] Exit:dla_handle_events, ret:0
[59053.067410] Enter:dla_handle_events, processor:SDP
[59053.067610] Exit:dla_handle_events, ret:0
[59053.067787] Enter:dla_handle_events, processor:PDP
[59053.067984] Handle op complete event, processor PDP group 0
[59053.068212] Enter:dla_op_completion processor PDP group0
[59053.068431] Completed PDP operation index 19 ROI 0
[59053.068632] Update dependency operation index 20 ROI 0 DEP_COUNT=1
[59053.068878] enable Convolution in dla_update_dependency as depdency are resolved
[59053.069167] Enter: dla_enable_operation
[59053.069337] Enable Convolution operation index 20 ROI 0
[59053.069766] Enter: dla_op_enabled
[59053.069922] Exit: dla_op_enabled
[59053.070067] Exit: dla_enable_operation status=0
[59053.070253] 20 HWLs done, totally 42 layers
[59053.070442] Enter: dla_dequeue_operation
[59053.070614] exit PDP as there's no further operation
[59053.070815] Exit: dla_dequeue_operation
[59053.070982] Enter: dla_free_op_desc op desc index 19 ROI 0
[59053.103577] Exit: dla_free_op_desc
[59053.103774] Exit:dla_op_completion processor PDP group0 status=0
[59053.104022] Exit:dla_handle_events, ret:0
[59053.104189] Enter:dla_handle_events, processor:CDP
[59053.104392] Exit:dla_handle_events, ret:0
[59053.104571] Enter:dla_handle_events, processor:RUBIK
[59053.104784] Exit:dla_handle_events, ret:0
[59251.484812] Enter:dla_handle_events, processor:BDMA
[59251.485117] Exit:dla_handle_events, ret:0
[59251.485293] Enter:dla_handle_events, processor:Convolution
[59251.485532] Handle cdma weight done event, processor Convolution group 0
[59251.485813] Handle cdma data done event, processor Convolution group 0
[59251.486082] Handle op complete event, processor Convolution group 0
[59251.486338] Enter:dla_op_completion processor Convolution group0
[59251.486578] Completed Convolution operation index 20 ROI 0
[59251.486873] 21 HWLs done, totally 42 layers
[59251.487060] Enter: dla_dequeue_operation
[59251.487232] Dequeue op from Convolution processor, index=25 ROI=0
[59251.487475] Enter: dla_submit_operation
[59251.487643] Prepare Convolution operation index 25 ROI 0 dep_count 2
[59251.487885] Enter: dla_prepare_operation
[59251.488138] processor:Convolution group:0, rdma_group:0 available
[59251.488394] Enter: dla_read_config
[59251.490117] Exit: dla_read_config
[59251.490305] Exit: dla_prepare_operation status=0
[59251.490508] Enter: dla_program_operation
[59251.490681] Program Convolution operation index 25 ROI 0 Group[0]
[59251.492059] no desc get due to index==-1
[59251.492331] no desc get due to index==-1
[59251.492528] no desc get due to index==-1
[59251.492701] no desc get due to index==-1
[59251.492867] no desc get due to index==-1
[59251.493050] Enter: dla_op_programmed
[59251.493218] Update dependency operation index 28 ROI 0 DEP_COUNT=3
[59251.493478] Update dependency operation index 26 ROI 0 DEP_COUNT=2
[59251.493738] Exit: dla_op_programmed
[59251.493904] Exit: dla_program_operation status=0
[59251.494108] Exit: dla_submit_operation
[59251.494278] Exit: dla_dequeue_operation
[59251.494450] Exit:dla_op_completion processor Convolution group0 status=0
[59251.494718] Exit:dla_handle_events, ret:0
[59251.494884] Enter:dla_handle_events, processor:SDP
[59251.495082] Handle op complete event, processor SDP group 0
[59251.495307] Enter:dla_op_completion processor SDP group0
[59251.495532] Completed SDP operation index 21 ROI 0
[59251.495735] Update dependency operation index 22 ROI 0 DEP_COUNT=1
[59251.495977] enable SDP in dla_update_dependency as depdency are resolved
[59251.496236] Enter: dla_enable_operation
[59251.496404] Enable SDP operation index 22 ROI 0
[59251.496685] Enter: dla_op_enabled
[59251.496841] Exit: dla_op_enabled
[59251.496986] Exit: dla_enable_operation status=0
[59251.497175] 22 HWLs done, totally 42 layers
[59251.497357] Enter: dla_free_op_desc op desc index 20 ROI 0
[59251.511279] Exit: dla_free_op_desc
[59251.511473] Enter: dla_dequeue_operation
[59251.511644] Dequeue op from SDP processor, index=24 ROI=0
[59251.511865] Enter: dla_submit_operation
[59251.512033] Prepare SDP operation index 24 ROI 0 dep_count 0
[59251.512256] Enter: dla_prepare_operation
[59251.513683] processor:SDP group:0, rdma_group:0 available
[59251.513915] Enter: dla_read_config
[59251.566983] Exit: dla_read_config
[59251.567170] Exit: dla_prepare_operation status=0
[59251.567357] Enter: dla_program_operation
[59251.567530] Program SDP operation index 24 ROI 0 Group[0]
[59251.578941] no desc get due to index==-1
[59251.579122] no desc get due to index==-1
[59251.579292] no desc get due to index==-1
[59251.579457] no desc get due to index==-1
[59251.579633] no desc get due to index==-1
[59251.579817] Enter: dla_op_programmed
[59251.579983] Update dependency operation index 26 ROI 0 DEP_COUNT=1
[59251.580243] enable SDP in dla_update_dependency as depdency are resolved
[59251.580529] Enter: dla_enable_operation
[59251.580692] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[59251.581054] Exit: dla_enable_operation status=0
[59251.581248] Exit: dla_op_programmed
[59251.581405] Exit: dla_program_operation status=0
[59251.581598] Enter: dla_enable_operation
[59251.581764] Enable SDP operation index 24 ROI 0
[59251.582811] Enter: dla_op_enabled
[59251.582985] Update dependency operation index 23 ROI 0 DEP_COUNT=2
[59251.583250] Exit: dla_op_enabled
[59251.583406] Exit: dla_enable_operation status=0
[59251.583607] Exit: dla_submit_operation
[59251.583876] Exit: dla_dequeue_operation
[59251.584066] Enter: dla_free_op_desc op desc index 21 ROI 0
[59251.589351] Exit: dla_free_op_desc
[59251.589560] Exit:dla_op_completion processor SDP group0 status=0
[59251.589811] Exit:dla_handle_events, ret:0
[59251.589987] Enter:dla_handle_events, processor:PDP
[59251.590186] Exit:dla_handle_events, ret:0
[59251.590356] Enter:dla_handle_events, processor:CDP
[59251.590557] Exit:dla_handle_events, ret:0
[59251.590727] Enter:dla_handle_events, processor:RUBIK
[59251.590928] Exit:dla_handle_events, ret:0
[59252.606912] Enter:dla_handle_events, processor:BDMA
[59252.607232] Exit:dla_handle_events, ret:0
[59252.607413] Enter:dla_handle_events, processor:Convolution
[59252.607643] Exit:dla_handle_events, ret:0
[59252.607821] Enter:dla_handle_events, processor:SDP
[59252.608026] Handle op complete event, processor SDP group 1
[59252.608252] Enter:dla_op_completion processor SDP group1
[59252.608470] Completed SDP operation index 22 ROI 0
[59252.608681] Update dependency operation index 23 ROI 0 DEP_COUNT=1
[59252.608932] enable Convolution in dla_update_dependency as depdency are resolved
[59252.609238] Enter: dla_enable_operation
[59252.609409] Enable Convolution operation index 23 ROI 0
[59252.609848] Enter: dla_op_enabled
[59252.610004] Exit: dla_op_enabled
[59252.610149] Exit: dla_enable_operation status=0
[59252.610354] 23 HWLs done, totally 42 layers
[59252.610531] Enter: dla_dequeue_operation
[59252.610728] Dequeue op from SDP processor, index=26 ROI=0
[59252.610950] Enter: dla_submit_operation
[59252.611118] Prepare SDP operation index 26 ROI 0 dep_count 0
[59252.611346] Enter: dla_prepare_operation
[59252.634696] processor:SDP group:1, rdma_group:1 available
[59252.634982] Enter: dla_read_config
[59252.656392] Exit: dla_read_config
[59252.667949] Exit: dla_prepare_operation status=0
[59252.668176] Enter: dla_program_operation
[59252.668362] Program SDP operation index 26 ROI 0 Group[1]
[59252.673825] no desc get due to index==-1
[59252.674012] no desc get due to index==-1
[59252.674965] no desc get due to index==-1
[59252.675141] no desc get due to index==-1
[59252.675315] no desc get due to index==-1
[59252.675487] Enter: dla_op_programmed
[59252.675648] Exit: dla_op_programmed
[59252.675802] Exit: dla_program_operation status=0
[59252.675996] Enter: dla_enable_operation
[59252.676169] Enable SDP operation index 26 ROI 0
[59252.676788] Enter: dla_op_enabled
[59252.676947] Update dependency operation index 25 ROI 0 DEP_COUNT=2
[59252.677196] Exit: dla_op_enabled
[59252.677357] Exit: dla_enable_operation status=0
[59252.677556] Exit: dla_submit_operation
[59252.677730] Exit: dla_dequeue_operation
[59252.677913] Enter: dla_free_op_desc op desc index 22 ROI 0
[59252.679054] Exit: dla_free_op_desc
[59252.679240] Exit:dla_op_completion processor SDP group1 status=0
[59252.679487] Exit:dla_handle_events, ret:0
[59252.679661] Enter:dla_handle_events, processor:PDP
[59252.679863] Exit:dla_handle_events, ret:0
[59252.680038] Enter:dla_handle_events, processor:CDP
[59252.680238] Exit:dla_handle_events, ret:0
[59252.680410] Enter:dla_handle_events, processor:RUBIK
[59252.680617] Exit:dla_handle_events, ret:0
[59324.349430] Enter:dla_handle_events, processor:BDMA
[59324.349728] Exit:dla_handle_events, ret:0
[59324.349932] Enter:dla_handle_events, processor:Convolution
[59324.350166] Handle cdma weight done event, processor Convolution group 1
[59324.350454] Handle cdma data done event, processor Convolution group 1
[59324.350771] Handle op complete event, processor Convolution group 1
[59324.350904] Enter:dla_op_completion processor Convolution group1
[59324.351029] Completed Convolution operation index 23 ROI 0
[59324.351147] Update dependency operation index 25 ROI 0 DEP_COUNT=1
[59324.351267] enable Convolution in dla_update_dependency as depdency are resolved
[59324.351416] Enter: dla_enable_operation
[59324.351509] Enable Convolution operation index 25 ROI 0
[59324.351896] Enter: dla_op_enabled
[59324.352073] Exit: dla_op_enabled
[59324.352228] Exit: dla_enable_operation status=0
[59324.352434] 24 HWLs done, totally 42 layers
[59324.352619] Enter: dla_dequeue_operation
[59324.352799] Dequeue op from Convolution processor, index=28 ROI=0
[59324.353061] Enter: dla_submit_operation
[59324.353233] Prepare Convolution operation index 28 ROI 0 dep_count 2
[59324.353478] Enter: dla_prepare_operation
[59324.362414] processor:Convolution group:1, rdma_group:0 available
[59324.362700] Enter: dla_read_config
[59324.397232] Exit: dla_read_config
[59324.397432] Exit: dla_prepare_operation status=0
[59324.397643] Enter: dla_program_operation
[59324.397815] Program Convolution operation index 28 ROI 0 Group[1]
[59324.407010] no desc get due to index==-1
[59324.409909] no desc get due to index==-1
[59324.410128] no desc get due to index==-1
[59324.410323] no desc get due to index==-1
[59324.410496] no desc get due to index==-1
[59324.410668] Enter: dla_op_programmed
[59324.410835] Update dependency operation index 29 ROI 0 DEP_COUNT=2
[59324.411092] Exit: dla_op_programmed
[59324.411246] Exit: dla_program_operation status=0
[59324.411436] Exit: dla_submit_operation
[59324.411607] Exit: dla_dequeue_operation
[59324.411780] Exit:dla_op_completion processor Convolution group1 status=0
[59324.412040] Exit:dla_handle_events, ret:0
[59324.412218] Enter:dla_handle_events, processor:SDP
[59324.412421] Handle op complete event, processor SDP group 0
[59324.412647] Enter:dla_op_completion processor SDP group0
[59324.412866] Completed SDP operation index 24 ROI 0
[59324.413093] 25 HWLs done, totally 42 layers
[59324.413306] Enter: dla_free_op_desc op desc index 23 ROI 0
[59324.416624] Exit: dla_free_op_desc
[59324.416784] Enter: dla_dequeue_operation
[59324.416954] Dequeue op from SDP processor, index=27 ROI=0
[59324.417182] Enter: dla_submit_operation
[59324.417357] Prepare SDP operation index 27 ROI 0 dep_count 1
[59324.417587] Enter: dla_prepare_operation
[59324.418169] processor:SDP group:0, rdma_group:0 available
[59324.418397] Enter: dla_read_config
[59324.440970] Exit: dla_read_config
[59324.441176] Exit: dla_prepare_operation status=0
[59324.441371] Enter: dla_program_operation
[59324.441545] Program SDP operation index 27 ROI 0 Group[0]
[59324.445843] no desc get due to index==-1
[59324.446025] no desc get due to index==-1
[59324.446191] no desc get due to index==-1
[59324.446376] no desc get due to index==-1
[59324.446550] no desc get due to index==-1
[59324.446730] Enter: dla_op_programmed
[59324.446904] Update dependency operation index 29 ROI 0 DEP_COUNT=1
[59324.447165] enable SDP in dla_update_dependency as depdency are resolved
[59324.447443] Enter: dla_enable_operation
[59324.447607] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[59324.447956] Exit: dla_enable_operation status=0
[59324.448147] Exit: dla_op_programmed
[59324.448368] Exit: dla_program_operation status=0
[59324.448569] Exit: dla_submit_operation
[59324.448737] Exit: dla_dequeue_operation
[59324.448910] Enter: dla_free_op_desc op desc index 24 ROI 0
[59324.450994] Exit: dla_free_op_desc
[59324.451244] Exit:dla_op_completion processor SDP group0 status=0
[59324.451490] Exit:dla_handle_events, ret:0
[59324.451658] Enter:dla_handle_events, processor:PDP
[59324.451848] Exit:dla_handle_events, ret:0
[59324.452010] Enter:dla_handle_events, processor:CDP
[59324.452207] Exit:dla_handle_events, ret:0
[59324.452378] Enter:dla_handle_events, processor:RUBIK
[59324.452580] Exit:dla_handle_events, ret:0
[59399.127943] Enter:dla_handle_events, processor:BDMA
[59399.128224] Exit:dla_handle_events, ret:0
[59399.128404] Enter:dla_handle_events, processor:Convolution
[59399.128622] Handle cdma weight done event, processor Convolution group 0
[59399.128897] Handle cdma data done event, processor Convolution group 0
[59399.129159] Handle op complete event, processor Convolution group 0
[59399.129411] Enter:dla_op_completion processor Convolution group0
[59399.129654] Completed Convolution operation index 25 ROI 0
[59399.129900] 26 HWLs done, totally 42 layers
[59399.130086] Enter: dla_dequeue_operation
[59399.130260] Dequeue op from Convolution processor, index=30 ROI=0
[59399.130518] Enter: dla_submit_operation
[59399.130704] Prepare Convolution operation index 30 ROI 0 dep_count 2
[59399.130906] Enter: dla_prepare_operation
[59399.131065] processor:Convolution group:0, rdma_group:0 available
[59399.131190] Enter: dla_read_config
[59399.133324] Exit: dla_read_config
[59399.133506] Exit: dla_prepare_operation status=0
[59399.133717] Enter: dla_program_operation
[59399.133906] Program Convolution operation index 30 ROI 0 Group[0]
[59399.135672] no desc get due to index==-1
[59399.136093] no desc get due to index==-1
[59399.136288] no desc get due to index==-1
[59399.136486] no desc get due to index==-1
[59399.136655] no desc get due to index==-1
[59399.136826] Enter: dla_op_programmed
[59399.136986] Update dependency operation index 34 ROI 0 DEP_COUNT=3
[59399.137240] Update dependency operation index 31 ROI 0 DEP_COUNT=2
[59399.137512] Exit: dla_op_programmed
[59399.137688] Exit: dla_program_operation status=0
[59399.137896] Exit: dla_submit_operation
[59399.138075] Exit: dla_dequeue_operation
[59399.138252] Exit:dla_op_completion processor Convolution group0 status=0
[59399.138531] Exit:dla_handle_events, ret:0
[59399.138703] Enter:dla_handle_events, processor:SDP
[59399.138904] Handle op complete event, processor SDP group 1
[59399.139158] Enter:dla_op_completion processor SDP group1
[59399.139392] Completed SDP operation index 26 ROI 0
[59399.139609] Update dependency operation index 27 ROI 0 DEP_COUNT=1
[59399.139876] enable SDP in dla_update_dependency as depdency are resolved
[59399.140135] Enter: dla_enable_operation
[59399.140312] Enable SDP operation index 27 ROI 0
[59399.140661] Enter: dla_op_enabled
[59399.140857] Exit: dla_op_enabled
[59399.141014] Exit: dla_enable_operation status=0
[59399.141214] 27 HWLs done, totally 42 layers
[59399.141408] Enter: dla_free_op_desc op desc index 25 ROI 0
[59399.155534] Exit: dla_free_op_desc
[59399.155647] Enter: dla_dequeue_operation
[59399.155736] Dequeue op from SDP processor, index=29 ROI=0
[59399.155852] Enter: dla_submit_operation
[59399.155943] Prepare SDP operation index 29 ROI 0 dep_count 0
[59399.156054] Enter: dla_prepare_operation
[59399.157398] processor:SDP group:1, rdma_group:1 available
[59399.157513] Enter: dla_read_config
[59399.210692] Exit: dla_read_config
[59399.210861] Exit: dla_prepare_operation status=0
[59399.211058] Enter: dla_program_operation
[59399.211245] Program SDP operation index 29 ROI 0 Group[1]
[59399.222284] no desc get due to index==-1
[59399.222389] no desc get due to index==-1
[59399.222476] no desc get due to index==-1
[59399.222558] no desc get due to index==-1
[59399.222641] no desc get due to index==-1
[59399.222726] Enter: dla_op_programmed
[59399.222809] Update dependency operation index 31 ROI 0 DEP_COUNT=1
[59399.222922] enable SDP in dla_update_dependency as depdency are resolved
[59399.223042] Enter: dla_enable_operation
[59399.223126] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[59399.223290] Exit: dla_enable_operation status=0
[59399.223383] Exit: dla_op_programmed
[59399.223461] Exit: dla_program_operation status=0
[59399.223555] Enter: dla_enable_operation
[59399.223641] Enable SDP operation index 29 ROI 0
[59399.224487] Enter: dla_op_enabled
[59399.224583] Update dependency operation index 28 ROI 0 DEP_COUNT=2
[59399.224701] Exit: dla_op_enabled
[59399.224778] Exit: dla_enable_operation status=0
[59399.224870] Exit: dla_submit_operation
[59399.224964] Exit: dla_dequeue_operation
[59399.225057] Enter: dla_free_op_desc op desc index 26 ROI 0
[59399.227847] Exit: dla_free_op_desc
[59399.228016] Exit:dla_op_completion processor SDP group1 status=0
[59399.228252] Exit:dla_handle_events, ret:0
[59399.228427] Enter:dla_handle_events, processor:PDP
[59399.228633] Exit:dla_handle_events, ret:0
[59399.228815] Enter:dla_handle_events, processor:CDP
[59399.229026] Exit:dla_handle_events, ret:0
[59399.229188] Enter:dla_handle_events, processor:RUBIK
[59399.229376] Exit:dla_handle_events, ret:0
[59400.291741] Enter:dla_handle_events, processor:BDMA
[59400.291932] Exit:dla_handle_events, ret:0
[59400.292025] Enter:dla_handle_events, processor:Convolution
[59400.292137] Exit:dla_handle_events, ret:0
[59400.292225] Enter:dla_handle_events, processor:SDP
[59400.292327] Handle op complete event, processor SDP group 0
[59400.292440] Enter:dla_op_completion processor SDP group0
[59400.292550] Completed SDP operation index 27 ROI 0
[59400.292657] Update dependency operation index 28 ROI 0 DEP_COUNT=1
[59400.292776] enable Convolution in dla_update_dependency as depdency are resolved
[59400.292928] Enter: dla_enable_operation
[59400.293014] Enable Convolution operation index 28 ROI 0
[59400.293407] Enter: dla_op_enabled
[59400.293570] Exit: dla_op_enabled
[59400.293712] Exit: dla_enable_operation status=0
[59400.293910] 28 HWLs done, totally 42 layers
[59400.294087] Enter: dla_dequeue_operation
[59400.294263] Dequeue op from SDP processor, index=31 ROI=0
[59400.294508] Enter: dla_submit_operation
[59400.294710] Prepare SDP operation index 31 ROI 0 dep_count 0
[59400.294948] Enter: dla_prepare_operation
[59400.332529] processor:SDP group:0, rdma_group:0 available
[59400.332691] Enter: dla_read_config
[59400.355818] Exit: dla_read_config
[59400.356028] Exit: dla_prepare_operation status=0
[59400.356241] Enter: dla_program_operation
[59400.356424] Program SDP operation index 31 ROI 0 Group[0]
[59400.361975] no desc get due to index==-1
[59400.362086] no desc get due to index==-1
[59400.363144] no desc get due to index==-1
[59400.363370] no desc get due to index==-1
[59400.363555] no desc get due to index==-1
[59400.363740] Enter: dla_op_programmed
[59400.363916] Exit: dla_op_programmed
[59400.364073] Exit: dla_program_operation status=0
[59400.364275] Enter: dla_enable_operation
[59400.364446] Enable SDP operation index 31 ROI 0
[59400.365105] Enter: dla_op_enabled
[59400.365269] Update dependency operation index 30 ROI 0 DEP_COUNT=2
[59400.365511] Exit: dla_op_enabled
[59400.365661] Exit: dla_enable_operation status=0
[59400.365858] Exit: dla_submit_operation
[59400.366024] Exit: dla_dequeue_operation
[59400.366201] Enter: dla_free_op_desc op desc index 27 ROI 0
[59400.367401] Exit: dla_free_op_desc
[59400.367568] Exit:dla_op_completion processor SDP group0 status=0
[59400.367814] Exit:dla_handle_events, ret:0
[59400.367993] Enter:dla_handle_events, processor:PDP
[59400.368192] Exit:dla_handle_events, ret:0
[59400.368368] Enter:dla_handle_events, processor:CDP
[59400.368570] Exit:dla_handle_events, ret:0
[59400.368742] Enter:dla_handle_events, processor:RUBIK
[59400.368950] Exit:dla_handle_events, ret:0
[59455.217766] Enter:dla_handle_events, processor:BDMA
[59455.218069] Exit:dla_handle_events, ret:0
[59455.218257] Enter:dla_handle_events, processor:Convolution
[59455.218514] Handle cdma weight done event, processor Convolution group 1
[59455.218736] Handle cdma data done event, processor Convolution group 1
[59455.218875] Handle op complete event, processor Convolution group 1
[59455.218996] Enter:dla_op_completion processor Convolution group1
[59455.219115] Completed Convolution operation index 28 ROI 0
[59455.219226] Update dependency operation index 30 ROI 0 DEP_COUNT=1
[59455.219339] enable Convolution in dla_update_dependency as depdency are resolved
[59455.219500] Enter: dla_enable_operation
[59455.219589] Enable Convolution operation index 30 ROI 0
[59455.219969] Enter: dla_op_enabled
[59455.220055] Exit: dla_op_enabled
[59455.220139] Exit: dla_enable_operation status=0
[59455.220236] 29 HWLs done, totally 42 layers
[59455.220328] Enter: dla_dequeue_operation
[59455.220416] Dequeue op from Convolution processor, index=34 ROI=0
[59455.220533] Enter: dla_submit_operation
[59455.220620] Prepare Convolution operation index 34 ROI 0 dep_count 2
[59455.220738] Enter: dla_prepare_operation
[59455.229922] processor:Convolution group:1, rdma_group:0 available
[59455.230054] Enter: dla_read_config
[59455.280163] Exit: dla_read_config
[59455.280390] Exit: dla_prepare_operation status=0
[59455.280598] Enter: dla_program_operation
[59455.280772] Program Convolution operation index 34 ROI 0 Group[1]
[59455.308286] no desc get due to index==-1
[59455.311390] no desc get due to index==-1
[59455.311575] no desc get due to index==-1
[59455.311744] no desc get due to index==-1
[59455.311930] no desc get due to index==-1
[59455.312104] Enter: dla_op_programmed
[59455.312282] Update dependency operation index 37 ROI 0 DEP_COUNT=3
[59455.312540] Update dependency operation index 35 ROI 0 DEP_COUNT=2
[59455.312808] Exit: dla_op_programmed
[59455.312965] Exit: dla_program_operation status=0
[59455.313161] Exit: dla_submit_operation
[59455.313327] Exit: dla_dequeue_operation
[59455.313499] Exit:dla_op_completion processor Convolution group1 status=0
[59455.313761] Exit:dla_handle_events, ret:0
[59455.313935] Enter:dla_handle_events, processor:SDP
[59455.314137] Handle op complete event, processor SDP group 1
[59455.314366] Enter:dla_op_completion processor SDP group1
[59455.314582] Completed SDP operation index 29 ROI 0
[59455.314791] 30 HWLs done, totally 42 layers
[59455.314976] Enter: dla_free_op_desc op desc index 28 ROI 0
[59455.318696] Exit: dla_free_op_desc
[59455.318796] Enter: dla_dequeue_operation
[59455.318896] Dequeue op from SDP processor, index=32 ROI=0
[59455.319000] Enter: dla_submit_operation
[59455.319087] Prepare SDP operation index 32 ROI 0 dep_count 1
[59455.319194] Enter: dla_prepare_operation
[59455.320810] processor:SDP group:1, rdma_group:1 available
[59455.345544] Enter: dla_read_config
[59455.403022] Exit: dla_read_config
[59455.403122] Exit: dla_prepare_operation status=0
[59455.403220] Enter: dla_program_operation
[59455.403309] Program SDP operation index 32 ROI 0 Group[1]
[59455.412093] no desc get due to index==-1
[59455.412197] no desc get due to index==-1
[59455.412284] no desc get due to index==-1
[59455.412367] no desc get due to index==-1
[59455.412448] no desc get due to index==-1
[59455.412531] Enter: dla_op_programmed
[59455.412613] Update dependency operation index 35 ROI 0 DEP_COUNT=1
[59455.412726] enable SDP in dla_update_dependency as depdency are resolved
[59455.412843] Enter: dla_enable_operation
[59455.412928] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[59455.413090] Exit: dla_enable_operation status=0
[59455.413182] Exit: dla_op_programmed
[59455.413262] Exit: dla_program_operation status=0
[59455.413354] Exit: dla_submit_operation
[59455.413438] Exit: dla_dequeue_operation
[59455.413525] Enter: dla_free_op_desc op desc index 29 ROI 0
[59455.415667] Exit: dla_free_op_desc
[59455.415761] Exit:dla_op_completion processor SDP group1 status=0
[59455.415876] Exit:dla_handle_events, ret:0
[59455.415962] Enter:dla_handle_events, processor:PDP
[59455.416057] Exit:dla_handle_events, ret:0
[59455.416143] Enter:dla_handle_events, processor:CDP
[59455.416237] Exit:dla_handle_events, ret:0
[59455.416322] Enter:dla_handle_events, processor:RUBIK
[59455.416419] Exit:dla_handle_events, ret:0
[59510.548146] Enter:dla_handle_events, processor:BDMA
[59510.548442] Exit:dla_handle_events, ret:0
[59510.548741] Enter:dla_handle_events, processor:Convolution
[59510.549100] Handle cdma weight done event, processor Convolution group 0
[59510.549374] Handle cdma data done event, processor Convolution group 0
[59510.549633] Handle op complete event, processor Convolution group 0
[59510.549877] Enter:dla_op_completion processor Convolution group0
[59510.550121] Completed Convolution operation index 30 ROI 0
[59510.550361] 31 HWLs done, totally 42 layers
[59510.550550] Enter: dla_dequeue_operation
[59510.550758] Dequeue op from Convolution processor, index=37 ROI=0
[59510.550998] Enter: dla_submit_operation
[59510.551166] Prepare Convolution operation index 37 ROI 0 dep_count 2
[59510.551405] Enter: dla_prepare_operation
[59510.551652] processor:Convolution group:0, rdma_group:0 available
[59510.551895] Enter: dla_read_config
[59510.553787] Exit: dla_read_config
[59510.553966] Exit: dla_prepare_operation status=0
[59510.554171] Enter: dla_program_operation
[59510.554360] Program Convolution operation index 37 ROI 0 Group[0]
[59510.555813] no desc get due to index==-1
[59510.556143] no desc get due to index==-1
[59510.556346] no desc get due to index==-1
[59510.556516] no desc get due to index==-1
[59510.556685] no desc get due to index==-1
[59510.556860] Enter: dla_op_programmed
[59510.557024] Update dependency operation index 40 ROI 0 DEP_COUNT=3
[59510.557282] Update dependency operation index 38 ROI 0 DEP_COUNT=2
[59510.557534] Exit: dla_op_programmed
[59510.557689] Exit: dla_program_operation status=0
[59510.557883] Exit: dla_submit_operation
[59510.558049] Exit: dla_dequeue_operation
[59510.558217] Exit:dla_op_completion processor Convolution group0 status=0
[59510.558492] Exit:dla_handle_events, ret:0
[59510.558661] Enter:dla_handle_events, processor:SDP
[59510.558862] Handle op complete event, processor SDP group 0
[59510.559085] Enter:dla_op_completion processor SDP group0
[59510.559302] Completed SDP operation index 31 ROI 0
[59510.559501] Update dependency operation index 32 ROI 0 DEP_COUNT=1
[59510.559740] enable SDP in dla_update_dependency as depdency are resolved
[59510.560003] Enter: dla_enable_operation
[59510.560179] Enable SDP operation index 32 ROI 0
[59510.560473] Enter: dla_op_enabled
[59510.560631] Exit: dla_op_enabled
[59510.560772] Exit: dla_enable_operation status=0
[59510.560962] 32 HWLs done, totally 42 layers
[59510.585807] Enter: dla_free_op_desc op desc index 30 ROI 0
[59510.596905] Exit: dla_free_op_desc
[59510.597084] Enter: dla_dequeue_operation
[59510.597266] Dequeue op from SDP processor, index=35 ROI=0
[59510.597515] Enter: dla_submit_operation
[59510.597700] Prepare SDP operation index 35 ROI 0 dep_count 0
[59510.597941] Enter: dla_prepare_operation
[59510.599371] processor:SDP group:0, rdma_group:0 available
[59510.599489] Enter: dla_read_config
[59510.659166] Exit: dla_read_config
[59510.659312] Exit: dla_prepare_operation status=0
[59510.659409] Enter: dla_program_operation
[59510.659498] Program SDP operation index 35 ROI 0 Group[0]
[59510.678936] no desc get due to index==-1
[59510.679052] no desc get due to index==-1
[59510.684381] no desc get due to index==-1
[59510.684483] no desc get due to index==-1
[59510.684568] no desc get due to index==-1
[59510.684654] Enter: dla_op_programmed
[59510.684737] Exit: dla_op_programmed
[59510.684818] Exit: dla_program_operation status=0
[59510.684911] Enter: dla_enable_operation
[59510.684997] Enable SDP operation index 35 ROI 0
[59510.686506] Enter: dla_op_enabled
[59510.686623] Update dependency operation index 34 ROI 0 DEP_COUNT=2
[59510.686740] Exit: dla_op_enabled
[59510.686823] Exit: dla_enable_operation status=0
[59510.686916] Exit: dla_submit_operation
[59510.687001] Exit: dla_dequeue_operation
[59510.687108] Enter: dla_free_op_desc op desc index 31 ROI 0
[59510.705152] Exit: dla_free_op_desc
[59510.705258] Exit:dla_op_completion processor SDP group0 status=0
[59510.705375] Exit:dla_handle_events, ret:0
[59510.705483] Enter:dla_handle_events, processor:PDP
[59510.705582] Exit:dla_handle_events, ret:0
[59510.705683] Enter:dla_handle_events, processor:CDP
[59510.705780] Exit:dla_handle_events, ret:0
[59510.705866] Enter:dla_handle_events, processor:RUBIK
[59510.705968] Exit:dla_handle_events, ret:0
[59511.366138] Enter:dla_handle_events, processor:BDMA
[59511.366322] Exit:dla_handle_events, ret:0
[59511.366421] Enter:dla_handle_events, processor:Convolution
[59511.366532] Exit:dla_handle_events, ret:0
[59511.366674] Enter:dla_handle_events, processor:SDP
[59511.366822] Handle op complete event, processor SDP group 1
[59511.366943] Enter:dla_op_completion processor SDP group1
[59511.367068] Completed SDP operation index 32 ROI 0
[59511.367179] Update dependency operation index 33 ROI 0 DEP_COUNT=1
[59511.367314] enable PDP in dla_update_dependency as depdency are resolved
[59511.367444] Enter: dla_enable_operation
[59511.367556] Enable PDP operation index 33 ROI 0
[59511.367657] group id 1 rdma id 1
[59511.367823] rdma needed 1
[59511.368040] Enter: dla_op_enabled
[59511.368206] Exit: dla_op_enabled
[59511.368371] Exit: dla_enable_operation status=0
[59511.368571] 33 HWLs done, totally 42 layers
[59511.368755] Enter: dla_dequeue_operation
[59511.368930] Dequeue op from SDP processor, index=36 ROI=0
[59511.369158] Enter: dla_submit_operation
[59511.369320] Prepare SDP operation index 36 ROI 0 dep_count 1
[59511.369559] Enter: dla_prepare_operation
[59511.378786] processor:SDP group:1, rdma_group:1 available
[59511.378915] Enter: dla_read_config
[59511.445776] Exit: dla_read_config
[59511.445999] Exit: dla_prepare_operation status=0
[59511.446198] Enter: dla_program_operation
[59511.446370] Program SDP operation index 36 ROI 0 Group[1]
[59511.460771] no desc get due to index==-1
[59511.460986] no desc get due to index==-1
[59511.461172] no desc get due to index==-1
[59511.461355] no desc get due to index==-1
[59511.461538] no desc get due to index==-1
[59511.461721] Enter: dla_op_programmed
[59511.461898] Update dependency operation index 38 ROI 0 DEP_COUNT=1
[59511.462146] enable SDP in dla_update_dependency as depdency are resolved
[59511.462415] Enter: dla_enable_operation
[59511.462586] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[59511.462942] Exit: dla_enable_operation status=0
[59511.463136] Exit: dla_op_programmed
[59511.463301] Exit: dla_program_operation status=0
[59511.463503] Exit: dla_submit_operation
[59511.463670] Exit: dla_dequeue_operation
[59511.463845] Enter: dla_free_op_desc op desc index 32 ROI 0
[59511.466638] Exit: dla_free_op_desc
[59511.466819] Exit:dla_op_completion processor SDP group1 status=0
[59511.467070] Exit:dla_handle_events, ret:0
[59511.467245] Enter:dla_handle_events, processor:PDP
[59511.467450] Exit:dla_handle_events, ret:0
[59511.467616] Enter:dla_handle_events, processor:CDP
[59511.467812] Exit:dla_handle_events, ret:0
[59511.467987] Enter:dla_handle_events, processor:RUBIK
[59511.468184] Exit:dla_handle_events, ret:0
[59512.339596] Enter:dla_handle_events, processor:BDMA
[59512.339790] Exit:dla_handle_events, ret:0
[59512.339900] Enter:dla_handle_events, processor:Convolution
[59512.340010] Exit:dla_handle_events, ret:0
[59512.340103] Enter:dla_handle_events, processor:SDP
[59512.340202] Exit:dla_handle_events, ret:0
[59512.340288] Enter:dla_handle_events, processor:PDP
[59512.340406] Handle op complete event, processor PDP group 1
[59512.340519] Enter:dla_op_completion processor PDP group1
[59512.340643] Completed PDP operation index 33 ROI 0
[59512.340755] Update dependency operation index 34 ROI 0 DEP_COUNT=1
[59512.340875] enable Convolution in dla_update_dependency as depdency are resolved
[59512.341013] Enter: dla_enable_operation
[59512.341117] Enable Convolution operation index 34 ROI 0
[59512.341551] Enter: dla_op_enabled
[59512.341731] Exit: dla_op_enabled
[59512.341899] Exit: dla_enable_operation status=0
[59512.342107] 34 HWLs done, totally 42 layers
[59512.342299] Enter: dla_dequeue_operation
[59512.342478] exit PDP as there's no further operation
[59512.343000] Exit: dla_dequeue_operation
[59512.343215] Enter: dla_free_op_desc op desc index 33 ROI 0
[59512.378489] Exit: dla_free_op_desc
[59512.378641] Exit:dla_op_completion processor PDP group1 status=0
[59512.378758] Exit:dla_handle_events, ret:0
[59512.378845] Enter:dla_handle_events, processor:CDP
[59512.378942] Exit:dla_handle_events, ret:0
[59512.379028] Enter:dla_handle_events, processor:RUBIK
[59512.379126] Exit:dla_handle_events, ret:0
[59946.827459] Enter:dla_handle_events, processor:BDMA
[59946.827768] Exit:dla_handle_events, ret:0
[59946.827964] Enter:dla_handle_events, processor:Convolution
[59946.828196] Handle cdma weight done event, processor Convolution group 1
[59946.828469] Handle cdma data done event, processor Convolution group 1
[59946.828721] Handle op complete event, processor Convolution group 1
[59946.828978] Enter:dla_op_completion processor Convolution group1
[59946.829223] Completed Convolution operation index 34 ROI 0
[59946.829456] 35 HWLs done, totally 42 layers
[59946.829639] Enter: dla_dequeue_operation
[59946.829812] Dequeue op from Convolution processor, index=40 ROI=0
[59946.830057] Enter: dla_submit_operation
[59946.830234] Prepare Convolution operation index 40 ROI 0 dep_count 2
[59946.830486] Enter: dla_prepare_operation
[59946.830741] processor:Convolution group:1, rdma_group:0 available
[59946.831011] Enter: dla_read_config
[59946.832703] Exit: dla_read_config
[59946.832868] Exit: dla_prepare_operation status=0
[59946.833058] Enter: dla_program_operation
[59946.833235] Program Convolution operation index 40 ROI 0 Group[1]
[59946.835122] no desc get due to index==-1
[59946.835228] no desc get due to index==-1
[59946.835479] no desc get due to index==-1
[59946.835700] no desc get due to index==-1
[59946.835868] no desc get due to index==-1
[59946.836032] no desc get due to index==-1
[59946.836203] Enter: dla_op_programmed
[59946.836367] Update dependency operation index 41 ROI 0 DEP_COUNT=2
[59946.836604] Exit: dla_op_programmed
[59946.836762] Exit: dla_program_operation status=0
[59946.836963] Exit: dla_submit_operation
[59946.837126] Exit: dla_dequeue_operation
[59946.837300] Exit:dla_op_completion processor Convolution group1 status=0
[59946.837563] Exit:dla_handle_events, ret:0
[59946.837739] Enter:dla_handle_events, processor:SDP
[59946.837948] Handle op complete event, processor SDP group 0
[59946.838169] Enter:dla_op_completion processor SDP group0
[59946.838398] Completed SDP operation index 35 ROI 0
[59946.838609] Update dependency operation index 36 ROI 0 DEP_COUNT=1
[59946.838857] enable SDP in dla_update_dependency as depdency are resolved
[59946.839112] Enter: dla_enable_operation
[59946.839287] Enable SDP operation index 36 ROI 0
[59946.839584] Enter: dla_op_enabled
[59946.839751] Exit: dla_op_enabled
[59946.839906] Exit: dla_enable_operation status=0
[59946.840100] 36 HWLs done, totally 42 layers
[59946.840288] Enter: dla_free_op_desc op desc index 34 ROI 0
[59946.843277] Exit: dla_free_op_desc
[59946.843374] Enter: dla_dequeue_operation
[59946.843465] Dequeue op from SDP processor, index=38 ROI=0
[59946.843569] Enter: dla_submit_operation
[59946.843657] Prepare SDP operation index 38 ROI 0 dep_count 0
[59946.843773] Enter: dla_prepare_operation
[59946.845122] processor:SDP group:0, rdma_group:0 available
[59946.845239] Enter: dla_read_config
[59946.914231] Exit: dla_read_config
[59946.914424] Exit: dla_prepare_operation status=0
[59946.914636] Enter: dla_program_operation
[59946.914820] Program SDP operation index 38 ROI 0 Group[0]
[59946.926807] no desc get due to index==-1
[59946.926912] no desc get due to index==-1
[59946.931751] no desc get due to index==-1
[59946.931853] no desc get due to index==-1
[59946.931944] no desc get due to index==-1
[59946.932030] Enter: dla_op_programmed
[59946.932112] Exit: dla_op_programmed
[59946.932193] Exit: dla_program_operation status=0
[59946.932288] Enter: dla_enable_operation
[59946.932375] Enable SDP operation index 38 ROI 0
[59946.932579] Enter: dla_op_enabled
[59946.932673] Update dependency operation index 37 ROI 0 DEP_COUNT=2
[59946.932786] Exit: dla_op_enabled
[59946.932863] Exit: dla_enable_operation status=0
[59946.932956] Exit: dla_submit_operation
[59946.933039] Exit: dla_dequeue_operation
[59946.933128] Enter: dla_free_op_desc op desc index 35 ROI 0
[59946.934552] Exit: dla_free_op_desc
[59946.934753] Exit:dla_op_completion processor SDP group0 status=0
[59946.935034] Exit:dla_handle_events, ret:0
[59946.935220] Enter:dla_handle_events, processor:PDP
[59946.935419] Exit:dla_handle_events, ret:0
[59946.935586] Enter:dla_handle_events, processor:CDP
[59946.935788] Exit:dla_handle_events, ret:0
[59946.935967] Enter:dla_handle_events, processor:RUBIK
[59946.936169] Exit:dla_handle_events, ret:0
[59946.945201] Enter:dla_handle_events, processor:BDMA
[59946.945452] Exit:dla_handle_events, ret:0
[59946.945626] Enter:dla_handle_events, processor:Convolution
[59946.945849] Exit:dla_handle_events, ret:0
[59946.946012] Enter:dla_handle_events, processor:SDP
[59946.946211] Handle op complete event, processor SDP group 1
[59946.946446] Enter:dla_op_completion processor SDP group1
[59946.946683] Completed SDP operation index 36 ROI 0
[59946.946887] Update dependency operation index 37 ROI 0 DEP_COUNT=1
[59946.947134] enable Convolution in dla_update_dependency as depdency are resolved
[59946.947432] Enter: dla_enable_operation
[59946.947592] Enable Convolution operation index 37 ROI 0
[59946.948708] Enter: dla_op_enabled
[59946.948878] Exit: dla_op_enabled
[59946.949028] Exit: dla_enable_operation status=0
[59946.949224] 37 HWLs done, totally 42 layers
[59946.949407] Enter: dla_dequeue_operation
[59946.949582] Dequeue op from SDP processor, index=39 ROI=0
[59946.949809] Enter: dla_submit_operation
[59946.949976] Prepare SDP operation index 39 ROI 0 dep_count 1
[59946.950207] Enter: dla_prepare_operation
[59946.980247] processor:SDP group:1, rdma_group:1 available
[59946.980397] Enter: dla_read_config
[59946.999588] Exit: dla_read_config
[59946.999759] Exit: dla_prepare_operation status=0
[59946.999958] Enter: dla_program_operation
[59947.000137] Program SDP operation index 39 ROI 0 Group[1]
[59947.005033] no desc get due to index==-1
[59947.015052] no desc get due to index==-1
[59947.015157] no desc get due to index==-1
[59947.015247] no desc get due to index==-1
[59947.015335] no desc get due to index==-1
[59947.015424] Enter: dla_op_programmed
[59947.015521] Update dependency operation index 41 ROI 0 DEP_COUNT=1
[59947.015637] enable SDP in dla_update_dependency as depdency are resolved
[59947.015760] Enter: dla_enable_operation
[59947.015846] exit dla_enable_operation without actual enable due to processor hasn't been programmed
[59947.016012] Exit: dla_enable_operation status=0
[59947.016106] Exit: dla_op_programmed
[59947.016188] Exit: dla_program_operation status=0
[59947.016281] Exit: dla_submit_operation
[59947.016368] Exit: dla_dequeue_operation
[59947.016459] Enter: dla_free_op_desc op desc index 36 ROI 0
[59947.017504] Exit: dla_free_op_desc
[59947.017614] Exit:dla_op_completion processor SDP group1 status=0
[59947.017737] Exit:dla_handle_events, ret:0
[59947.017827] Enter:dla_handle_events, processor:PDP
[59947.017928] Exit:dla_handle_events, ret:0
[59947.018017] Enter:dla_handle_events, processor:CDP
[59947.018119] Exit:dla_handle_events, ret:0
[59947.018208] Enter:dla_handle_events, processor:RUBIK
[59947.018322] Exit:dla_handle_events, ret:0
[59947.070190] Enter:dla_handle_events, processor:BDMA
[59947.070362] Exit:dla_handle_events, ret:0
[59947.070450] Enter:dla_handle_events, processor:Convolution
[59947.070555] Handle cdma data done event, processor Convolution group 0
[59947.070702] Exit:dla_handle_events, ret:0
[59947.070793] Enter:dla_handle_events, processor:SDP
[59947.070891] Exit:dla_handle_events, ret:0
[59947.070975] Enter:dla_handle_events, processor:PDP
[59947.071070] Exit:dla_handle_events, ret:0
[59947.071156] Enter:dla_handle_events, processor:CDP
[59947.071252] Exit:dla_handle_events, ret:0
[59947.071336] Enter:dla_handle_events, processor:RUBIK
[59947.071435] Exit:dla_handle_events, ret:0
[60140.966260] Enter:dla_handle_events, processor:BDMA
[60140.966589] Exit:dla_handle_events, ret:0
[60140.966754] Enter:dla_handle_events, processor:Convolution
[60140.966869] Handle cdma weight done event, processor Convolution group 0
[60140.966999] Handle op complete event, processor Convolution group 0
[60140.967117] Enter:dla_op_completion processor Convolution group0
[60140.967230] Completed Convolution operation index 37 ROI 0
[60140.967340] 38 HWLs done, totally 42 layers
[60140.967433] Enter: dla_dequeue_operation
[60140.967517] exit Convolution as there's no further operation
[60140.967623] Exit: dla_dequeue_operation
[60140.967712] Exit:dla_op_completion processor Convolution group0 status=0
[60140.967834] Exit:dla_handle_events, ret:0
[60140.967918] Enter:dla_handle_events, processor:SDP
[60140.968015] Handle op complete event, processor SDP group 0
[60140.968123] Enter:dla_op_completion processor SDP group0
[60140.968228] Completed SDP operation index 38 ROI 0
[60140.968328] Update dependency operation index 39 ROI 0 DEP_COUNT=1
[60140.968443] enable SDP in dla_update_dependency as depdency are resolved
[60140.968563] Enter: dla_enable_operation
[60140.968650] Enable SDP operation index 39 ROI 0
[60140.968872] Enter: dla_op_enabled
[60140.969051] Exit: dla_op_enabled
[60140.969200] Exit: dla_enable_operation status=0
[60140.969394] 39 HWLs done, totally 42 layers
[60140.969568] Enter: dla_free_op_desc op desc index 37 ROI 0
[60140.979566] Exit: dla_free_op_desc
[60140.979663] Enter: dla_dequeue_operation
[60140.979752] Dequeue op from SDP processor, index=41 ROI=0
[60140.979858] Enter: dla_submit_operation
[60140.979944] Prepare SDP operation index 41 ROI 0 dep_count 0
[60140.980049] Enter: dla_prepare_operation
[60140.981344] processor:SDP group:0, rdma_group:0 available
[60140.981460] Enter: dla_read_config
[60141.038714] Exit: dla_read_config
[60141.038905] Exit: dla_prepare_operation status=0
[60141.039109] Enter: dla_program_operation
[60141.039285] Program SDP operation index 41 ROI 0 Group[0]
[60141.049419] no desc get due to index==-1
[60141.049616] no desc get due to index==-1
[60141.049789] no desc get due to index==-1
[60141.049958] no desc get due to index==-1
[60141.050123] no desc get due to index==-1
[60141.050297] no desc get due to index==-1
[60141.050466] Enter: dla_op_programmed
[60141.050629] Exit: dla_op_programmed
[60141.050782] Exit: dla_program_operation status=0
[60141.050972] Enter: dla_enable_operation
[60141.051139] Enable SDP operation index 41 ROI 0
[60141.051458] Enter: dla_op_enabled
[60141.051631] Update dependency operation index 40 ROI 0 DEP_COUNT=2
[60141.051873] Exit: dla_op_enabled
[60141.052021] Exit: dla_enable_operation status=0
[60141.052210] Exit: dla_submit_operation
[60141.052369] Exit: dla_dequeue_operation
[60141.052545] Enter: dla_free_op_desc op desc index 38 ROI 0
[60141.054903] Exit: dla_free_op_desc
[60141.055002] Exit:dla_op_completion processor SDP group0 status=0
[60141.055119] Exit:dla_handle_events, ret:0
[60141.055206] Enter:dla_handle_events, processor:PDP
[60141.055301] Exit:dla_handle_events, ret:0
[60141.055386] Enter:dla_handle_events, processor:CDP
[60141.055481] Exit:dla_handle_events, ret:0
[60141.055567] Enter:dla_handle_events, processor:RUBIK
[60141.055664] Exit:dla_handle_events, ret:0
[60141.067058] Enter:dla_handle_events, processor:BDMA
[60141.067335] Exit:dla_handle_events, ret:0
[60141.067513] Enter:dla_handle_events, processor:Convolution
[60141.067736] Exit:dla_handle_events, ret:0
[60141.067911] Enter:dla_handle_events, processor:SDP
[60141.068107] Handle op complete event, processor SDP group 1
[60141.068328] Enter:dla_op_completion processor SDP group1
[60141.068550] Completed SDP operation index 39 ROI 0
[60141.068759] Update dependency operation index 40 ROI 0 DEP_COUNT=1
[60141.069000] enable Convolution in dla_update_dependency as depdency are resolved
[60141.069299] Enter: dla_enable_operation
[60141.069466] Enable Convolution operation index 40 ROI 0
[60141.069928] Enter: dla_op_enabled
[60141.070022] Exit: dla_op_enabled
[60141.070101] Exit: dla_enable_operation status=0
[60141.070197] 40 HWLs done, totally 42 layers
[60141.070295] Enter: dla_dequeue_operation
[60141.070382] exit SDP as there's no further operation
[60141.070478] Exit: dla_dequeue_operation
[60141.070564] Enter: dla_free_op_desc op desc index 39 ROI 0
[60141.103770] Exit: dla_free_op_desc
[60141.103912] Exit:dla_op_completion processor SDP group1 status=0
[60141.104027] Exit:dla_handle_events, ret:0
[60141.104113] Enter:dla_handle_events, processor:PDP
[60141.104208] Exit:dla_handle_events, ret:0
[60141.104292] Enter:dla_handle_events, processor:CDP
[60141.104389] Exit:dla_handle_events, ret:0
[60141.104474] Enter:dla_handle_events, processor:RUBIK
[60141.104571] Exit:dla_handle_events, ret:0
[60141.215488] Enter:dla_handle_events, processor:BDMA
[60141.215652] Exit:dla_handle_events, ret:0
[60141.215741] Enter:dla_handle_events, processor:Convolution
[60141.232669] Handle cdma data done event, processor Convolution group 1
[60141.232814] Exit:dla_handle_events, ret:0
[60141.232903] Enter:dla_handle_events, processor:SDP
[60141.232998] Exit:dla_handle_events, ret:0
[60141.233084] Enter:dla_handle_events, processor:PDP
[60141.233181] Exit:dla_handle_events, ret:0
[60141.233265] Enter:dla_handle_events, processor:CDP
[60141.233362] Exit:dla_handle_events, ret:0
[60141.233447] Enter:dla_handle_events, processor:RUBIK
[60141.233544] Exit:dla_handle_events, ret:0
[60188.343525] Enter:dla_handle_events, processor:BDMA
[60188.343852] Exit:dla_handle_events, ret:0
[60188.344042] Enter:dla_handle_events, processor:Convolution
[60188.344281] Handle cdma weight done event, processor Convolution group 1
[60188.344555] Handle op complete event, processor Convolution group 1
[60188.344797] Enter:dla_op_completion processor Convolution group1
[60188.345029] Completed Convolution operation index 40 ROI 0
[60188.345385] 41 HWLs done, totally 42 layers
[60188.345575] Enter: dla_dequeue_operation
[60188.345751] exit Convolution as there's no further operation
[60188.345985] Exit: dla_dequeue_operation
[60188.346157] Exit:dla_op_completion processor Convolution group1 status=0
[60188.346417] Exit:dla_handle_events, ret:0
[60188.346591] Enter:dla_handle_events, processor:SDP
[60188.346823] Handle op complete event, processor SDP group 0
[60188.347048] Enter:dla_op_completion processor SDP group0
[60188.347264] Completed SDP operation index 41 ROI 0
[60188.347468] 42 HWLs done, totally 42 layers
[60188.347656] Enter: dla_free_op_desc op desc index 40 ROI 0
[60188.348209] Exit: dla_free_op_desc
[60188.348375] Enter: dla_free_op_desc op desc index 41 ROI 0
[60188.348892] Exit: dla_free_op_desc
[60188.349055] Exit:dla_op_completion processor SDP group0 status=0
[60188.349294] Exit:dla_handle_events, ret:0
[60188.349472] Enter:dla_handle_events, processor:PDP
[60188.349671] Exit:dla_handle_events, ret:0
[60188.349843] Enter:dla_handle_events, processor:CDP
[60188.350043] Exit:dla_handle_events, ret:0
[60188.350219] Enter:dla_handle_events, processor:RUBIK
[60188.350431] Exit:dla_handle_events, ret:0
[60188.354058] reset engine done
Test pass

prasshantg · 2018-03-07T05:24:38Z

@yirs2001 We tried to reproduce it but do not observe rcu_preempt warnings. It could be some system limitation on which you are running VP. But I suppose this should not impact output of test.

JunningWu · 2018-03-11T01:10:50Z

@yirs2001 Same as U, I am using Ubuntu14.04 on VMware, can you share more information about your platform?

yirs2001 · 2018-03-11T23:47:19Z

@JunningWu , PC with OS ubuntu 14.04, run the test on docker

unlimt · 2018-03-14T03:26:59Z

I had the same error on my PC with Ubuntu 16.04
You could find "INFO: rcu_preempt self-detected stall on CPU" log on line #372 and #1866

nvdla_run_alexnet.zip

prasshantg · 2018-03-14T05:09:07Z

Looking into it, will get back by 03/21.

prasshantg · 2018-06-07T16:54:12Z

@unlimt @yirs2001 @JunningWu

hey guys,

we have been profiling virtual platform and trying to reproduce this issue but no success. is this issue blocking any of you? if no, we would like to close this issue and open separate low priority issue for RCU preemption message.

prasshantg · 2018-07-12T05:51:59Z

We have improved memory transaction interface in VP and it should resolve this issue. Please try latest VP, you need to fetch and rebuild it.

prasshantg added the bug label Feb 7, 2018

prasshantg self-assigned this Feb 7, 2018

prasshantg mentioned this issue Feb 7, 2018

[U May Need It]nvdla_runtime options #9

Closed

prasshantg closed this as completed Jul 12, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Run compiled AlexNet on VP #21

Run compiled AlexNet on VP #21

prasshantg commented Feb 7, 2018

JunningWu commented Feb 9, 2018

prasshantg commented Feb 9, 2018

JunningWu commented Feb 12, 2018

prasshantg commented Feb 12, 2018

prasshantg commented Mar 5, 2018

yirs2001 commented Mar 6, 2018 •

edited

prasshantg commented Mar 6, 2018

yirs2001 commented Mar 7, 2018

prasshantg commented Mar 7, 2018

JunningWu commented Mar 11, 2018

yirs2001 commented Mar 11, 2018

unlimt commented Mar 14, 2018

prasshantg commented Mar 14, 2018

prasshantg commented Jun 7, 2018

prasshantg commented Jul 12, 2018

Run compiled AlexNet on VP #21

Run compiled AlexNet on VP #21

Comments

prasshantg commented Feb 7, 2018

JunningWu commented Feb 9, 2018

prasshantg commented Feb 9, 2018

JunningWu commented Feb 12, 2018

prasshantg commented Feb 12, 2018

prasshantg commented Mar 5, 2018

yirs2001 commented Mar 6, 2018 • edited

./nvdla_runtime --loadable alexnet.nvdla --image 227x227.jpg

prasshantg commented Mar 6, 2018

yirs2001 commented Mar 7, 2018

prasshantg commented Mar 7, 2018

JunningWu commented Mar 11, 2018

yirs2001 commented Mar 11, 2018

unlimt commented Mar 14, 2018

prasshantg commented Mar 14, 2018

prasshantg commented Jun 7, 2018

prasshantg commented Jul 12, 2018

yirs2001 commented Mar 6, 2018 •

edited