Have trouble registering an image stack with a template

[yuhany1024]

I have two image stacks. The size of them are 20482048600. I can get good results if I register each stack separately. However, if I register stack1 firstly and then use the average image of stack1(after registration) to register stack2. The alignment is pretty off.
Here's the average image of my stack1:

Here's the average image of my stack 2 after registration using the average of stack1:

I can get good results if I don't set template to register stack2.

I only used rigid motion correction. Here're my parameters:
NoRMCorreSetParms('d1',size(Y,1),'d2',size(Y,2),'bin_width',round(T),'max_shift',50,'us_fac',50,'init_batch',200);