Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug fix about device of subsample in subsample_messenger.py #3195

Merged
merged 4 commits into from
Apr 20, 2023

Conversation

hjnnjh
Copy link
Contributor

@hjnnjh hjnnjh commented Apr 12, 2023

I made the following changes on my device. Currently works fine. Since the whole Pyro project is very complex, I am not sure where the source of the bug is. I hope you can fix this bug soon.

@martinjankowiak
Copy link
Collaborator

@hjnnjh

pyro.plate has a device arg: https://docs.pyro.ai/en/stable/primitives.html?highlight=plate(#pyro.primitives.plate

i'm assuming you're using a plate and using device will fix your issue?

@hjnnjh
Copy link
Contributor Author

hjnnjh commented Apr 12, 2023

I have specified the device arg for all the pyro.plate in my model and I am using the AutoDelta guide, but I am still encountering the device error.

@hjnnjh
Copy link
Contributor Author

hjnnjh commented Apr 12, 2023

@hjnnjh

pyro.plate has a device arg: https://docs.pyro.ai/en/stable/primitives.html?highlight=plate(#pyro.primitives.plate

i'm assuming you're using a plate and using device will fix your issue?

Here are some error information:

Traceback (most recent call last):
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/trace_messenger.py", line 174, in __call__
    ret = self.fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/messenger.py", line 12, in _context_wrap
    return fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/messenger.py", line 12, in _context_wrap
    return fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/messenger.py", line 12, in _context_wrap
    return fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/nn/module.py", line 448, in __call__
    result = super().__call__(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/infer/autoguide/guides.py", line 398, in forward
    name, dist.Delta(attr_get(self), event_dim=site["fn"].event_dim)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/nn/module.py", line 504, in __getattr__
    return pyro.param(fullname, event_dim=event_dim)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/primitives.py", line 78, in param
    return _param(*args, constraint=constraint, event_dim=event_dim, name=name)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/runtime.py", line 283, in _fn
    apply_stack(msg)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/runtime.py", line 221, in apply_stack
    frame._postprocess_message(msg)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/subsample_messenger.py", line 189, in _postprocess_message
    new_value = value.index_select(dim, self._indices)
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper__index_select)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/trace_messenger.py", line 174, in __call__
    ret = self.fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/handlers.py", line 204, in _fn
    return ftr(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/trace_messenger.py", line 180, in __call__
    raise exc from e
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/trace_messenger.py", line 174, in __call__
    ret = self.fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/messenger.py", line 12, in _context_wrap
    return fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/messenger.py", line 12, in _context_wrap
    return fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/messenger.py", line 12, in _context_wrap
    return fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/nn/module.py", line 448, in __call__
    result = super().__call__(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/infer/autoguide/guides.py", line 398, in forward
    name, dist.Delta(attr_get(self), event_dim=site["fn"].event_dim)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/nn/module.py", line 504, in __getattr__
    return pyro.param(fullname, event_dim=event_dim)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/primitives.py", line 78, in param
    return _param(*args, constraint=constraint, event_dim=event_dim, name=name)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/runtime.py", line 283, in _fn
    apply_stack(msg)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/runtime.py", line 221, in apply_stack
    frame._postprocess_message(msg)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/subsample_messenger.py", line 189, in _postprocess_message
    new_value = value.index_select(dim, self._indices)
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper__index_select)
          Trace Shapes:                     
           Param Sites:                     
   AutoDelta.phi_songId      25 5000        
 AutoDelta.phi_artistId      25 3500        
AutoDelta.phi_contentId      25 1500        
   AutoDelta.phi_talkId      25  144        
         AutoDelta.xi_1           25        
         AutoDelta.xi_2           25        
        AutoDelta.gamma      25    6        
        AutoDelta.omega       3   25        
            AutoDelta.p 100   3    3        
    AutoDelta.theta_b_0     100   25        
    AutoDelta.theta_c_0     100   25        
    AutoDelta.theta_b_1     100   25        
    AutoDelta.theta_c_1     100   25        
    AutoDelta.theta_b_2     100   25        
    AutoDelta.theta_c_2     100   25        
    AutoDelta.theta_b_3     100   25        
    AutoDelta.theta_c_3     100   25        
    AutoDelta.theta_b_4     100   25        
    AutoDelta.theta_c_4     100   25        
    AutoDelta.theta_b_5     100   25        
    AutoDelta.theta_c_5     100   25        
    AutoDelta.theta_b_6     100   25        
    AutoDelta.theta_c_6     100   25        
    AutoDelta.theta_b_7     100   25        
    AutoDelta.theta_c_7     100   25        
    AutoDelta.theta_b_8     100   25        
    AutoDelta.theta_c_8     100   25        
    AutoDelta.theta_b_9     100   25        
    AutoDelta.theta_c_9     100   25        
   AutoDelta.theta_b_10     100   25        
   AutoDelta.theta_c_10     100   25        
   AutoDelta.theta_b_11     100   25        
   AutoDelta.theta_c_11     100   25        
   AutoDelta.theta_b_12     100   25        
   AutoDelta.theta_c_12     100   25        
   AutoDelta.theta_b_13     100   25        
   AutoDelta.theta_c_13     100   25        
   AutoDelta.theta_b_14     100   25        
   AutoDelta.theta_c_14     100   25        
   AutoDelta.theta_b_15     100   25        
   AutoDelta.theta_c_15     100   25        
   AutoDelta.theta_b_16     100   25        
   AutoDelta.theta_c_16     100   25        
   AutoDelta.theta_b_17     100   25        
   AutoDelta.theta_c_17     100   25        
   AutoDelta.theta_b_18     100   25        
   AutoDelta.theta_c_18     100   25        
   AutoDelta.theta_b_19     100   25        
   AutoDelta.theta_c_19     100   25        
   AutoDelta.theta_b_20     100   25        
   AutoDelta.theta_c_20     100   25        
   AutoDelta.theta_b_21     100   25        
   AutoDelta.theta_c_21     100   25        
   AutoDelta.theta_b_22     100   25        
   AutoDelta.theta_c_22     100   25        
   AutoDelta.theta_b_23     100   25        
   AutoDelta.theta_c_23     100   25        
   AutoDelta.theta_b_24     100   25        
   AutoDelta.theta_c_24     100   25        
   AutoDelta.theta_b_25     100   25        
   AutoDelta.theta_c_25     100   25        
   AutoDelta.theta_b_26     100   25        
   AutoDelta.theta_c_26     100   25        
   AutoDelta.theta_b_27     100   25        
   AutoDelta.theta_c_27     100   25        
   AutoDelta.theta_b_28     100   25        
   AutoDelta.theta_c_28     100   25        
          Sample Sites:                     
     batched_users dist            |        
                  value       8    |        
             users dist            |        
                  value     100    |        
        phi_songId dist            | 25 5000
                  value            | 25 5000
      phi_artistId dist            | 25 3500
                  value            | 25 3500
     phi_contentId dist            | 25 1500
                  value            | 25 1500
        phi_talkId dist            | 25  144
                  value            | 25  144
              xi_1 dist            | 25     
                  value            | 25     
              xi_2 dist            | 25     
                  value            | 25     
             gamma dist            | 25    6
                  value            | 25    6
             omega dist            |  3   25
                  value            |  3   25
                 p dist     100    |  3    3
                  value     100    |  3    3

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/ubuntu/PycharmProjects/pythonProject/NCM-Model/model/ncm_model.py", line 246, in <module>
    model.svi_estimate()
  File "/home/ubuntu/PycharmProjects/pythonProject/NCM-Model/model/ncm_model.py", line 153, in svi_estimate
    loss = svi.step()
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/infer/svi.py", line 145, in step
    loss = self.loss_and_grads(self.model, self.guide, *args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/infer/traceenum_elbo.py", line 451, in loss_and_grads
    for model_trace, guide_trace in self._get_traces(model, guide, args, kwargs):
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/infer/traceenum_elbo.py", line 394, in _get_traces
    yield self._get_trace(model, guide, args, kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/infer/traceenum_elbo.py", line 340, in _get_trace
    "flat", self.max_plate_nesting, model, guide, args, kwargs
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/infer/enum.py", line 61, in get_importance_trace
    *args, **kwargs
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/trace_messenger.py", line 198, in get_trace
    self(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/trace_messenger.py", line 180, in __call__
    raise exc from e
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/trace_messenger.py", line 174, in __call__
    ret = self.fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/handlers.py", line 204, in _fn
    return ftr(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/trace_messenger.py", line 180, in __call__
    raise exc from e
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/trace_messenger.py", line 174, in __call__
    ret = self.fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/messenger.py", line 12, in _context_wrap
    return fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/messenger.py", line 12, in _context_wrap
    return fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/messenger.py", line 12, in _context_wrap
    return fn(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/nn/module.py", line 448, in __call__
    result = super().__call__(*args, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/infer/autoguide/guides.py", line 398, in forward
    name, dist.Delta(attr_get(self), event_dim=site["fn"].event_dim)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/nn/module.py", line 504, in __getattr__
    return pyro.param(fullname, event_dim=event_dim)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/primitives.py", line 78, in param
    return _param(*args, constraint=constraint, event_dim=event_dim, name=name)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/runtime.py", line 283, in _fn
    apply_stack(msg)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/runtime.py", line 221, in apply_stack
    frame._postprocess_message(msg)
  File "/home/ubuntu/Softwares/anaconda3/envs/deep_learning/lib/python3.7/site-packages/pyro/poutine/subsample_messenger.py", line 189, in _postprocess_message
    new_value = value.index_select(dim, self._indices)
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument index in method wrapper__index_select)
          Trace Shapes:                     
           Param Sites:                     
   AutoDelta.phi_songId      25 5000        
 AutoDelta.phi_artistId      25 3500        
AutoDelta.phi_contentId      25 1500        
   AutoDelta.phi_talkId      25  144        
         AutoDelta.xi_1           25        
         AutoDelta.xi_2           25        
        AutoDelta.gamma      25    6        
        AutoDelta.omega       3   25        
            AutoDelta.p 100   3    3        
    AutoDelta.theta_b_0     100   25        
    AutoDelta.theta_c_0     100   25        
    AutoDelta.theta_b_1     100   25        
    AutoDelta.theta_c_1     100   25        
    AutoDelta.theta_b_2     100   25        
    AutoDelta.theta_c_2     100   25        
    AutoDelta.theta_b_3     100   25        
    AutoDelta.theta_c_3     100   25        
    AutoDelta.theta_b_4     100   25        
    AutoDelta.theta_c_4     100   25        
    AutoDelta.theta_b_5     100   25        
    AutoDelta.theta_c_5     100   25        
    AutoDelta.theta_b_6     100   25        
    AutoDelta.theta_c_6     100   25        
    AutoDelta.theta_b_7     100   25        
    AutoDelta.theta_c_7     100   25        
    AutoDelta.theta_b_8     100   25        
    AutoDelta.theta_c_8     100   25        
    AutoDelta.theta_b_9     100   25        
    AutoDelta.theta_c_9     100   25        
   AutoDelta.theta_b_10     100   25        
   AutoDelta.theta_c_10     100   25        
   AutoDelta.theta_b_11     100   25        
   AutoDelta.theta_c_11     100   25        
   AutoDelta.theta_b_12     100   25        
   AutoDelta.theta_c_12     100   25        
   AutoDelta.theta_b_13     100   25        
   AutoDelta.theta_c_13     100   25        
   AutoDelta.theta_b_14     100   25        
   AutoDelta.theta_c_14     100   25        
   AutoDelta.theta_b_15     100   25        
   AutoDelta.theta_c_15     100   25        
   AutoDelta.theta_b_16     100   25        
   AutoDelta.theta_c_16     100   25        
   AutoDelta.theta_b_17     100   25        
   AutoDelta.theta_c_17     100   25        
   AutoDelta.theta_b_18     100   25        
   AutoDelta.theta_c_18     100   25        
   AutoDelta.theta_b_19     100   25        
   AutoDelta.theta_c_19     100   25        
   AutoDelta.theta_b_20     100   25        
   AutoDelta.theta_c_20     100   25        
   AutoDelta.theta_b_21     100   25        
   AutoDelta.theta_c_21     100   25        
   AutoDelta.theta_b_22     100   25        
   AutoDelta.theta_c_22     100   25        
   AutoDelta.theta_b_23     100   25        
   AutoDelta.theta_c_23     100   25        
   AutoDelta.theta_b_24     100   25        
   AutoDelta.theta_c_24     100   25        
   AutoDelta.theta_b_25     100   25        
   AutoDelta.theta_c_25     100   25        
   AutoDelta.theta_b_26     100   25        
   AutoDelta.theta_c_26     100   25        
   AutoDelta.theta_b_27     100   25        
   AutoDelta.theta_c_27     100   25        
   AutoDelta.theta_b_28     100   25        
   AutoDelta.theta_c_28     100   25        
          Sample Sites:                     
     batched_users dist            |        
                  value       8    |        
             users dist            |        
                  value     100    |        
        phi_songId dist            | 25 5000
                  value            | 25 5000
      phi_artistId dist            | 25 3500
                  value            | 25 3500
     phi_contentId dist            | 25 1500
                  value            | 25 1500
        phi_talkId dist            | 25  144
                  value            | 25  144
              xi_1 dist            | 25     
                  value            | 25     
              xi_2 dist            | 25     
                  value            | 25     
             gamma dist            | 25    6
                  value            | 25    6
             omega dist            |  3   25
                  value            |  3   25
                 p dist     100    |  3    3
                  value     100    |  3    3
          Trace Shapes:                     
           Param Sites:                     
   AutoDelta.phi_songId      25 5000        
 AutoDelta.phi_artistId      25 3500        
AutoDelta.phi_contentId      25 1500        
   AutoDelta.phi_talkId      25  144        
         AutoDelta.xi_1           25        
         AutoDelta.xi_2           25        
        AutoDelta.gamma      25    6        
        AutoDelta.omega       3   25        
            AutoDelta.p 100   3    3        
    AutoDelta.theta_b_0     100   25        
    AutoDelta.theta_c_0     100   25        
    AutoDelta.theta_b_1     100   25        
    AutoDelta.theta_c_1     100   25        
    AutoDelta.theta_b_2     100   25        
    AutoDelta.theta_c_2     100   25        
    AutoDelta.theta_b_3     100   25        
    AutoDelta.theta_c_3     100   25        
    AutoDelta.theta_b_4     100   25        
    AutoDelta.theta_c_4     100   25        
    AutoDelta.theta_b_5     100   25        
    AutoDelta.theta_c_5     100   25        
    AutoDelta.theta_b_6     100   25        
    AutoDelta.theta_c_6     100   25        
    AutoDelta.theta_b_7     100   25        
    AutoDelta.theta_c_7     100   25        
    AutoDelta.theta_b_8     100   25        
    AutoDelta.theta_c_8     100   25        
    AutoDelta.theta_b_9     100   25        
    AutoDelta.theta_c_9     100   25        
   AutoDelta.theta_b_10     100   25        
   AutoDelta.theta_c_10     100   25        
   AutoDelta.theta_b_11     100   25        
   AutoDelta.theta_c_11     100   25        
   AutoDelta.theta_b_12     100   25        
   AutoDelta.theta_c_12     100   25        
   AutoDelta.theta_b_13     100   25        
   AutoDelta.theta_c_13     100   25        
   AutoDelta.theta_b_14     100   25        
   AutoDelta.theta_c_14     100   25        
   AutoDelta.theta_b_15     100   25        
   AutoDelta.theta_c_15     100   25        
   AutoDelta.theta_b_16     100   25        
   AutoDelta.theta_c_16     100   25        
   AutoDelta.theta_b_17     100   25        
   AutoDelta.theta_c_17     100   25        
   AutoDelta.theta_b_18     100   25        
   AutoDelta.theta_c_18     100   25        
   AutoDelta.theta_b_19     100   25        
   AutoDelta.theta_c_19     100   25        
   AutoDelta.theta_b_20     100   25        
   AutoDelta.theta_c_20     100   25        
   AutoDelta.theta_b_21     100   25        
   AutoDelta.theta_c_21     100   25        
   AutoDelta.theta_b_22     100   25        
   AutoDelta.theta_c_22     100   25        
   AutoDelta.theta_b_23     100   25        
   AutoDelta.theta_c_23     100   25        
   AutoDelta.theta_b_24     100   25        
   AutoDelta.theta_c_24     100   25        
   AutoDelta.theta_b_25     100   25        
   AutoDelta.theta_c_25     100   25        
   AutoDelta.theta_b_26     100   25        
   AutoDelta.theta_c_26     100   25        
   AutoDelta.theta_b_27     100   25        
   AutoDelta.theta_c_27     100   25        
   AutoDelta.theta_b_28     100   25        
   AutoDelta.theta_c_28     100   25        
          Sample Sites:                     
     batched_users dist            |        
                  value       8    |        
             users dist            |        
                  value     100    |        
        phi_songId dist            | 25 5000
                  value            | 25 5000
      phi_artistId dist            | 25 3500
                  value            | 25 3500
     phi_contentId dist            | 25 1500
                  value            | 25 1500
        phi_talkId dist            | 25  144
                  value            | 25  144
              xi_1 dist            | 25     
                  value            | 25     
              xi_2 dist            | 25     
                  value            | 25     
             gamma dist            | 25    6
                  value            | 25    6
             omega dist            |  3   25
                  value            |  3   25
                 p dist     100    |  3    3
                  value     100    |  3    3

But It works fine when I tried trace the model shape

❯ /home/ubuntu/Softwares/anaconda3/envs/deep_learning/bin/python /home/ubuntu/PycharmProjects/pythonProject/NCM-Model/model/ncm_model.py
[2023-04-12 13:56:54 INFO]: Trace log save to ./model_shape.log
        Trace Shapes:                                    
         Param Sites:                                    
        Sample Sites:                                    
      phi_songId dist                           | 25 5000
                value                           | 25 5000
             log_prob                           |        
    phi_artistId dist                           | 25 3500
                value                           | 25 3500
             log_prob                           |        
   phi_contentId dist                           | 25 1500
                value                           | 25 1500
             log_prob                           |        
      phi_talkId dist                           | 25  144
                value                           | 25  144
             log_prob                           |        
            xi_1 dist                           | 25     
                value                           | 25     
             log_prob                           |        
            xi_2 dist                           | 25     
                value                           | 25     
             log_prob                           |        
           gamma dist                           | 25    6
                value                           | 25    6
             log_prob                           |        
           omega dist                           |  3   25
                value                           |  3   25
             log_prob                           |        
           users dist                           |        
                value                       100 |        
             log_prob                           |        
               p dist                       100 |  3    3
                value                       100 |  3    3
             log_prob                       100 |        
   batched_users dist                           |        
                value                         8 |        
             log_prob                           |        
         state_0 dist                         8 |        
                value                  3  1   1 |        
             log_prob                  3  1   8 |        
       theta_b_0 dist                  3  1   8 | 25     
                value                  3  1   8 | 25     
             log_prob                  3  1   8 |        
       theta_c_0 dist                  3  1   8 | 25     
                value                  3  1   8 | 25     
             log_prob                  3  1   8 |        
         cards_0 dist                           |        
                value                        19 |        
             log_prob                         8 |        
           z_b_0 dist                  3 19   8 |        
                value               25 1  1   1 |        
             log_prob               25 3 19   8 |        
    d_b_0_songId dist               25 1 19   8 |        
                value                    19   8 |        
             log_prob               25 1 19   8 |        
  d_b_0_artistId dist               25 1 19   8 |        
                value                    19   8 |        
             log_prob               25 1 19   8 |        
 d_b_0_contentId dist               25 1 19   8 |        
                value                    19   8 |        
             log_prob               25 1 19   8 |        
  d_b_0_talkId_0 dist               25 1 19   8 |        
                value                  3 19   8 |        
             log_prob               25 3 19   8 |        
  d_b_0_talkId_1 dist               25 1 19   8 |        
                value                  3 19   8 |        
             log_prob               25 3 19   8 |        
  d_b_0_talkId_2 dist               25 1 19   8 |        
                value                  3 19   8 |        
             log_prob               25 3 19   8 |        
           z_c_0 dist                  3 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  1 3 19   8 |        
    d_c_0_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
  d_c_0_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_c_0_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
  d_c_0_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
  d_c_0_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
  d_c_0_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
           y_c_0 dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
         state_1 dist                  3  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  1 3  1   8 |        
       theta_b_1 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
       theta_c_1 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
         cards_1 dist                           |        
                value                        19 |        
             log_prob                         8 |        
           z_b_1 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
    d_b_1_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
  d_b_1_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_1_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
  d_b_1_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
  d_b_1_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
  d_b_1_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
           z_c_1 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
    d_c_1_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
  d_c_1_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_1_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
  d_c_1_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
  d_c_1_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
  d_c_1_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
           y_c_1 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
         state_2 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
       theta_b_2 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
       theta_c_2 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
         cards_2 dist                           |        
                value                        19 |        
             log_prob                         8 |        
           z_b_2 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
    d_b_2_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
  d_b_2_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_2_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
  d_b_2_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
  d_b_2_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
  d_b_2_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
           z_c_2 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
    d_c_2_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
  d_c_2_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_2_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
  d_c_2_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
  d_c_2_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
  d_c_2_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
           y_c_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
         state_3 dist                3 1  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
       theta_b_3 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
       theta_c_3 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
         cards_3 dist                           |        
                value                        19 |        
             log_prob                         8 |        
           z_b_3 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
    d_b_3_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
  d_b_3_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_3_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
  d_b_3_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
  d_b_3_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
  d_b_3_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
           z_c_3 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
    d_c_3_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
  d_c_3_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_3_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
  d_c_3_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
  d_c_3_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
  d_c_3_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
           y_c_3 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
         state_4 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
       theta_b_4 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
       theta_c_4 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
         cards_4 dist                           |        
                value                        19 |        
             log_prob                         8 |        
           z_b_4 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
    d_b_4_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
  d_b_4_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_4_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
  d_b_4_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
  d_b_4_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
  d_b_4_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
           z_c_4 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
    d_c_4_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
  d_c_4_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_4_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
  d_c_4_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
  d_c_4_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
  d_c_4_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
           y_c_4 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
         state_5 dist                3 1  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
       theta_b_5 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
       theta_c_5 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
         cards_5 dist                           |        
                value                        19 |        
             log_prob                         8 |        
           z_b_5 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
    d_b_5_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
  d_b_5_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_5_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
  d_b_5_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
  d_b_5_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
  d_b_5_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
           z_c_5 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
    d_c_5_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
  d_c_5_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_5_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
  d_c_5_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
  d_c_5_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
  d_c_5_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
           y_c_5 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
         state_6 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
       theta_b_6 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
       theta_c_6 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
         cards_6 dist                           |        
                value                        19 |        
             log_prob                         8 |        
           z_b_6 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
    d_b_6_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
  d_b_6_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_6_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
  d_b_6_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
  d_b_6_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
  d_b_6_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
           z_c_6 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
    d_c_6_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
  d_c_6_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_6_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
  d_c_6_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
  d_c_6_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
  d_c_6_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
           y_c_6 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
         state_7 dist                3 1  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
       theta_b_7 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
       theta_c_7 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
         cards_7 dist                           |        
                value                        19 |        
             log_prob                         8 |        
           z_b_7 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
    d_b_7_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
  d_b_7_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_7_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
  d_b_7_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
  d_b_7_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
  d_b_7_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
           z_c_7 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
    d_c_7_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
  d_c_7_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_7_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
  d_c_7_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
  d_c_7_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
  d_c_7_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
           y_c_7 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
         state_8 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
       theta_b_8 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
       theta_c_8 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
         cards_8 dist                           |        
                value                        19 |        
             log_prob                         8 |        
           z_b_8 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
    d_b_8_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
  d_b_8_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_8_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
  d_b_8_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
  d_b_8_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
  d_b_8_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
           z_c_8 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
    d_c_8_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
  d_c_8_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_8_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
  d_c_8_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
  d_c_8_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
  d_c_8_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
           y_c_8 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
         state_9 dist                3 1  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
       theta_b_9 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
       theta_c_9 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
         cards_9 dist                           |        
                value                        19 |        
             log_prob                         8 |        
           z_b_9 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
    d_b_9_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
  d_b_9_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_9_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
  d_b_9_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
  d_b_9_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
  d_b_9_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
           z_c_9 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
    d_c_9_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
  d_c_9_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_9_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
  d_c_9_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
  d_c_9_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
  d_c_9_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
           y_c_9 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
        state_10 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_10 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
      theta_c_10 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
        cards_10 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_10 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
   d_b_10_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_10_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
d_b_10_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_10_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_10_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_10_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
          z_c_10 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
   d_c_10_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_10_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
d_c_10_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_10_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_10_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_10_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
          y_c_10 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
        state_11 dist                3 1  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_11 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
      theta_c_11 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
        cards_11 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_11 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
   d_b_11_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_11_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
d_b_11_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_11_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_11_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_11_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
          z_c_11 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
   d_c_11_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_11_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
d_c_11_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_11_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_11_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_11_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
          y_c_11 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
        state_12 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_12 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
      theta_c_12 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
        cards_12 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_12 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
   d_b_12_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_12_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
d_b_12_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_12_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_12_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_12_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
          z_c_12 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
   d_c_12_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_12_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
d_c_12_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_12_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_12_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_12_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
          y_c_12 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
        state_13 dist                3 1  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_13 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
      theta_c_13 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
        cards_13 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_13 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
   d_b_13_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_13_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
d_b_13_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_13_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_13_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_13_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
          z_c_13 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
   d_c_13_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_13_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
d_c_13_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_13_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_13_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_13_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
          y_c_13 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
        state_14 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_14 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
      theta_c_14 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
        cards_14 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_14 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
   d_b_14_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_14_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
d_b_14_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_14_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_14_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_14_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
          z_c_14 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
   d_c_14_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_14_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
d_c_14_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_14_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_14_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_14_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
          y_c_14 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
        state_15 dist                3 1  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_15 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
      theta_c_15 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
        cards_15 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_15 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
   d_b_15_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_15_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
d_b_15_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_15_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_15_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_15_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
          z_c_15 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
   d_c_15_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_15_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
d_c_15_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_15_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_15_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_15_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
          y_c_15 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
        state_16 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_16 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
      theta_c_16 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
        cards_16 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_16 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
   d_b_16_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_16_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
d_b_16_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_16_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_16_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_16_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
          z_c_16 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
   d_c_16_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_16_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
d_c_16_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_16_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_16_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_16_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
          y_c_16 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
        state_17 dist                3 1  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_17 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
      theta_c_17 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
        cards_17 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_17 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
   d_b_17_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_17_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
d_b_17_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_17_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_17_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_17_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
          z_c_17 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
   d_c_17_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_17_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
d_c_17_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_17_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_17_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_17_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
          y_c_17 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
        state_18 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_18 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
      theta_c_18 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
        cards_18 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_18 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
   d_b_18_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_18_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
d_b_18_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_18_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_18_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_18_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
          z_c_18 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
   d_c_18_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_18_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
d_c_18_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_18_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_18_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_18_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
          y_c_18 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
        state_19 dist                3 1  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_19 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
      theta_c_19 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
        cards_19 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_19 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
   d_b_19_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_19_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
d_b_19_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_19_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_19_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_19_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
          z_c_19 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
   d_c_19_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_19_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
d_c_19_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_19_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_19_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_19_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
          y_c_19 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
        state_20 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_20 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
      theta_c_20 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
        cards_20 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_20 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
   d_b_20_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_20_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
d_b_20_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_20_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_20_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_20_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
          z_c_20 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
   d_c_20_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_20_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
d_c_20_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_20_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_20_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_20_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
          y_c_20 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
        state_21 dist                3 1  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_21 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
      theta_c_21 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
        cards_21 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_21 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
   d_b_21_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_21_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
d_b_21_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_21_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_21_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_21_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
          z_c_21 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
   d_c_21_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_21_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
d_c_21_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_21_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_21_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_21_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
          y_c_21 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
        state_22 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_22 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
      theta_c_22 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
        cards_22 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_22 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
   d_b_22_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_22_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
d_b_22_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_22_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_22_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_22_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
          z_c_22 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
   d_c_22_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_22_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
d_c_22_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_22_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_22_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_22_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
          y_c_22 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
        state_23 dist                3 1  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_23 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
      theta_c_23 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
        cards_23 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_23 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
   d_b_23_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_23_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
d_b_23_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_23_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_23_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_23_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
          z_c_23 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
   d_c_23_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_23_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
d_c_23_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_23_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_23_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_23_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
          y_c_23 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
        state_24 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_24 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
      theta_c_24 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
        cards_24 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_24 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
   d_b_24_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_24_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
d_b_24_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_24_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_24_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_24_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
          z_c_24 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
   d_c_24_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_24_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
d_c_24_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_24_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_24_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_24_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
          y_c_24 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
        state_25 dist                3 1  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_25 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
      theta_c_25 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
        cards_25 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_25 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
   d_b_25_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_25_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
d_b_25_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_25_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_25_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_25_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
          z_c_25 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
   d_c_25_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_25_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
d_c_25_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_25_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_25_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_25_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
          y_c_25 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
        state_26 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_26 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
      theta_c_26 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
        cards_26 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_26 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
   d_b_26_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_26_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
d_b_26_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_26_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_26_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_26_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
          z_c_26 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
   d_c_26_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_26_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
d_c_26_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_26_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_26_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_26_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
          y_c_26 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
        state_27 dist                3 1  1   8 |        
                value          3  1  1 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_27 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
      theta_c_27 dist          3  1  1 1  1   8 | 25     
                value          3  1  1 1  1   8 | 25     
             log_prob          3  1  1 1  1   8 |        
        cards_27 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_27 dist          3  1  1 1 19   8 |        
                value       25 1  1  1 1  1   1 |        
             log_prob       25 3  1  1 1 19   8 |        
   d_b_27_songId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_27_artistId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
d_b_27_contentId dist       25 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob       25 1  1  1 1 19   8 |        
 d_b_27_talkId_0 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_27_talkId_1 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
 d_b_27_talkId_2 dist       25 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob       25 1  1  1 3 19   8 |        
          z_c_27 dist          3  1  1 1 19   8 |        
                value    25  1 1  1  1 1  1   1 |        
             log_prob    25  1 3  1  1 1 19   8 |        
   d_c_27_songId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_27_artistId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
d_c_27_contentId dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
 d_c_27_talkId_0 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_27_talkId_1 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
 d_c_27_talkId_2 dist    25  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob    25  1 1  1  1 3 19   8 |        
          y_c_27 dist    25  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob    25  1 1  1  1 1 19   8 |        
        state_28 dist          3  1  1 1  1   8 |        
                value                3 1  1   1 |        
             log_prob          3  1  3 1  1   8 |        
      theta_b_28 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
      theta_c_28 dist                3 1  1   8 | 25     
                value                3 1  1   8 | 25     
             log_prob                3 1  1   8 |        
        cards_28 dist                           |        
                value                        19 |        
             log_prob                         8 |        
          z_b_28 dist                3 1 19   8 |        
                value            25  1 1  1   1 |        
             log_prob            25  3 1 19   8 |        
   d_b_28_songId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_28_artistId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
d_b_28_contentId dist            25  1 1 19   8 |        
                value                    19   8 |        
             log_prob            25  1 1 19   8 |        
 d_b_28_talkId_0 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_28_talkId_1 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
 d_b_28_talkId_2 dist            25  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob            25  1 3 19   8 |        
          z_c_28 dist                3 1 19   8 |        
                value 25  1  1 1  1  1 1  1   1 |        
             log_prob 25  1  1 1  1  3 1 19   8 |        
   d_c_28_songId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_28_artistId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
d_c_28_contentId dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        
 d_c_28_talkId_0 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_28_talkId_1 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
 d_c_28_talkId_2 dist 25  1  1 1  1  1 1 19   8 |        
                value                  3 19   8 |        
             log_prob 25  1  1 1  1  1 3 19   8 |        
          y_c_28 dist 25  1  1 1  1  1 1 19   8 |        
                value                    19   8 |        
             log_prob 25  1  1 1  1  1 1 19   8 |        

@martinjankowiak
Copy link
Collaborator

@hjnnjh can you please provide a minimal runnable script / code snippet that demonstrates this error?

@fritzo
Copy link
Member

fritzo commented Apr 13, 2023

Hi @hjnnjh thanks for the fix! I think it's a little dangerous to decide based on torch.cuda.is_available(), but it seems like a very safe conservative change to decide based on value.device. Would this version of your change work for you? (and if so we'd be happy to merge it)

- new_value = value.index_select(dim, self._indices)
+ new_value = value.index_select(dim, self._indices.to(value.device))

EDIT looks like the lint errors are due to black. This is a pretty simple change, so feel free to omit comments.

@hjnnjh
Copy link
Contributor Author

hjnnjh commented Apr 14, 2023

@hjnnjh can you please provide a minimal runnable script / code snippet that demonstrates this error?

I'm busy building my model the past few days. I'll provide a minimal runnable script soon.

@hjnnjh
Copy link
Contributor Author

hjnnjh commented Apr 14, 2023

Hi @hjnnjh thanks for the fix! I think it's a little dangerous to decide based on torch.cuda.is_available(), but it seems like a very safe conservative change to decide based on value.device. Would this version of your change work for you? (and if so we'd be happy to merge it)

- new_value = value.index_select(dim, self._indices)
+ new_value = value.index_select(dim, self._indices.to(value.device))

EDIT looks like the lint errors are due to black. This is a pretty simple change, so feel free to omit comments.

Thanks for your reply! I think this is a better solution. It works fine now.

@hjnnjh
Copy link
Contributor Author

hjnnjh commented Apr 17, 2023

@hjnnjh can you please provide a minimal runnable script / code snippet that demonstrates this error?

I create a repo with a minimal runnable script minimal_example.py here. You can run it just by executing python minimal_example.py. device arg is specified in self._device.

@fritzo
Copy link
Member

fritzo commented Apr 18, 2023

@hjnnjh looks good. Can you just try running make format to fix code formatting. I'm guessing the line is now too long. Thanks!

@hjnnjh
Copy link
Contributor Author

hjnnjh commented Apr 19, 2023

@hjnnjh looks good. Can you just try running make format to fix code formatting. I'm guessing the line is now too long. Thanks!

I just reformatted subsample_messenger.py via black. Maybe it could pass the CI test now :)

@hjnnjh
Copy link
Contributor Author

hjnnjh commented Apr 20, 2023

@fritzo Hello, can this PR be merged?

@fehiepsi fehiepsi merged commit 1311b9e into pyro-ppl:dev Apr 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants