Skeleton motion dataset of Vehicle Rear seat Passenger(SVRP)

OpenPose 2D data

Currently only OpenPose 2D version is available. There are 10 cross validation datasets, so if you just want to see what it is like, downloading just a single file is enough.
python NPY File is compressed with 7z format. https://www.7-zip.org/

Sample code to read OpenPose2D data is as follows.

  import numpy as np
  filename_npy='CrossValidationDataset_OpenPose2D/VehiclePassenger_CV_OpenPose2D_0.npz'
  NPY_DATA = np.load(filename_npy)# dictionary
  
  x_train=NPY_DATA['x_train']# (4291, 3, 120, 25, 1)  
  y_train=NPY_DATA['y_train']# (4291,)
  
  x_test=NPY_DATA['x_test']# (466, 3, 120, 25, 1)  
  y_test=NPY_DATA['y_test']# (466,)

Train: abt 200 batch x 22 classes and Test: abt 20 batch x 22 classes
Only time series data of skeleton joint is avaiable.

x_train

batch (22 class times XXX)	coordinate (x,y,certainty)	time (30frame per sec times 4 seconds)	OpenPose Skeleton joints	Number of person
4291	3	120	25	1 (always a single person)

y_train

batch (22 class times XXX)
4291 (22 class id labels from 0 to 21)

Please use this citation.
@article{SVRP, author = "Jingo Adachi, Hiroshi Tsukahara, Nobuhiro Mizuno,Akira Yoshizawa", title = "Action Inference of Rear Seat Passenger for In-Vehicle Service", journal = "IEEE IV2022", year = "2022" }

Action List


0	Normal
1	Getting on a car
2	Getting off a car
3	Moving inside a car
4	Buckle a seatbelt
5	Unbuckle a seatbelt
6	Touching a seatbelt
7	Sleeping/Relaxing
8	Looking outside
9	Pointing at something
10	Blocking glare
11	Feeling hot
12	Feeling cold
13	Bending over
14	Working on lap
15	Working backward
16	Reading
17	Eating
18	Drinking
19	Watching TV
20	Taking clothes
21	Putting on clothes