Skip to content

Data Loading

Josef Hardi edited this page Jul 24, 2019 · 2 revisions

We stored the resulting tabular data in the comma-separated values (CSV) format. Anyone who has access to the files should be able to load the data into their data analytics tool or data store using this format. Currently, we have some data loading functions written in the R language. The function requires a file path that points to the CSV file location, and it will produce a data frame in R.

The table below summarizes the data size and table size of each HR-CDM table:

Table Name Data Size (# of rows) Table Size (# of columns)
PERSON 231,813 18
EMPLOYEE 231,813 5
HR_EVENT 3,052,017 11
EMPLOYMENT_RECORD 3,052,017 22
WORK_SITE 1,079 3
LOCATION 1,079 8
SITE_HISTORY 19,422 10
SITE_EVENT 0 9

In addition to the core tables above, we created a derived-type table for a robust data analysis about the employment history. Specifically, we have included a new table called EMPLOYMENT_RECORD_MONTHLY_GRID where new monthly rows are automatically generated and inserted into the original EMPLOYMENT_RECORD table. The purpose of this treatment is to create a uniform time-spaced data set for each employee over the period of the year 1996 to 2013.

Table Name Data Size (# of rows) Table Size (# of columns)
EMPLOYMENT_RECORD_MONTHLY_GRID 41,629,310 22

Clone this wiki locally