ESCO comparison

[lizgzil]

A generic issue about the analysis/inclusion of ESCO skills in our skills taxonomy built from TK job adverts.

• Compare/map the ESCO skills to TK skills.

• Compare/map the ESCO hierarchy of skills to the new hierarchy

• Identify ESCO skills missing from the job ads. Attempt to assign missing skills to clusters.

• Analyse the distribution of assignments. Do all the missing ESCO skills get assigned to the same cluster?

• Some ESCO skills will not be present in the TextKernel job ads. So we need to identify ESCO skills missing from job ads.

• Identify the union of ESCO skills and skills identified in the job ads

• List missing ESCO skills. Why are they missing? Are they niche skills? What industries are they in?

• Extract the ESCO skills from the TextKernel data, we can do this by applying Karlis' algorithm to the data.

• Extract skills phrases (i.e surface forms) from ESCO descriptions

• Perform phrase matching to detect surface forms in job ads and then assign skills based on surface form detection