Fix/OpenAlex: abstract_inverted_index field now a JSON structure

[alexmassen-hane]

A proposed fix for the new structure of the abstract_inverted_index field as it is now a proper JSON object. Also added to the unit tests to make sure it transforms to the desired format.

[codecov]

Codecov Report

Patch coverage: 100.00% and project coverage change: -0.01% ⚠️

Comparison is base (9991d03) 95.21% compared to head (04ba403) 95.21%.

Additional details and impacted files

@@             Coverage Diff             @@
##           develop     #183      +/-   ##
===========================================
- Coverage    95.21%   95.21%   -0.01%     
===========================================
  Files           20       20              
  Lines         5209     5206       -3     
  Branches       720      719       -1     
===========================================
- Hits          4960     4957       -3     
  Misses         161      161              
  Partials        88       88              

Files Changed	Coverage Δ
...ervatory_workflows/workflows/openalex_telescope.py	92.10% <100.00%> (-0.06%)	⬇️

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[jdddog]

Thanks for fixing this Alex.

Since we will need to re-run the workflow from scratch to fix this (since we have already loaded the inverted index into our db as a string), we might as well:

• Load the whole data structure into the Works table, e.g. {IndexLength": 7, "InvertedIndex": {}}.
• In the Works table, add the type_crossref field.
• In the Location objects add the is_in_doaj next to the field is_oa.

[jdddog]

Thanks for fixing this Alex!