blob/json_blob should not be included in default response

[tloubrieu-jpl]

🐛 Describe the bug

I've seen the blob in default responses from the API

📜 To Reproduce

Test with this request for example:

curl --location --request GET 'http://localhost:8080/bundles'
--header 'Accept: application/kvp+json'

🕵️ Expected behavior

The blob should not be available in default responses so to improve the performance and not to confuse the users.

📚 Version of Software Used

Latest on main

[al-niessner]

@tloubrieu-jpl @jordanpadams

Using example URL, not finding blob in result:

$ curl --location --request GET 'http://localhost:8080/bundles' --header 'Accept: application/kvp+json'
{
  "summary":{"hits":1,"took":10,"start":0,"limit":100,"sort":[],"properties":["_package_id","lid","lidvid","ops:Harvest_Info.ops:node_name","ops:Label_File_Info.ops:creation_date_time","ops:Label_File_Info.ops:file_name","ops:Label_File_Info.ops:file_ref","ops:Label_File_Info.ops:file_size","ops:Label_File_Info.ops:md5_checksum","product_class","ref_lid_collection","ref_lid_instrument","ref_lid_instrument_host","ref_lid_investigation","ref_lid_target","title","vid"]},
  "data":[    {
      "ops:Label_File_Info.ops:md5_checksum":"24bf73b1cc29677faa4f590121164f4e",
      "ref_lid_instrument_host":"urn:nasa:pds:context:instrument_host:spacecraft.mess",
      "ops:Label_File_Info.ops:creation_date_time":"2021-05-12T18:17:17Z",
      "lid":"urn:nasa:pds:izenberg_pdart14_meap",
      "ref_lid_investigation":"urn:nasa:pds:context:investigation:mission.messenger",
      "lidvid":"urn:nasa:pds:izenberg_pdart14_meap::1.0",
      "title":"Izenberg PDART 2014 MESSENGER Advanced Products Bundle",
      "_package_id":"39728247-ff50-467c-92a2-65827eb27eec",
      "ref_lid_instrument":"[urn:nasa:pds:context:instrument:grs.mess, urn:nasa:pds:context:instrument:mascs.mess, urn:nasa:pds:context:instrument:ns.mess]",
      "ops:Harvest_Info.ops:node_name":"PSA",
      "ops:Label_File_Info.ops:file_size":"5685",
      "ref_lid_collection":"[urn:nasa:pds:izenberg_pdart14_meap:data_eetable, urn:nasa:pds:izenberg_pdart14_meap:data_imagecube, urn:nasa:pds:izenberg_pdart14_meap:data_tnmap, urn:nasa:pds:izenberg_pdart14_meap:document]",
      "vid":"1.0",
      "product_class":"Product_Bundle",
      "ops:Label_File_Info.ops:file_name":"bundle_izenberg_pdart14_meap.xml",
      "ref_lid_target":"urn:nasa:pds:context:target:planet.mercury",
      "ops:Label_File_Info.ops:file_ref":"/var/local/harvest/archive/bundle_izenberg_pdart14_meap.xml"    }
  ]
}

Double checked and 'ops:Label_File_Info/ops:blob' is in the test data. Maybe already fixed on PR #20 ?

[jordanpadams]

@al-niessner not sure about the latest version, but I do see ops:Label_File_Info.ops:json_blob in the JSON response on pds-gamma

"ops:Label_File_Info.ops:json_blob": [
          "eJztWW1v20YS/isLfbIBiqZkK7aZT6pipMbFdU/yFcVdC2JFrqRFyF3eLinZDfLf75klKVKyLffspsUB5w+OSc7MPvM+s/nS+9HopIyL6LtSJanohV9614lQhVzImBdSq2hsBKfXeU0Yp9zaXrjP6PVudNJyfS9toc0DMe68/yAKLtNe+K8vvaz7PuEFDu8Ng8FFPxj1TwcQmAgbG5nTd3yaAAf96TN2t5KW7Z7PUj4XKdtwyzZGFoVQbP7AbqdXP7NcGKuVEqnHFtqwYiWYVLKQPGWJ4YuC6bU0ls2dHB/nrsFAmGTSCwdfvWeRXhLSwekjpP/IiYbpBbM5j0XsDumQMK4SxpNEugeQXalYl6oQhg0YWDmrbW19qCqs2D6TQOU0KGQmSDOpExZcnAzOT8h0rNBsMGie9nUZHtbloj84P6BLZZ+tCVvMw9dgblES5mBYP13uYz49iHkweCXm01fZeYvSYR49h/nseczDoB8MX4n57FWYRzuYL57DPDqM+aw/fBXm0Zvi+XInni/9JuctW/G1YHOBLIeoWFgrEraRxQqpxUoHK2ExT+XcOGVYJooVJB/h3Xp4vK/8u8PKoyK9Svl3b0oMp3wdccPA/8X8otgTP11bNxpD+fyxpRq7VHZiSmzYQgK44plUSxZrtabCr5XXkCykSBOCIVVClhEObdeuucxFKpVgJXlAbt0BgT57DvI38uL5YS+iWrx72YtQNhNmuRPDXtennqveMF76gJqeSiAAyk4F7591PL7v8jdqzNiHbkTVfzQyCmqLXW53GvkYLha2IoqcKMbzXKhEJBVECBJrqUt7QClt5FIqNM0d/zdIuKGuipix5TyRRsTU/aGpUmXUcEYdzn3nXRx0HtX5xxPBkynYgj5v0S2Mzp4t58OgW86Rav8LXhunVntVOsqi4pMK+mfV300xqg1DIRvrNIVb6KublZ4qDS7V47RMxHY+gcMp+9cyKTl4Nitd8aFcFEbOy5qtW+maf5tRZw3lkie9fnnA6wPqlMHZf+v1i5e8Ptrx+sX/vf6ne30QfP31q9frII8QAyKNaiI4eeCf+4EfgDHVS8RGCsZqKxEGn0ujQsUtD/PEhtqIe9/N8I/O8XqT2k7RdXua22bKedrE3IPgEEqz6H6suUWjtmZtSZS6NHVW1ogoXhsredrVWEGI8nZ2Pb2e9adX9+wnaeW89g0gGT4F2SyHYASroAA+uv3pejo7frLhu08MmFy7bdxtHTtV5hU3PIYQ+RtvdgtHUJoFFhF6PBpgshiNjtl3VJrJM7xE2JooxcIGjacCvjUe++BP/PdsJjMaB8b+GA+fSmVxZELP79lEW3KIQjxO8fgRRb60HvuBCHlpRFFwkoIDBEKqPWACPedSeOzG/xudINLflIw/e2z2nn3PM5yXOD4ESCEL2kh7t65/QPisUfSaUh09q/ItEAirSwMNd3dXcIi4xDr4QCRLnVJSXd3nKUKGDL11y3G4M6z8biexevkF2PssVbQWr4oiD09OEJg+Rai/1Gt6OKNfJ2tqYu2mXUVWVDzkpObYxCt0XhJWkUQ3IpsLE10h5x6qlbl6YaF3We3gMuP4hjSRCZI1MmKB1q1i8XyShImOywxmCsMLl2FbngZIDWvFbdTQRm0d6bma/UcA6ZS/MBy9iKVD/k3gUA5Hhm/C8PJluxDtNwPRzvEhithfDGb1OQ3+epMAxeBVKH5FaloZ2nglMv5Jx3UHeClPGX23BwhOfvwwO4vwKxqcB4F/b5NeXQRCnNcesNls/M2pr80SY0YwOPn55tPMYemjpBWcVEeXQlsV98X2ru0aq5gt5HL3Bs5VPZqjp63VvpAlnzdjXAkOZVdgmElLTdInIx+wZ6GjHT6qTDSd/DklGcBqODcVXDr+dm6FWWO7jGYPthAZGWD/XTTRWa4VTnU1801Ws4Wp6t9K2yJsr/OeNZ200R5X12rtHDDbino04N65jj3vW6eNRQfnBaaPLDfSiv15onPDSCuYm3YFgl9nWalqm1sSV0l77yhyvYGx2zPqt0bnZUqW3vlETZA+L0uMc9DUY4qv64jwqoFQp+zo4w+T4w5fc9nRVWSjzWdMjUvMyTge42OLUrBmLMbmzU2x8po9tJ5wtlqCzSnJsaRDZ0g2Wib1Vl4BQ+M22AYq2A2FA9QVRL6xdA+y1QbzOHZ/rLAOLzu6G3+cjG9mxx6ttbEkN++T3G4J1p2ZQdLMQBu0fWJmIGIyQIakEXUm7hPeXTk6uibG2I7wxtBJS0z19dP4uNKmrXMeQ+YZKTB0e4xu3vmygoLXCO1mEGyMwSzPcoClHQQDF4ZWgC3p1saR3ekyXvXHKul/1GxWkY7jf5dQ0dlp1hpoNr6pkRJjTTutDp3w3JZ4PJpNJ1vEGP6Us8zWEd0QaQSRc2i90iSPUok0aBOrchcGcb2x+xnRmBSBArdSpFFP8BpjkS8dygq15QuRPjRmcrFW6QB2F4h+W4c6OUvN7Q8pLKHrcb+vnHQrCYVSi+y6Q0Or1R1iBWUQw7pUyAdLwBAVuVuvI4okekN9UdF/xoBXQLRMp4JbV4NK9VnpjSu5aFKm6DLS1fs7uk8LLu6Gp2EwCoPgn0R553Iy2i34b2xcVZ6H2yyu1pfIXSwdbl0VZ8dmu6tPa7xxLZt2odQBhaooyXKpmmFhcHl5yaZ/P33X+4qf/wCqNICG"
        ],

[al-niessner]

Quite possible that I fixed it on PR #20 but it has not made its way to pds-gamma. Thanks.

[tloubrieu-jpl]

closed by mistake

[al-niessner]

This problem resulted because the test data set updated to add json_blob but the java software knew anything about it. As part of updating application/pds4+xml to decode ops_blob, made the discovery that there are now two blobs: json_blob and ops_blob.

Updated the ignore blob code to ignore both and process the correct one for PDS4 content type. Hence, json_blob no longer shows up with JSON content types.