Support searching on original file formats (i.e. RData) when tabular data is successfully ingested

[pdurbin]

http://economics.stackexchange.com/questions/8922/examples-of-applied-micro-paper-with-r-code-and-data-in-public-repository is an example of someone looking specifically for data in RData format. We should support this use case.

Here's the problem. As of #2038 (comment) you can search for RData with "fileContentType:application/x-rlang-transport" ( https://dataverse.harvard.edu/dataverse/harvard?q=fileContentType%3Aapplication%2Fx-rlang-transport ) (good!) but only if the RData file failed to ingest. https://dataverse.harvard.edu/dataset.xhtml?persistentId=hdl:1902.1/21042 for example has a mix of RData files where some of them were ingested but many where not. The ones that were not ingested will be searchable with the query above. To search specifically within that dataverse:

• show RData files that have not been successfully ingested: https://dataverse.harvard.edu/dataverse/pan?q=fileContentType%3Aapplication%2Fx-rlang-transport
• show RData files that have been successfully ingested and converted to tab-separated files (and other TSV files): https://dataverse.harvard.edu/dataverse/pan?q=fileContentType%3Atext%2Ftab-separated-values

So what's going on? When an RData file is successfully ingested, at index time what's being indexed is "fileContentType":"text/tab-separated-values" rather than "fileContentType":"application/x-rlang-transport". Here's an example Solr document from https://demo.dataverse.org/dataset.xhtml?persistentId=doi:10.5072/FK2/VJ1Y9K where an RData file was successfully ingested:

  {
    "entityId":1430,
    "dataverseVersionIndexedBy_s":"4.2",
    "identifier":"1430",
    "persistentUrl":"http://dx.doi.org/10.5072/FK2/VJ1Y9K",
    "dvObjectType":"files",
    "fileNameWithoutExtension":["Multiplication Table-Multiplication Table"],
    "fileName":["Multiplication Table-Multiplication Table",
      "Multiplication Table-Multiplication Table.tab"],
    "name":"Multiplication Table-Multiplication Table.tab",
    "nameSort":"Multiplication Table-Multiplication Table.tab",
    "datasetVersionId":463,
    "fileAccess":["Public"],
    "dateSort":"2015-10-21T13:54:56.908Z",
    "dateFriendly":"Oct 21, 2015",
    "publicationStatus":["Published"],
    "publicationDate":"2015",
    "dsPublicationDate":"2015",
    "id":"datafile_1430",
    "fileTypeDisplay":"Tab-Delimited",
    "fileContentType":"text/tab-separated-values",
    "fileType":["Tab-Delimited",
      "tabulardata"],
    "fileTypeGroupFacet":"tabulardata",
    "fileSizeInBytes":499,
    "fileMd5":"e33a7b3ef797d8945d5fa9d175518cd1",
    "unf":"UNF:6:SHOdLOf1LEtmuZnBTFRilg==",
    "subtreePaths":["/1424"],
    "parentId":"1425",
    "parentIdentifier":"doi:10.5072/FK2/VJ1Y9K",
    "parentCitation":"Liscouski, Amanda, 2015, \"Pretium\", http://dx.doi.org/10.5072/FK2/VJ1Y9K,  Demo Dataverse,  DRAFT VERSION ",
    "parentName":"Pretium",
    "variableName":["x",
      "0",
      "1",
      "2",
      "3",
      "4",
      "5",
      "6",
      "7",
      "8",
      "9",
      "10",
      "11",
      "12"],
    "variableLabel":["x",
      "0",
      "1",
      "2",
      "3",
      "4",
      "5",
      "6",
      "7",
      "8",
      "9",
      "10",
      "11",
      "12"],
    "_version_":1515655756533202944}

[pdurbin]

Related: Advanced Search: make File Type a dropdown driven by uploaded data #543

[pdurbin]

A recent comment by @landreev at #2822 (comment) gives me hope that we can fix this some day.

[pdurbin]

Closing in favor of #2822.