extensive duplication in drugbank.mixtures

[andrewsu]

for example, see http://mychem.info/v1/chem/KTUFNOKKBVMGRW-UHFFFAOYSA-N?fields=drugbank,drugcentral

screenshot:

[newgene]

This seems not being solved in the recent data release. More examples here:

http://mychem.info/v1/query?q=_exists_:drugbank.mixtures&fields=drugbank.mixtures,drugbank.name

@greg-k-taylor

[greg-k-taylor]

This patch may solve the problem. It appears inefficient (during the parsing step) but removes duplicates. Below is a link to the patch and a list of a few documents without duplicates. I spot checked DB00007, DB00008, and DB00009 which have duplicates in the current version of mychem.info.

greg-k-taylor@f294b27

Here is a short list of documents without duplicates (using the patch):
{ "_id" : "DB00007", "drugbank" : { "mixtures" : [ { "name" : "Lupaneta Pack", "ingredients" : [ "Leuprolide", "Norethisterone" ] } ] } }
{ "_id" : "DB00008", "drugbank" : { "mixtures" : [ { "name" : "Pegasys Rbv", "ingredients" : [ "Peginterferon alfa-2a", "Ribavirin" ] } ] } }
{ "_id" : "DB00009", "drugbank" : { "mixtures" : [ { "name" : "Lysatec RT - Pa", "ingredients" : [ "Alteplase", "Water" ] }, { "name" : "Activase RT-PA", "ingredients" : [ "Alteplase", "Water" ] }

[newgene]

Now in pull request: #57

[greg-k-taylor]

Pull request merged and closed.

[greg-k-taylor]

Ooops, not verified in production yet.