Mapping screen only shows non-JSON blob fields

[RDmitchell]

On the last mapping screen, where you click the Save Mappings button and then the program proceeds to go into Matching mode, the program displays the mapped field names to the actual data, in list form. It seems like the program shows all fields except those in the extra_data field, which is the JSON blob.

I mapped a file where the only field I mapped that was not in extra_data was Tax Lot ID (all the others had field names that would force them to be put into the extra_data field) and the only field that was displayed was the Tax Lot ID field, and it took up the entire screen (!).

In this screen we should show all the fields that were in the previous mapping screen, whether or not they are in a JSON blob field.

This may not be quite so important after the data model restructuring, because there will be fewer fields in JSON blob fields, but whatever data is in those fields needs to be displayed on the final mapping screen

[RDmitchell]

Get an example file together.

[RDmitchell]

Here is a link to an example file that should show this problem.

https://drive.google.com/a/lbl.gov/folderview?id=0B3fTKpZ9Dx7LOWlRd04wbjlVUXc&usp=sharing

[nicholasserra]

This seems to only happen the first time a new extra_data field is introduced. I suspect it is related to how the Columns table works.

To show this, import the test file and specify new extra_data field names for the fields. If you then go back to mapping and hit save mappings again, they'll all be on the mapping screen.

[nicholasserra]

I have a fix for this in progress.

[RDmitchell]

Interesting ... and I think that makes sense, thinking back about my experiences with mapping.

Thanks for working on this !!

[RDmitchell]

@nicholasserra -- I can't seem to import this test file into any of my test accounts on seedtest. I have tried 3 different ones (61, 11 and 86). They all seem to hang at 45% in the "Upload your building data" screen. This file only has 6 fields and 9 records, so it should upload quickly.

I will try importing other files and see if it is a more universal problem. If it is, I will make a new issue.

[RDmitchell]

@nicholasserra -- this seems to be a more universal problem -- I can't upload the covered building sample data. I just tried it on seed production and it uploads within a few seconds. On seedtest it is stuck at 45%. I will make a new issue and come back to testing this issue when the import problem is fixed.

[RDmitchell]

Miles restarted celery, now I am able to import files.

Now I can get to the mapping screen, and below is how I mapped the file

But now the program seems to hang at 0% mapping.

3 minutes in, still at 0%, no errors in console. am cancelling it.

[RDmitchell]

@nicholasserra -- am handing this back to you because I can't get the test file to map. Could be another problem with seedtest, but decided to put this back in your queue. You can make a new issue if there is a problem with mapping.

[RDmitchell]

am taking this back because I think the mapping problem is not related to this bug. When that is figured out I will test this.

[RDmitchell]

Thanks Nick -- looks great !