Bulk import enhancements

[apexdodge]

We want to build the following enhancements to our Import from CSV feature.

• Validate each content item before inserting. If it fails validation, add it to a list of errors. This list then is turned into a CSV file that is downloaded at the end of the bulk import process so the user knows which records failed to import successfully.
• Swap out the CSV reader with one that is MIT licensed instead of Apache 2.0.
• Support for attachment field type.

[smd-11]

@apexdodge ,would like to work on this.

• Is it fine if this https://github.com/drcolombo/CsvReader (MIT License) is used.
• Need your inputs on how support for attachment field type can be implemented(for Image we can have base64 string of that image in csv but for pdf's and other file formats not sure)

[apexdodge]

@smd-11, yes, this is a good task, thank you.

• Yes, that library looks good. Go for it.
• I'm thinking the user must provide a URL to a file. If the URL is valid, download the file into memory, upload using IFileStorageProvider, then save a MediaItem to the db table, and finally the Guid from the MediaItem that was just saved can be used as the value to save to the attachment field type.

Helpful example of file storage provider:

raytha/src/Raytha.Web/Areas/Admin/Controllers/MediaItemsController.cs

Line 77 in 7a12f56

var objectKey = FileStorageUtility.CreateObjectKeyFromIdAndFileName(idForKey, file.FileName);

Helpful example of validation of fields:

raytha/src/Raytha.Application/ContentItems/Commands/EditContentItem.cs

Line 42 in 7a12f56

foreach (var field in request.Content as IDictionary<string, dynamic>)

You may want to rebase your fork from dev.

Let me know if you have any questions from that.

Thanks!

[smd-11]

@apexdodge created PR for merging.

[apexdodge]

PR merged, moving to testing. Big thanks @smd-11

[apexdodge]

Fixed a blocker that was discovered during testing.

When choosing to use local storage instead of cloud storage, a crash occurs due to missing httpcontext in background task. This is now resolved and testing can be resumed.

[apexdodge]

Released with v1.1.3