Detect the MIME type of large files by examining the first chunk

Summary:
Fixes T11242. See that task for detailed discussion.

Previously, it didn't particularly matter that we don't MIME detect chunked files since they were all just big blobs of junk (PSDs, zips/tarballs, whatever) that we handled uniformly.

However, videos are large and the MIME type also matters.

  - Detect the overall mime type by detecitng the MIME type of the first chunk. This appears to work properly, at least for video.
  - Skip mime type detection on other chunks, which we were performing and ignoring. This makes uploading chunked files a little faster since we don't need to write stuff to disk.

Test Plan:
Uploaded a 50MB video locally, saw it as chunks with a "video/mp4" mime type, played it in the browser in Phabricator as an embedded HTML 5 video.

{F1706837}

Reviewers: chad

Reviewed By: chad

Maniphest Tasks: T11242

Differential Revision: https://secure.phabricator.com/D16204

Author: epriestley

src/applications/files/conduit/FileUploadChunkConduitAPIMethod.php

@@ -51,20 +51,43 @@ protected function execute(ConduitAPIRequest $request) {
       $start,
       $start + $length);
 
+    // If this is the initial chunk, leave the MIME type unset so we detect
+    // it and can update the parent file. If this is any other chunk, it has
+    // no meaningful MIME type. Provide a default type so we can avoid writing
+    // it to disk to perform MIME type detection.
+    if (!$start) {
+      $mime_type = null;
+    } else {
+      $mime_type = 'application/octet-stream';
+    }
+
     // NOTE: These files have a view policy which prevents normal access. They
     // are only accessed through the storage engine.
     $chunk_data = PhabricatorFile::newFromFileData(
       $data,
       array(
         'name' => $file->getMonogram().'.chunk-'.$chunk->getID(),
         'viewPolicy' => PhabricatorPolicies::POLICY_NOONE,
+        'mime-type' => $mime_type,
       ));
 
     $chunk->setDataFilePHID($chunk_data->getPHID())->save();
 
+    $needs_update = false;
+
     $missing = $this->loadAnyMissingChunk($viewer, $file);
     if (!$missing) {
-      $file->setIsPartial(0)->save();
+      $file->setIsPartial(0);
+      $needs_update = true;
+    }
+
+    if (!$start) {
+      $file->setMimeType($chunk_data->getMimeType());
+      $needs_update = true;
+    }
+
+    if ($needs_update) {
+      $file->save();
     }
 
     return null;

src/applications/files/storage/PhabricatorFile.php

@@ -270,10 +270,8 @@ public static function newChunkedFile(
 
     $file->setByteSize($length);
 
-    // TODO: We might be able to test the first chunk in order to figure
-    // this out more reliably, since MIME detection usually examines headers.
-    // However, enormous files are probably always either actually raw data
-    // or reasonable to treat like raw data.
+    // NOTE: Once we receive the first chunk, we'll detect its MIME type and
+    // update the parent file. This matters for large media files like video.
     $file->setMimeType('application/octet-stream');
 
     $chunked_hash = idx($params, 'chunkedHash');