Youtube Metadata - Creation date missing with some videos.

[maborak]

Checklist

• I'm reporting a broken site support issue

• I've verified that I'm running youtube-dl version 2020.03.24

• I've read bugs section in FAQ

• I've checked that all provided URLs are alive and playable in a browser

• I've checked that all URLs and arguments with special characters are properly quoted or escaped

• I've searched the bugtracker for similar bug reports including closed ones

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'https://www.youtube.com/watch?v=VGv2_7sCkAc']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2020.03.24
[debug] Git HEAD: 049c0486b
[debug] Python version 2.7.5 (CPython) - Linux-3.10.0-1062.18.1.el7.x86_64-x86_64-with-centos-7.7.1908-Core
[debug] exe versions: ffmpeg 3.4.7, ffprobe 3.4.7
[debug] Proxy map: {}
[youtube] VGv2_7sCkAc: Downloading webpage
[youtube] VGv2_7sCkAc: Downloading MPD manifest
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on u'https://manifest.googlevideo.com/api/manifest/dash/expire/1585473170/ei/MhKAXseVBcO_wgSZiZAI/ip/181.188.177.68/id/546bf6ffbb029007/source/youtube/requiressl/yes/playback_host/r2---sn-upbvcv-a2cl.googlevideo.com/mh/8d/mm/31%2C29/mn/sn-upbvcv-a2cl%2Csn-bvvbax-aphe/ms/au%2Crdu/mv/m/mvi/1/pl/24/nh/%2CEAE/hfr/all/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cwebm2_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm2_sd_hd_clear/initcwndbps/540000/vprv/1/mt/1585451488/fvip/2/keepalive/yes/itag/0/sparams/expire%2Cei%2Cip%2Cid%2Csource%2Crequiressl%2Chfr%2Cas%2Cvprv%2Citag/sig/AJpPlLswRQIgPjUiQXUcy4OhY_b4CjWODP6CQ8BlGHFdlbnH7m6Mq_8CIQCZf-yeSL4lVXRhwZBvmbu0I41TSQQ7raIqZkfBmB77gg%3D%3D/lsparams/playback_host%2Cmh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cnh%2Cinitcwndbps/lsig/ALrAebAwRgIhAPL3e1pt76n0X6BcIjIn-QLqHG_NZ3iURhFcjNT9SdwFAiEAh3pj19_B3lhw4QPYiRxWMeHuT7wSHLKNj_LeRV6BCR4%3D'
[dashsegments] Total fragments: 221
[download] Destination: React.js _ Configuración de React con CDN y Babel-VGv2_7sCkAc.f247.webm
[download] 100% of 27.25MiB in 02:15
[debug] Invoking downloader on u'https://manifest.googlevideo.com/api/manifest/dash/expire/1585473170/ei/MhKAXseVBcO_wgSZiZAI/ip/181.188.177.68/id/546bf6ffbb029007/source/youtube/requiressl/yes/playback_host/r2---sn-upbvcv-a2cl.googlevideo.com/mh/8d/mm/31%2C29/mn/sn-upbvcv-a2cl%2Csn-bvvbax-aphe/ms/au%2Crdu/mv/m/mvi/1/pl/24/nh/%2CEAE/hfr/all/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cwebm2_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm2_sd_hd_clear/initcwndbps/540000/vprv/1/mt/1585451488/fvip/2/keepalive/yes/itag/0/sparams/expire%2Cei%2Cip%2Cid%2Csource%2Crequiressl%2Chfr%2Cas%2Cvprv%2Citag/sig/AJpPlLswRQIgPjUiQXUcy4OhY_b4CjWODP6CQ8BlGHFdlbnH7m6Mq_8CIQCZf-yeSL4lVXRhwZBvmbu0I41TSQQ7raIqZkfBmB77gg%3D%3D/lsparams/playback_host%2Cmh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cnh%2Cinitcwndbps/lsig/ALrAebAwRgIhAPL3e1pt76n0X6BcIjIn-QLqHG_NZ3iURhFcjNT9SdwFAiEAh3pj19_B3lhw4QPYiRxWMeHuT7wSHLKNj_LeRV6BCR4%3D'
[dashsegments] Total fragments: 118
[download] Destination: React.js _ Configuración de React con CDN y Babel-VGv2_7sCkAc.f251.webm
[download] 100% of 18.72MiB in 00:19
React.js _ Configuración de React con CDN y Babel-VGv2_7sCkAc.webm
[ffmpeg] Merging formats into "React.js _ Configuración de React con CDN y Babel-VGv2_7sCkAc.webm"
[debug] ffmpeg command line: ffmpeg -y -loglevel 'repeat+info' -i 'file:React.js _ Configuración de React con CDN y Babel-VGv2_7sCkAc.f247.webm' -i 'file:React.js _ Configuración de React con CDN y Babel-VGv2_7sCkAc.f251.webm' -c copy -map '0:v:0' -map '1:a:0' 'file:React.js _ Configuración de React con CDN y Babel-VGv2_7sCkAc.temp.webm'
Deleting original file React.js _ Configuración de React con CDN y Babel-VGv2_7sCkAc.f247.webm (pass -k to keep)
Deleting original file React.js _ Configuración de React con CDN y Babel-VGv2_7sCkAc.f251.webm (pass -k to keep)

Description

I am downloading this url: https://www.youtube.com/watch?v=VGv2_7sCkAc

Once the video is downloaded the FILE DATE is the CURRENT TIME ( Mar 28 23:15 ) and not the time when the video mas uploaded ( Mar 17, 2018 ).

  File: ‘React.js _ Configuración de React con CDN y Babel-VGv2_7sCkAc.webm’
  Size: 48210750        Blocks: 94168      IO Block: 4096   regular file
Device: fd00h/64768d    Inode: 13140645    Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2020-03-28 23:15:45.534022377 -0400
Modify: 2020-03-28 23:15:06.810632000 -0400
Change: 2020-03-28 23:15:27.603327117 -0400
 Birth: -

With other videos like: https://www.youtube.com/watch?v=u2Ms34GE14U
I do not have this issue, in this case the Date is: Apr 4 2019 ¿Qué son las APIs y para qué sirven-u2Ms34GE14U.mkv

  File: ‘¿Qué son las APIs y para qué sirven-u2Ms34GE14U.mkv’
  Size: 216252263       Blocks: 422368     IO Block: 4096   regular file
Device: fd00h/64768d    Inode: 13140648    Links: 1
Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2019-04-04 19:11:23.000000000 -0400
Modify: 2019-04-04 19:11:23.000000000 -0400
Change: 2020-03-28 23:16:56.094136839 -0400
 Birth: -

Is this something related to FFMEG?

Thank you

[dstftw]

1. It's Last-Modified header not upload date.
2. It's only set for plain HTTP downloads.

[maborak]

Thank you for the response

1. It's Last-Modified header not upload date.

Yes, I found in the code the method to add the utime and atime to temporary files

youtube-dl/youtube_dl/downloader/common.py

Line 206 in 049c048

def try_utime(self, filename, last_modified_hdr):

But this code does not work with fragments ( http_dash_segments ).

As you see here:

• The fragments class create a TMP file ( without correct atime, mtime )
  

  youtube-dl/youtube_dl/downloader/fragment.py

  Line 182 in 049c048

  dest_stream, tmpfilename = sanitize_open(tmpfilename, open_mode)

• These TMP files are used to calculate the final atime, mtime
  

  youtube-dl/youtube_dl/postprocessor/ffmpeg.py

  Line 209 in 049c048

  oldest_mtime = min(

• So, to the end the final atime. mtime are the new created temporary file.

Suggestion

The http_dash_segments engine should use the first fragment as mtime, atime