Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

YouTube annotation file download is incomplete #13458

Closed
kevinlul opened this issue Jun 21, 2017 · 2 comments
Closed

YouTube annotation file download is incomplete #13458

kevinlul opened this issue Jun 21, 2017 · 2 comments
Labels

Comments

@kevinlul
Copy link

@kevinlul kevinlul commented Jun 21, 2017

Please follow the guide below

  • You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
  • Put an x into all the boxes [ ] relevant to your issue (like that [x])
  • Use Preview tab to see how your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2017.06.18. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

  • I've verified and I assure that I'm running youtube-dl 2017.06.18

Before submitting an issue make sure you have:

  • [X ] At least skimmed through README and most notably FAQ and BUGS sections
  • [X ] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

  • [X ] Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue


If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:

Add -v flag to your command line you run youtube-dl with, copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):

D:\Programs\YouTube Download Utility>youtube-dl --write-annotations -v https://www.youtube.com/watch?v=8jYyq3lCgGs
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--write-annotations', '-v', 'https://www.youtube.com/watch?v=8jYyq3lCgGs']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2017.06.18
[debug] Python version 3.4.4 - Windows-10-10.0.10586
[debug] exe versions: none
[debug] Proxy map: {}
[youtube] 8jYyq3lCgGs: Downloading webpage
[youtube] 8jYyq3lCgGs: Downloading video info webpage
[youtube] 8jYyq3lCgGs: Extracting video information
[youtube] 8jYyq3lCgGs: Searching for annotations.
[youtube] {43} signature length 40.42, html5 player vfl1Renoe
[youtube] {18} signature length 40.42, html5 player vfl1Renoe
[youtube] {36} signature length 40.42, html5 player vfl1Renoe
[youtube] {17} signature length 40.42, html5 player vfl1Renoe
[youtube] {134} signature length 40.42, html5 player vfl1Renoe
[youtube] {243} signature length 40.42, html5 player vfl1Renoe
[youtube] {133} signature length 40.42, html5 player vfl1Renoe
[youtube] {242} signature length 40.42, html5 player vfl1Renoe
[youtube] {160} signature length 40.42, html5 player vfl1Renoe
[youtube] {278} signature length 40.42, html5 player vfl1Renoe
[youtube] {140} signature length 40.42, html5 player vfl1Renoe
[youtube] {171} signature length 40.42, html5 player vfl1Renoe
[youtube] {249} signature length 40.42, html5 player vfl1Renoe
[youtube] {250} signature length 40.42, html5 player vfl1Renoe
[youtube] {251} signature length 40.42, html5 player vfl1Renoe
[youtube] 8jYyq3lCgGs: Downloading MPD manifest
[info] Writing video annotations to: Hiiro no Kakera Opening - Nee-8jYyq3lCgGs.annotations.xml
[debug] Invoking downloader on 'https://r7---sn-ni5f-ttjl.googlevideo.com/videoplayback?initcwndbps=2392500&gir=yes&mm=31&mn=sn-ni5f-ttjl&id=o-AIK0EjyJl9ep2oQfVjjM5ziNhb2di5GC_I5jtM9rBvLs&mt=1498073799&source=youtube&mv=m&ms=au&ip=70.65.124.15&clen=8393932&ei=CMtKWZDWFsn8DfunkKgB&pl=22&ipbits=0&pcm2cms=yes&requiressl=yes&ratebypass=yes&itag=43&lmt=1335960887362144&dur=0.000&expire=1498095464&mime=video%2Fwebm&key=yt6&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cpcm2cms%2Cpl%2Cratebypass%2Crequiressl%2Csource%2Cexpire&signature=E083F1AA891C6299BD1352470E34C3364CCBF81D.856DBE06DB3883C3F71D1BC837DBAA7E9086F281'
[download] Destination: Hiiro no Kakera Opening - Nee-8jYyq3lCgGs.webm
[download] 100% of 8.01MiB in 00:04

D:\Programs\YouTube Download Utility>
...
<end of log>

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.


Description of your issue, suggested solution and other information

The annotations for that video are the lyrics. However, only 14 annotations are downloaded, whereas there are clearly more. For example, the first annotation is missing, and the first line recorded is "Watashi wa kimi o omotte iru yo". Numerous annotations are skipped.

@dstftw
Copy link
Collaborator

@dstftw dstftw commented Jun 21, 2017

<?xml version="1.0" encoding="UTF-8" ?><document><annotations itct="CAAQwOYBIhMIjY7_rt3P1AIVRAQYCh3DZA5-KPgdMgJpdkjrgIrKt9WMm_IB">
<annotation id="annotation_127964" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_127964&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="CAEQs-UBGP___________wEiEwiNjv-u3c_UAhVEBBgKHcNkDn4o-B0yAml2SOuAisq31Yyb8gE">
  <TEXT>Watashi wa kimi o omotte iru yo</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="36.12000" y="87.77800" w="34.70000" h="10.27800" t="0:00:06.5"/>
      <rectRegion x="36.12000" y="87.77800" w="34.70000" h="10.27800" t="0:00:14.6"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.91159166666667" effects="textdropshadow">
    <padding top="2.34695506096" left="1.33265578747" bottom="2.34695506096" right="1.77687442303"/>
  </appearance>
  
</annotation>
<annotation id="annotation_379026" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_379026&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="CAIQs-UBGP___________wEiEwiNjv-u3c_UAhVEBBgKHcNkDn4o-B0yAml2SOuAisq31Yyb8gE">
  <TEXT>Tsumetai ame zubunure ni natte&#39;ta watashi ni</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="26.18300" y="87.77800" w="48.73800" h="10.27800" t="0:00:26.6"/>
      <rectRegion x="26.18300" y="87.77800" w="48.73800" h="10.27800" t="0:00:31.9"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.91159166666667" effects="textdropshadow">
    <padding top="2.34695506096" left="1.33265578747" bottom="2.34695506096" right="1.77687442303"/>
  </appearance>
  
</annotation>
<annotation id="annotation_420390" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_420390&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="CAMQs-UBGP___________wEiEwiNjv-u3c_UAhVEBBgKHcNkDn4o-B0yAml2SOuAisq31Yyb8gE">
  <TEXT>Suki ni naru tte kurushii&#39;n da ne</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="32.65000" y="87.22200" w="35.64700" h="10.83300" t="0:00:58.5"/>
      <rectRegion x="32.65000" y="87.22200" w="35.64700" h="10.83300" t="0:01:03.2"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.91159166666667" effects="textdropshadow">
    <padding top="2.34695506096" left="1.33265578747" bottom="2.34695506096" right="1.77687442303"/>
  </appearance>
  
</annotation>
<annotation id="annotation_464447" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_464447&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="CAQQs-UBGP___________wEiEwiNjv-u3c_UAhVEBBgKHcNkDn4o-B0yAml2SOuAisq31Yyb8gE">
  <TEXT>Nee, nani shite mo kimi ni aitaku naru yo</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="28.86400" y="87.77800" w="43.84900" h="10.27800" t="0:00:53.5"/>
      <rectRegion x="28.86400" y="87.77800" w="43.84900" h="10.27800" t="0:00:58.5"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.91159166666667" effects="textdropshadow">
    <padding top="2.34695506096" left="1.33265578747" bottom="2.34695506096" right="1.77687442303"/>
  </appearance>
  
</annotation>
<annotation id="annotation_528585" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_528585&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="CAUQs-UBGP___________wEiEwiNjv-u3c_UAhVEBBgKHcNkDn4o-B0yAml2SOuAisq31Yyb8gE">
  <TEXT>Naze itsumo kimi nandarou</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="36.90900" y="88.61100" w="30.59900" h="9.72200" t="0:00:36.4"/>
      <rectRegion x="36.90900" y="88.61100" w="30.59900" h="9.72200" t="0:00:41.4"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.91159166666667" effects="textdropshadow">
    <padding top="2.34695506096" left="1.33265578747" bottom="2.34695506096" right="1.77687442303"/>
  </appearance>
  
</annotation>
<annotation id="annotation_615960" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_615960&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="CAYQs-UBGP___________wEiEwiNjv-u3c_UAhVEBBgKHcNkDn4o-B0yAml2SOuAisq31Yyb8gE">
  <TEXT>Mado o akeru to kanjita, ah, yoru no nioi</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="30.75700" y="88.05600" w="43.37500" h="10.00000" t="0:00:17.1"/>
      <rectRegion x="30.75700" y="88.05600" w="43.37500" h="10.00000" t="0:00:21.5"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.91159166666667" effects="textdropshadow">
    <padding top="2.34695506096" left="1.33265578747" bottom="2.34695506096" right="1.77687442303"/>
  </appearance>
  
</annotation>
<annotation id="annotation_709438" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_709438&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="CAcQs-UBGP___________wEiEwiNjv-u3c_UAhVEBBgKHcNkDn4o-B0yAml2SOuAisq31Yyb8gE">
  <TEXT>Sasaete kureru hito wa</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="39.11700" y="88.33300" w="27.12900" h="9.44400" t="0:00:41.4"/>
      <rectRegion x="39.11700" y="88.33300" w="27.12900" h="9.44400" t="0:00:46.3"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.91159166666667" effects="textdropshadow">
    <padding top="2.34695506096" left="1.33265578747" bottom="2.34695506096" right="1.77687442303"/>
  </appearance>
  
</annotation>
<annotation id="annotation_735617" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_735617&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="CAgQs-UBGP___________wEiEwiNjv-u3c_UAhVEBBgKHcNkDn4o-B0yAml2SOuAisq31Yyb8gE">
  <TEXT>Nee kimi wa ima dare o omotte iru no?</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="30.59900" y="87.50000" w="41.48300" h="10.27800" t="0:00:00.0"/>
      <rectRegion x="30.59900" y="87.50000" w="41.48300" h="10.27800" t="0:00:06.5"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.91159166666667" effects="textdropshadow">
    <padding top="2.34695506096" left="1.33265578747" bottom="2.34695506096" right="1.77687442303"/>
  </appearance>
  
</annotation>
<annotation id="annotation_778002" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_778002&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="CAkQs-UBGP___________wEiEwiNjv-u3c_UAhVEBBgKHcNkDn4o-B0yAml2SOuAisq31Yyb8gE">
  <TEXT>Itsu de mo riyuu wa kimi dake dayo</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="30.91500" y="87.77800" w="38.32800" h="10.00000" t="0:01:08.5"/>
      <rectRegion x="30.91500" y="87.77800" w="38.32800" h="10.00000" t="0:01:15.7"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.91159166666667" effects="textdropshadow">
    <padding top="2.34695506096" left="1.33265578747" bottom="2.34695506096" right="1.77687442303"/>
  </appearance>
  
</annotation>
<annotation id="annotation_778429" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_778429&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="CAoQs-UBGP___________wEiEwiNjv-u3c_UAhVEBBgKHcNkDn4o-B0yAml2SOuAisq31Yyb8gE">
  <TEXT>Sono tabi, mata suki ni natte yuku</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="33.91200" y="88.05600" w="37.06600" h="9.44400" t="0:00:46.3"/>
      <rectRegion x="33.91200" y="88.05600" w="37.06600" h="9.44400" t="0:00:53.5"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.91159166666667" effects="textdropshadow">
    <padding top="2.34695506096" left="1.33265578747" bottom="2.34695506096" right="1.77687442303"/>
  </appearance>
  
</annotation>
<annotation id="annotation_90770" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_90770&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="">
  <TEXT>Ima dare no kao ga kokoro no naka ni ukanda?</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="26.65600" y="87.22200" w="50.78900" h="10.27800" t="0:00:21.6"/>
      <rectRegion x="26.65600" y="87.22200" w="50.78900" h="10.27800" t="0:00:26.5"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.9116" effects="textdropshadow">
    <padding top="2.34696006775" left="1.33265864849" bottom="2.34696006775" right="1.77687823772"/>
  </appearance>
  
</annotation>
<annotation id="annotation_931976" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_931976&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="">
  <TEXT>Ima kimi wo omotteru yo</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="39.27400" y="87.50000" w="26.97200" h="10.00000" t="0:01:19.1"/>
      <rectRegion x="39.27400" y="87.50000" w="26.97200" h="10.00000" t="0:01:26.3"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.9116" effects="textdropshadow">
    <padding top="2.34696006775" left="1.33265864849" bottom="2.34696006775" right="1.77687823772"/>
  </appearance>
  
</annotation>
<annotation id="annotation_956237" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_956237&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="">
  <TEXT>Kimi dake ga sono te o sashinobete kureta&#39;n da</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="26.02500" y="87.50000" w="51.26200" h="10.83300" t="0:00:31.9"/>
      <rectRegion x="26.02500" y="87.50000" w="51.26200" h="10.83300" t="0:00:36.4"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.91159166666667" effects="textdropshadow">
    <padding top="2.34695506096" left="1.33265578747" bottom="2.34695506096" right="1.77687442303"/>
  </appearance>
  
</annotation>
<annotation id="annotation_960031" type="text" style="popup" log_data="xble=1&amp;a-v=8jYyq3lCgGs&amp;a-type=1&amp;a-id=annotation_960031&amp;ei=oNBKWY2-CcSIYMPJufAH" itct="">
  <TEXT>Ureshiku naru no mo setsunaku saseru no mo</TEXT>
  <segment>
    <movingRegion type="rect">
      <rectRegion x="26.97200" y="89.16700" w="49.21100" h="10.00000" t="0:01:03.2"/>
      <rectRegion x="26.97200" y="89.16700" w="49.21100" h="10.00000" t="0:01:08.5"/>
    </movingRegion>
  </segment>
  <appearance bgAlpha="0.600000023842" bgColor="0" fgColor="16777215" textSize="3.91159166666667" effects="textdropshadow">
    <padding top="2.34695506096" left="1.33265578747" bottom="2.34695506096" right="1.77687442303"/>
  </appearance>
  
</annotation></annotations></document>

Downloaded annotations contain ALL annotations displayed in video. There are exactly 14 annotations displayed in the video. Bother to count them first.

@dstftw dstftw closed this Jun 21, 2017
@dstftw dstftw added the invalid label Jun 21, 2017
@kevinlul
Copy link
Author

@kevinlul kevinlul commented Jun 22, 2017

Sorry. Comical fail by me. Annotations don't have to be in chronological order.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.