obs_clone: started to fail cloning openSUSE:Factory:Staging:C

[jberry-suse]

Sometime between last merge and #1334 (a few hours) the obs_clone.py script fails to complete which causes the tests that rely on that data to fail. Presumably either OBS changed something or the data itself was changed in a way that needs to be handled.

The last bit from the log that I reproduce on travis and locally.

clone source/openSUSE:Factory:Rings:0-Bootstrap/_meta
CACHE_MISS https://api.opensuse.org/source/openSUSE:Factory:Rings:0-Bootstrap/_meta (expired)
GET https://api.opensuse.org/source/openSUSE:Factory:Rings:0-Bootstrap/_meta
CACHE_PUT https://api.opensuse.org/source/openSUSE:Factory:Rings:0-Bootstrap/_meta None
skip person/coolo
WARNING: SSL certificate checks disabled. Connection is insecure!

PUT http://0.0.0.0:3000/source/openSUSE:Factory:Rings:0-Bootstrap/_meta
clone source/openSUSE:Factory:Staging:C/_meta
CACHE_MISS https://api.opensuse.org/source/openSUSE:Factory:Staging:C/_meta (does not exist)
GET https://api.opensuse.org/source/openSUSE:Factory:Staging:C/_meta
CACHE_PUT https://api.opensuse.org/source/openSUSE:Factory:Staging:C/_meta None
WARNING: SSL certificate checks disabled. Connection is insecure!

PUT http://0.0.0.0:3000/source/openSUSE:Factory:Staging:C/_meta
<status code="unknown_project">
  <summary>openSUSE:Factory:Rings:1-MinimalX</summary>
</status>

[jberry-suse]

Gist containing log from the last successfully run on travis-ci vs the current failing output and a diff.

https://gist.github.com/jberry-suse/4ac4c491ac3903d4cbe06604bd59f92a

[jberry-suse]

The output seems further confused by the order that gets messed up on travis-ci since cache output is to stderr and rest is to stdout.

[jberry-suse]

Cleanup using ^(CACHE.*|GET|PUT|POST|WARNING:) .*\n for more direct comparison.

https://gist.github.com/jberry-suse/fcd2847a33e1e39711484799c6ecb8b8

[jberry-suse]

It seems source/openSUSE:Factory:ToTest is missed entirely. Not sure if this has something to do with what @DimStar77 was discussing in IRC.

[jberry-suse]

Something changed in data structure to no longer require :ToTest and pickup :C. Granted it likely should be handleable, but obs_clone certainly does not handle everything.

[jberry-suse]

# r429 | dimstar_suse | 2018-01-10 23:02:48 | 7a3ea49d400124d87d5f53b6d3dc7ecd | None |
osc rdiff -M -c 429 openSUSE:Factory

Index: _meta
===================================================================
--- _meta (revision 428)
+++ _meta (revision 429)
@@ -32,7 +32,8 @@
     <arch>x86_64</arch>
     <arch>i586</arch>
   </repository>
-  <repository name="standard" rebuild="local">
+  <repository name="standard" rebuild="direct">
+    <path project="openSUSE:Factory:Rings:0-Bootstrap" repository="standard" />
     <arch>x86_64</arch>
     <arch>i586</arch>
   </repository>

[jberry-suse]

$ osc api /source/openSUSE:Factory:Rings:0-Bootstrap/_meta
<project name="openSUSE:Factory:Rings:0-Bootstrap">
  <title>The bootstrap cycle of factory</title>
  <description/>
  <person userid="coolo" role="maintainer"/>
  <build>
    <enable arch="x86_64"/>
  </build>
  <publish>
    <disable/>
  </publish>
  <debuginfo>
    <enable/>
  </debuginfo>
  <repository name="standard" rebuild="direct">
    <path project="openSUSE:Factory:Staging:C" repository="bootstrap_copy"/>
    <path project="openSUSE:Factory" repository="ports"/>
    <arch>x86_64</arch>
    <arch>i586</arch>
  </repository>
</project>

Well that explains that. Can likely enhance tool to handle case, but presumably this will be reverted tomorrow after the hiccup has healed.