CircleCI integration tests broken - master-latest-daily charts not found

[howardjohn]

CircleCI integration tests are failing with error:

Error: Looks like "https://storage.googleapis.com/istio-prerelease/daily-build/master-latest-daily/charts" is not a valid chart repository or cannot be reached: Failed to fetch https://storage.googleapis.com/istio-prerelease/daily-build/master-latest-daily/charts/index.yaml : 404 Not Found

Example: https://circleci.com/gh/istio/istio/330161?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link

[ymesika]

I guess the easiest path to fixing it is to merge release-1.1 into master.
Otherwise do some cherry-picking (#11805 specifically with all of @sdake helm changes).

[louiscryan]

Hey Yossi - I tried this but am still getting issues

…

On Tue, Feb 19, 2019 at 12:54 PM Yossi Mesika ***@***.***> wrote: I guess the easiest path to fixing it is to merge release-1.1 into master. Otherwise do some cherry-picking (#11805 <#11805> specifically with all of @sdake <https://github.com/sdake> helm changes). — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#11853 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AIoKPKhdRsghktX2EbkIl_jIJ1Gh5iBtks5vPGSigaJpZM4bDku1> .

[sdake]

The release-1.1 charts are here:
helm repo add istio.io "https://gcsweb.istio.io/gcs/istio-prerelease/daily-build/release-1.1-latest-daily/charts/

[sdake]

As far as I can tell, the master daily charts release process is busted and is not being automatically pushed by the infrastructure. It looks like the bucket has been removed. They were previously at this address:

https://storage.googleapis.com/istio-prerelease/daily-build/master-latest-daily/charts

See:
https://github.com/istio/istio.io/pull/3249/files

To get things unblocked, I'd recommend just using the release-1.1 chart address in #11853 (comment) and hunt down the change that broke the gate.

One of the problems with our process of merging in release-1.1 without a postsubmit gate is software isn't gated, and I suspect not built nor pushed automatically - but I am not certain.

@linsun any ideas?

[pitlv2109]

Is anyone working on fixing this issue? Individual PR or branch can add a workaround by using a working charts repo, e.g. release-1.1-latest-daily/charts/, but I think an official fix would be ideal. Thanks!

[irisdingbj]

I believe @louiscryan is working on a fix for the problem

[utka]

The reason is we can not build master since 17 Feb, and the master-latest-build was deleted for latest available build 16th. I think it is deleted by script before pushing new version, but because new version does not exist, it fails.
https://storage.googleapis.com/istio-prow/logs/release-daily/216/build-log.txt

[utka]

I am triggering daily build manually now

[utka]

I manually triggered
gsutil -q cp -r 'gs://istio-prerelease/daily-build/master-20190216-09-16/*' gs://istio-prerelease/daily-build/master-latest-daily/

So master-latest-daily exists now, still going to trigger new daily release

[ozevren]

Can we close this?