Skip to content
This repository was archived by the owner on Sep 17, 2024. It is now read-only.

feat: add licenses and support for generating notice files#175

Merged
mdelapenya merged 3 commits intoelastic:masterfrom
mdelapenya:licenses
Jul 17, 2020
Merged

feat: add licenses and support for generating notice files#175
mdelapenya merged 3 commits intoelastic:masterfrom
mdelapenya:licenses

Conversation

@mdelapenya
Copy link
Copy Markdown
Contributor

What is this PR doing?

It's addding Elastic's license to all source code, plus the automation to generate NOTICE.txt from the existing Go depenencies, as used in the Beats project.

Why is it important?

As this is a public repo, we want to be consistent with our Open Source policies

Follow-ups

Because the e2e module is consuming the CLI, we need CLI's license file to be pushed first before submitting the e2e.

As this project is starting to be GA, we will generate a 1.0.0 tag for the CLI

@mdelapenya mdelapenya self-assigned this Jul 17, 2020
@mdelapenya mdelapenya requested review from a team and EricDavisX July 17, 2020 08:06
@mdelapenya mdelapenya added automation documentation Improvements or additions to documentation labels Jul 17, 2020
@mdelapenya mdelapenya requested a review from mostlyjason July 17, 2020 08:09
@mdelapenya mdelapenya marked this pull request as ready for review July 17, 2020 08:09
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Jul 17, 2020

💔 Tests Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Branch indexing]

  • Start Time: 2020-07-17T10:48:02.670+0000

  • Duration: 20 min 9 sec

Test stats 🧪

Test Results
Failed 3
Passed 49
Skipped 14
Total 66

Test errors

Expand to view the tests failures

  • Name: Initializing / Tests / Sanity checks / Fix End of Files – pre_commit.lint

    • Age: 1
    • Duration: 0
    • Error Details: error
  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Un-enrolling an agent – Fleet Mode Agent

    • Age: 1
    • Duration: 23.931095
    • Error Details: Step the agent is not listed as online in Fleet: The Agent is still online
  • Name: Initializing / End-To-End Tests / ingest-manager_fleet_mode / Re-enrolling an agent – Fleet Mode Agent

    • Age: 1
    • Duration: 55.289032
    • Error Details: Step the agent is listed in Fleet as online: There are 4 online agents. We expected to have exactly one

Steps errors

Expand to view the steps failures

  • Name: Run functional tests for ingest-manager:fleet_mode

    • Description:

    • Duration: 11 min 51 sec

    • Start Time: 2020-07-17T10:55:46.371+0000

    • log

  • Name: Error signal

    • Description:

    • Duration: 0 min 0 sec

    • Start Time: 2020-07-17T11:06:37.619+0000

    • log

  • Name: General Build Step

    • Description: [2020-07-17T11:06:38.110Z] Archiving artifacts
      hudson.AbortException: script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-07-17T11:06:38.100+0000

    • log

Log output

Expand to view the last 100 lines of log output

[2020-07-17T11:06:23.126Z] time="2020-07-17T11:06:23Z" level=warning msg="Waiting for more hits in the index" currentHits=4 desiredHits=5 elapsedTime=20.596070344s index=metricbeat-7.8.0-mysql-percona-5.7.24-dkme9ldg retry=8
[2020-07-17T11:06:29.710Z] time="2020-07-17T11:06:29Z" level=info msg="Hits number satisfied" currentHits=5 desiredHits=5 elapsedTime=26.508793957s retries=9
[2020-07-17T11:06:29.710Z] time="2020-07-17T11:06:29Z" level=info msg="Hits number satisfied" currentHits=5 desiredHits=5 elapsedTime=6.304062ms retries=1
[2020-07-17T11:06:29.710Z] Stopping metricbeat_metricbeat_1 ... 
[2020-07-17T11:06:30.232Z] 
Stopping metricbeat_metricbeat_1 ... done
Removing metricbeat_metricbeat_1 ... 
[2020-07-17T11:06:30.233Z] 
Removing metricbeat_metricbeat_1 ... done
Going to remove metricbeat_metricbeat_1
[2020-07-17T11:06:30.805Z] Stopping metricbeat_mysql_1 ... 
[2020-07-17T11:06:31.755Z] 
Stopping ingest-manager_centos_2 ... done
Removing ingest-manager_centos_2 ... 
[2020-07-17T11:06:31.755Z] 
Removing ingest-manager_centos_2 ... done
Going to remove ingest-manager_centos_2
[2020-07-17T11:06:32.014Z] Stopping ingest-manager_kibana_1           ... 
[2020-07-17T11:06:32.014Z] Stopping ingest-manager_package-registry_1 ... 
[2020-07-17T11:06:32.014Z] Stopping ingest-manager_elasticsearch_1    ... 
[2020-07-17T11:06:34.109Z] 
Stopping metricbeat_mysql_1 ... done
Removing metricbeat_mysql_1 ... 
[2020-07-17T11:06:34.109Z] 
Removing metricbeat_mysql_1 ... done
Going to remove metricbeat_mysql_1
[2020-07-17T11:06:34.109Z] Pulling mysql (docker.elastic.co/integrations-ci/beats-mysql:percona-8.0.13-4-1)...
[2020-07-17T11:06:35.051Z] percona-8.0.13-4-1: Pulling from integrations-ci/beats-mysql
[2020-07-17T11:06:37.288Z] 
Stopping ingest-manager_kibana_1           ... done

Stopping ingest-manager_package-registry_1 ... done

Stopping ingest-manager_elasticsearch_1    ... done
Removing ingest-manager_kibana_1           ... 
[2020-07-17T11:06:37.288Z] Removing ingest-manager_package-registry_1 ... 
[2020-07-17T11:06:37.288Z] Removing ingest-manager_elasticsearch_1    ... 
[2020-07-17T11:06:37.288Z] 
Removing ingest-manager_package-registry_1 ... done

Removing ingest-manager_kibana_1           ... done

Removing ingest-manager_elasticsearch_1    ... done
Removing network ingest-manager_default
[2020-07-17T11:06:37.555Z] <?xml version="1.0" encoding="UTF-8"?>
[2020-07-17T11:06:37.556Z] <testsuites name="main" tests="6" skipped="0" failures="2" errors="0" time="556.608872136">
[2020-07-17T11:06:37.556Z]   <testsuite name="Fleet Mode Agent" tests="6" skipped="0" failures="2" errors="0" time="326.858557456">
[2020-07-17T11:06:37.556Z]     <testcase name="Deploying an agent" status="passed" time="38.150475326"></testcase>
[2020-07-17T11:06:37.556Z]     <testcase name="Starting the agent starts backend processes" status="passed" time="26.000526371"></testcase>
[2020-07-17T11:06:37.556Z]     <testcase name="Stopping the agent stops backend processes" status="passed" time="17.746915608"></testcase>
[2020-07-17T11:06:37.556Z]     <testcase name="Un-enrolling an agent" status="failed" time="23.931095269">
[2020-07-17T11:06:37.556Z]       <failure message="Step the agent is not listed as online in Fleet: The Agent is still online"></failure>
[2020-07-17T11:06:37.556Z]     </testcase>
[2020-07-17T11:06:37.556Z]     <testcase name="Re-enrolling an agent" status="failed" time="55.289032393">
[2020-07-17T11:06:37.556Z]       <failure message="Step the agent is listed in Fleet as online: There are 4 online agents. We expected to have exactly one"></failure>
[2020-07-17T11:06:37.556Z]     </testcase>
[2020-07-17T11:06:37.556Z]     <testcase name="Revoking the enrollment token for an agent" status="passed" time="98.483126542"></testcase>
[2020-07-17T11:06:37.556Z]   </testsuite>
[2020-07-17T11:06:37.556Z]   <testsuite name="Stand-alone Agent Mode" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
[2020-07-17T11:06:37.556Z] </testsuites>make: *** [functional-test] Error 1
[2020-07-17T11:06:37.556Z] Makefile:36: recipe for target 'functional-test' failed
[2020-07-17T11:06:37.556Z] + echo 'ERROR: functional-test failed'
[2020-07-17T11:06:37.556Z] ERROR: functional-test failed
[2020-07-17T11:06:37.556Z] + exit_status=1
[2020-07-17T11:06:37.556Z] + sed -e 's/^[ \t]*//; s#>.*failed$#>#g' outputs/TEST-ingest-manager-fleet_mode
[2020-07-17T11:06:37.556Z] + grep -E '^<.*>$'
[2020-07-17T11:06:37.556Z] + exit 1
[2020-07-17T11:06:37.644Z] Recording test results
[2020-07-17T11:06:38.110Z] Archiving artifacts
[2020-07-17T11:06:38.250Z] Failed in branch ingest-manager_fleet_mode
[2020-07-17T11:06:47.288Z] metricbeat_elasticsearch_1 is up-to-date
[2020-07-17T11:06:47.288Z] Creating metricbeat_mysql_1 ... 
[2020-07-17T11:07:12.582Z] 
Creating metricbeat_mysql_1 ... done
Found orphan containers (metricbeat_mysql_1) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up.
[2020-07-17T11:07:12.582Z] metricbeat_elasticsearch_1 is up-to-date
[2020-07-17T11:07:12.582Z] Creating metricbeat_metricbeat_1 ... 
[2020-07-17T11:07:12.582Z] 
Creating metricbeat_metricbeat_1 ... done
time="2020-07-17T11:07:11Z" level=info msg="Metricbeat is running configured for the service" metricbeatVersion=7.8.0 service=mysql serviceVersion=8.0.13-4 variant=Percona
[2020-07-17T11:07:34.550Z] time="2020-07-17T11:07:31Z" level=warning msg="Waiting for more hits in the index" currentHits=2 desiredHits=5 elapsedTime=10.091075ms index=metricbeat-7.8.0-mysql-percona-8.0.13-4-oozmgkmx retry=1
[2020-07-17T11:07:34.550Z] time="2020-07-17T11:07:32Z" level=warning msg="Waiting for more hits in the index" currentHits=2 desiredHits=5 elapsedTime=387.147503ms index=metricbeat-7.8.0-mysql-percona-8.0.13-4-oozmgkmx retry=2
[2020-07-17T11:07:34.550Z] time="2020-07-17T11:07:33Z" level=warning msg="Waiting for more hits in the index" currentHits=2 desiredHits=5 elapsedTime=1.205445389s index=metricbeat-7.8.0-mysql-percona-8.0.13-4-oozmgkmx retry=3
[2020-07-17T11:07:36.468Z] time="2020-07-17T11:07:35Z" level=warning msg="Waiting for more hits in the index" currentHits=2 desiredHits=5 elapsedTime=4.080636038s index=metricbeat-7.8.0-mysql-percona-8.0.13-4-oozmgkmx retry=4
[2020-07-17T11:07:41.782Z] time="2020-07-17T11:07:40Z" level=warning msg="Waiting for more hits in the index" currentHits=2 desiredHits=5 elapsedTime=9.05528982s index=metricbeat-7.8.0-mysql-percona-8.0.13-4-oozmgkmx retry=5
[2020-07-17T11:07:48.373Z] time="2020-07-17T11:07:47Z" level=warning msg="Waiting for more hits in the index" currentHits=3 desiredHits=5 elapsedTime=15.568085318s index=metricbeat-7.8.0-mysql-percona-8.0.13-4-oozmgkmx retry=6
[2020-07-17T11:07:53.669Z] time="2020-07-17T11:07:53Z" level=warning msg="Waiting for more hits in the index" currentHits=4 desiredHits=5 elapsedTime=21.726110573s index=metricbeat-7.8.0-mysql-percona-8.0.13-4-oozmgkmx retry=7
[2020-07-17T11:07:57.883Z] time="2020-07-17T11:07:57Z" level=warning msg="Waiting for more hits in the index" currentHits=4 desiredHits=5 elapsedTime=25.147089216s index=metricbeat-7.8.0-mysql-percona-8.0.13-4-oozmgkmx retry=8
[2020-07-17T11:08:02.100Z] time="2020-07-17T11:08:01Z" level=info msg="Hits number satisfied" currentHits=5 desiredHits=5 elapsedTime=29.798216277s retries=9
[2020-07-17T11:08:02.100Z] time="2020-07-17T11:08:01Z" level=info msg="Hits number satisfied" currentHits=5 desiredHits=5 elapsedTime=6.795117ms retries=1
[2020-07-17T11:08:03.053Z] Stopping metricbeat_metricbeat_1 ... 
[2020-07-17T11:08:03.317Z] 
Stopping metricbeat_metricbeat_1 ... done
Removing metricbeat_metricbeat_1 ... 
[2020-07-17T11:08:03.317Z] 
Removing metricbeat_metricbeat_1 ... done
Going to remove metricbeat_metricbeat_1
[2020-07-17T11:08:03.888Z] Stopping metricbeat_mysql_1 ... 
[2020-07-17T11:08:07.190Z] 
Stopping metricbeat_mysql_1 ... done
Removing metricbeat_mysql_1 ... 
[2020-07-17T11:08:07.190Z] 
Removing metricbeat_mysql_1 ... done
Going to remove metricbeat_mysql_1
[2020-07-17T11:08:07.764Z] Stopping metricbeat_elasticsearch_1 ... 
[2020-07-17T11:08:08.708Z] 
Stopping metricbeat_elasticsearch_1 ... done
Removing metricbeat_elasticsearch_1 ... 
[2020-07-17T11:08:08.708Z] 
Removing metricbeat_elasticsearch_1 ... done
Removing network metricbeat_default
[2020-07-17T11:08:08.969Z] <?xml version="1.0" encoding="UTF-8"?>
[2020-07-17T11:08:08.969Z] <testsuites name="main" tests="7" skipped="0" failures="0" errors="0" time="646.227988463">
[2020-07-17T11:08:08.969Z]   <testsuite name="As a Metricbeat developer I want to check that default configuration works as expected" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
[2020-07-17T11:08:08.969Z]   <testsuite name="As a Metricbeat developer I want to check that the Apache module works as expected" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
[2020-07-17T11:08:08.969Z]   <testsuite name="As a Metricbeat developer I want to check that the MySQL module works as expected" tests="7" skipped="0" failures="0" errors="0" time="599.447789247">
[2020-07-17T11:08:08.969Z]     <testcase name="Check MariaDB-10.2.23 is sending metrics to Elasticsearch without errors" status="passed" time="89.431806196"></testcase>
[2020-07-17T11:08:08.969Z]     <testcase name="Check MariaDB-10.3.14 is sending metrics to Elasticsearch without errors" status="passed" time="75.285927794"></testcase>
[2020-07-17T11:08:08.969Z]     <testcase name="Check MariaDB-10.4.4 is sending metrics to Elasticsearch without errors" status="passed" time="81.927853211"></testcase>
[2020-07-17T11:08:08.969Z]     <testcase name="Check MySQL-5.7.12 is sending metrics to Elasticsearch without errors" status="passed" time="81.723275027"></testcase>
[2020-07-17T11:08:08.969Z]     <testcase name="Check MySQL-8.0.13 is sending metrics to Elasticsearch without errors" status="passed" time="78.765985323"></testcase>
[2020-07-17T11:08:08.970Z]     <testcase name="Check Percona-5.7.24 is sending metrics to Elasticsearch without errors" status="passed" time="81.463456151"></testcase>
[2020-07-17T11:08:08.970Z]     <testcase name="Check Percona-8.0.13-4 is sending metrics to Elasticsearch without errors" status="passed" time="88.156079612"></testcase>
[2020-07-17T11:08:08.970Z]   </testsuite>
[2020-07-17T11:08:08.970Z]   <testsuite name="As a Metricbeat developer I want to check that the Redis module works as expected" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
[2020-07-17T11:08:08.970Z]   <testsuite name="As a Metricbeat developer I want to check that the vSphere module works as expected" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
[2020-07-17T11:08:08.970Z] </testsuites>+ sed -e 's/^[ \t]*//; s#>.*failed$#>#g' outputs/TEST-metricbeat-mysql
[2020-07-17T11:08:08.970Z] + grep -E '^<.*>$'
[2020-07-17T11:08:08.970Z] + exit 0
[2020-07-17T11:08:09.035Z] Recording test results
[2020-07-17T11:08:09.498Z] Archiving artifacts
[2020-07-17T11:08:10.970Z] Stage "Release" skipped due to earlier failure(s)
[2020-07-17T11:08:11.338Z] Running on Jenkins in /var/lib/jenkins/workspace/e2e-tests_e2e-testing-mbp_PR-175@2
[2020-07-17T11:08:11.428Z] [INFO] getVaultSecret: Getting secrets
[2020-07-17T11:08:11.504Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-07-17T11:08:12.335Z] + chmod 755 generate-build-data.sh
[2020-07-17T11:08:12.335Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-175/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-175/runs/1 FAILURE 1209396
[2020-07-17T11:08:12.335Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-175/runs/1/steps/?limit=10000 -o steps-info.json
[2020-07-17T11:08:13.246Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-175/runs/1/tests/?status=FAILED -o tests-errors.json
[2020-07-17T11:08:13.246Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-175/runs/1/log/ -o pipeline-log.txt

@mdelapenya mdelapenya requested a review from ph July 17, 2020 12:36
Comment thread cli/Makefile
go get -v -t ./...

.PHONY: notice
notice:
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Taken from Beats

Comment thread e2e/Makefile
godog --format=${FORMAT} ${FEATURE_FLAG} ${FEATURE}

.PHONY: notice
notice:
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Taken from Beats

Copy link
Copy Markdown
Contributor

@EricDavisX EricDavisX left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm;

@mdelapenya mdelapenya merged commit cf9a440 into elastic:master Jul 17, 2020
@mdelapenya
Copy link
Copy Markdown
Contributor Author

@mostlyjason I merged today to make progress with the licenses already merged. Please comment whatever you consider here

Thanks!

@mdelapenya mdelapenya deleted the licenses branch July 17, 2020 15:50
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

automation documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants