generated from oracle/template-repo
-
Notifications
You must be signed in to change notification settings - Fork 30
docs: add tutorial for find source command #920
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
2 commits
Select commit
Hold shift + click to select a range
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,38 @@ | ||
| .. Copyright (c) 2023 - 2023, Oracle and/or its affiliates. All rights reserved. | ||
| .. Licensed under the Universal Permissive License v 1.0 as shown at https://oss.oracle.com/licenses/upl/. | ||
|
|
||
| .. _find-source-command-cli: | ||
|
|
||
| =========== | ||
| Find Source | ||
| =========== | ||
|
|
||
| ----------- | ||
| Description | ||
| ----------- | ||
|
|
||
| Find the source commit, and optionally source repository, of a target artifact. | ||
|
|
||
| ----- | ||
| Usage | ||
| ----- | ||
|
|
||
| .. code-block:: shell | ||
|
|
||
| usage: ./run_macaron.sh find-source -purl PURL [-rp REPO_PATH] | ||
|
|
||
| ------- | ||
| Options | ||
| ------- | ||
|
|
||
| .. option:: -h, --help | ||
|
|
||
| Show this help message and exit | ||
|
|
||
| .. option:: -purl PACKAGE_URL, --package-url PACKAGE_URL | ||
|
|
||
| The PURL string used to uniquely identify the artifact. | ||
|
|
||
| .. option:: -rp REPO_PATH, --repo-path REPO_PATH | ||
|
|
||
| The path to the repository. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,80 @@ | ||
| .. Copyright (c) 2024 - 2024, Oracle and/or its affiliates. All rights reserved. | ||
| .. Licensed under the Universal Permissive License v 1.0 as shown at https://oss.oracle.com/licenses/upl/. | ||
|
|
||
| ------------- | ||
| Source Finder | ||
| ------------- | ||
|
|
||
| This tutorial demonstrates how Macaron can find the source commit of a given artifact, and optionally the source repository, while performing no analyses. This operation exists as a standalone feature, using the ``find-source`` command, for users that wish to utilise only these features of Macaron without spending time performing additional unnecessary steps. | ||
|
|
||
| Unlike the integrated commit finder (demonstrated in another tutorial :doc:`here </pages/tutorials/source_finder>`), the ``find-source`` command does not require cloning the target repository, thereby saving time in many cases, and disk space in all cases. For those who still wish to clone the repository as part of the process, a configuration option exists and will be explained below. | ||
|
|
||
| ****************************** | ||
| Installation and Prerequisites | ||
| ****************************** | ||
|
|
||
| Skip this section if you already know how to install Macaron. | ||
|
|
||
| .. toggle:: | ||
|
|
||
| Please follow the instructions :ref:`here <installation-guide>`. In summary, you need: | ||
|
|
||
| * Docker | ||
| * the ``run_macaron.sh`` script to run the Macaron image. | ||
|
|
||
| .. note:: At the moment, Docker alternatives (e.g. podman) are not supported. | ||
|
|
||
|
|
||
| You also need to provide Macaron with a GitHub token through the ``GITHUB_TOKEN`` environment variable. | ||
|
|
||
| To obtain a GitHub Token: | ||
|
|
||
| * Go to ``GitHub settings`` → ``Developer Settings`` (at the bottom of the left side pane) → ``Personal Access Tokens`` → ``Fine-grained personal access tokens`` → ``Generate new token``. Give your token a name and an expiry period. | ||
| * Under ``"Repository access"``, choosing ``"Public Repositories (read-only)"`` should be good enough in most cases. | ||
|
|
||
| Now you should be good to run Macaron. For more details, see the documentation :ref:`here <prepare-github-token>`. | ||
|
|
||
| ********* | ||
| Execution | ||
| ********* | ||
|
|
||
| To use the ``find-source`` command and find the repository and commit for an artifact, Macaron can be run with the following command: | ||
|
|
||
| .. code-block:: shell | ||
|
|
||
| ./run_macaron.sh find-source -purl pkg:npm/semver@7.6.2 | ||
|
|
||
| The output of the command will be written to the command line, and to a report file in the JSON format. The report can be found within the ``output`` folder under the respective path of the artifact that was passed to the command. (See :ref:`Output Files Guide <output_files_guide>`). In this case, Macaron created a report file: ``output/reports/npm/semver/semver.source.json``, which contains the repository and commit that was found. | ||
|
|
||
| To open the report and view the contents, you can use the following: | ||
|
|
||
| .. code-block:: shell | ||
|
|
||
| open output/reports/npm/semver/semver.source.json | ||
|
|
||
| Inside you will find the ``repo`` and ``commit`` properties have been populated with ``https://github.com/npm/node-semver`` and ``eb1380b1ecd74f6572831294d55ef4537dfe1a2a`` respectively. As this is a GitHub repository, Macaron also creates a URL that leads directly to the reported commit, found under the ``url`` property. | ||
|
|
||
| If the repository for an artifact is already known, the ``find-source`` command can be given it to save looking it up again. To do this, the command changes to: | ||
|
|
||
| .. code-block:: shell | ||
|
|
||
| ./run_macaron.sh find-source -purl pkg:npm/semver@7.6.2 -rp https://github.com/npm/node-semver | ||
|
|
||
| .. note:: If you are unfamiliar with PackageURLs (purl), see this link: `PURLs <https://github.com/package-url/purl-spec>`_. | ||
|
|
||
| ******************** | ||
| Execution with Clone | ||
| ******************** | ||
|
|
||
| For the case where cloning the repository is desirable, perhaps because further use of the contents are planned, Macaron requires this to be specified in a custom ``ini`` configuration file that is passed as input. See `How to change the default configuration </pages/using#change-config>`_ for more details. Within the configuration file the following option should be set: | ||
|
|
||
| .. code-block:: ini | ||
|
|
||
| [repofinder] | ||
| find_source_should_clone = True | ||
|
|
||
| Then Macaron can be run with: | ||
|
|
||
| .. code-block:: shell | ||
|
|
||
| ./run_macaron.sh -dp <path-to-modified-default.ini> find-source -purl pkg:npm/semver@7.6.2 |
6 changes: 6 additions & 0 deletions
6
tests/integration/cases/tutorial_source_finder/check_output.sh
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| #!/bin/bash | ||
| # Copyright (c) 2024 - 2024, Oracle and/or its affiliates. All rights reserved. | ||
| # Licensed under the Universal Permissive License v 1.0 as shown at https://oss.oracle.com/licenses/upl/. | ||
|
|
||
| [[ "$(jq -r '.commit' output/reports/npm/semver/semver.source.json)" = "eb1380b1ecd74f6572831294d55ef4537dfe1a2a" ]] && | ||
| [[ "$(jq -r '.repo' output/reports/npm/semver/semver.source.json)" = "https://github.com/npm/node-semver" ]] |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,20 @@ | ||
| # Copyright (c) 2024 - 2024, Oracle and/or its affiliates. All rights reserved. | ||
| # Licensed under the Universal Permissive License v 1.0 as shown at https://oss.oracle.com/licenses/upl/. | ||
|
|
||
| description: | | ||
| Performing the examples provided within the related tutorial. | ||
|
|
||
| tags: | ||
| - tutorial | ||
|
|
||
| steps: | ||
| - name: Run macaron find source | ||
| kind: find-source | ||
| options: | ||
| command_args: | ||
| - -purl | ||
| - pkg:npm/semver@7.6.2 | ||
| - name: Check the report contents | ||
| kind: shell | ||
| options: | ||
| cmd: ./check_output.sh |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.