Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix integration tests on main #1662

Merged
merged 1 commit into from
Feb 6, 2024
Merged

Fix integration tests on main #1662

merged 1 commit into from
Feb 6, 2024

Conversation

wsmoses
Copy link
Member

@wsmoses wsmoses commented Feb 5, 2024

No description provided.

@wsmoses wsmoses merged commit 5b6b4ac into main Feb 6, 2024
44 of 54 checks passed
@wsmoses wsmoses deleted the llmainint branch February 6, 2024 02:09
MilesCranmer added a commit to MilesCranmer/Enzyme that referenced this pull request Jul 24, 2024
Since DynamicExpressions.jl seems to be particularly good at finding issues with Enzyme, such as:

- EnzymeAD#548
- EnzymeAD#552
- EnzymeAD#816
- EnzymeAD#999
- EnzymeAD#1009
- EnzymeAD#1018
- EnzymeAD#1156
- EnzymeAD#1662
- EnzymeAD#1674

This PR therefore adds a simple integration test for it so that such issues will get flagged immediately. The CI also pins DynamicExpressions to a specific version where it has been known to work, so any failures would indicate some kind of regression.

Also, this is a separate CI run so won't be recorded in the main test suite.

I restructured the CI so that packages can add their own integration tests fairly easily:

```yaml
      matrix:
        version:
          - '1'
        os:
          - ubuntu-latest
        test:
          - DynamicExpressions
    steps:
      - uses: actions/checkout@v4
      - uses: julia-actions/setup-julia@v1
        with:
          version: ${{ matrix.version }}
      - uses: julia-actions/cache@v1
      - uses: julia-actions/julia-buildpkg@v1
      - name: "Run tests"
        run: |
            julia --color=yes --project=. -e 'using Pkg; pkg"instantiate"'
            julia --color=yes --project=test/integration -e 'using Pkg; pkg"dev ."; pkg"instantiate"'
            julia --color=yes --project=test/integration --threads=auto --check-bounds=yes -e test/integration/${{ matrix.test }}.jl
        shell: bash
```

All they need to do is create a new `test/integration/{PackageName}.jl` file and add it to the list.

@gdalle maybe you could rebase EnzymeAD#1563 on this so we can have them in the same format?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant