ci(test): Add alternative test reporting actions (do not merge)

[devin-ai-integration]

Test Result Reporting Actions Research

Overview

This PR implements alternative GitHub Actions for test result reporting in PyAirbyte CI pipelines. The focus is on actions that can push test results as PR comments, similar to EnricoMi/publish-unit-test-result-action@v2.

Implementation Details

• Added two alternative GitHub Actions to the Pytest-Fast CI pipeline:
  1. dorny/test-reporter - High community adoption (940 stars)
  2. mikepenz/action-junit-report - Strong JUnit-specific option (361 stars)
• Added an intentionally failing test to demonstrate reporting capabilities
• Modified pytest command to generate JUnit XML output for the actions to consume

Comparison Criteria

These actions will be evaluated based on:

1. Visual clarity: How easy is it to understand the test results at a glance?
2. Information completeness: Does it provide all necessary details about test failures?
3. Configuration complexity: How difficult is it to set up and maintain?
4. Integration with GitHub: How well does it integrate with GitHub's PR interface?

Link to Devin run

https://app.devin.ai/sessions/5ac1d2b1a29c4075b5d0caa19b71d989

Requested by

Aaron ("AJ") Steers (aj@airbyte.io)

[devin-ai-integration]

Original prompt from Aaron:

@Devin - Check the PyAirbyte CI pipeline for its use of `EnricoMi/publish-unit-test-result-action@v2`. Then, research and propose 3-5 alternatives that produce similar results - specifically a push to the PR as a comment. Proposed to consider:
1. dorny/test-reporter
2. telus-agcg/action-junit-report
3. mikepenz/action-junit-report
4. xportation/junit-coverage-report

[devin-ai-integration]

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

• Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
• Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

• Disable automatic comment and CI monitoring

[github-actions]

PyTest Results (Fast Tests Only, No Creds)

231 tests  +2   230 ✅ +1   3m 28s ⏱️ -1s
  1 suites ±0     0 💤 ±0 
  1 files   ±0     1 ❌ +1 

For more details on these failures, see this check.

Results for commit b0a59c3. ± Comparison against base commit 647fd09.

♻️ This comment has been updated with latest results.

[github-actions]

PyTest Results (Full)

293 tests  +2   278 ✅ +1   16m 37s ⏱️ - 1m 36s
  1 suites ±0    14 💤 ±0 
  1 files   ±0     1 ❌ +1 

For more details on these failures, see this check.

Results for commit b0a59c3. ± Comparison against base commit 647fd09.

♻️ This comment has been updated with latest results.

[Aaron ("AJ") Steers (aaronsteers)]

In-line annotation example:

[github-actions]

	Tests	Passed ☑️	Skipped ⚠️	Failed ❌️	Time ⏱
PyAirbyte Test Results (mikepenz)	227 ran	221 passed	5 skipped	1 failed	3m 12s 481ms

[devin-ai-integration]

Closing due to inactivity for more than 7 days.