CI: add regression testing with apisix:dev

[ps-19]

Type of change:

• Bugfix
• New feature provided
• Improve performance
• Backport patches
• Documentation
• Refactor
• Chore
• CI/CD or Tests

What this PR does / why we need it:

The PR tries to add regression testing with apisix:dev . It tries to resolve issue#1075 (#1075). Previously, apisix:dev was used for e2e testing by default, but this affected the development experience and sometimes resulted in false negatives where e2e tests failed due to changes in APISIX. By adding a scheduled job to use apisix:dev image for regression testing, your PR aims to address these concerns and improve the testing process.

Pre-submission checklist:

• Did you explain what problem does this PR solve? Or what new features have been added?
• Have you added corresponding test cases?
• Have you modified the corresponding document?
• Is this PR backward compatible? If it is not backward compatible, please discuss on the mailing list first

[codecov-commenter]

Codecov Report

Merging #1721 (c4eed67) into master (98ff8e5) will decrease coverage by 0.01%.
The diff coverage is 0.00%.

❗ Current head c4eed67 differs from pull request most recent head bb6cf30. Consider uploading reports for the commit bb6cf30 to get more accurate results

@@            Coverage Diff             @@
##           master    #1721      +/-   ##
==========================================
- Coverage   39.30%   39.29%   -0.01%     
==========================================
  Files          91       91              
  Lines        8073     8075       +2     
==========================================
  Hits         3173     3173              
- Misses       4494     4495       +1     
- Partials      406      407       +1     

Impacted Files	Coverage Δ
...kg/providers/apisix/translation/apisix_consumer.go	65.21% <0.00%> (-1.95%)	⬇️

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

[ps-19]

I made some changes and added comment for clarification. Kindly have a look.

[lingsamuel]

Please sync changes from e2e-test-ci.yml, there are some necessary stability fixes.

[lingsamuel]

Please sync changes from https://github.com/apache/apisix-ingress-controller/blob/master/.github/workflows/e2e-test-ci.yml#L189-L200 , there are some necessary stability fixes.

[ps-19]

I installed a red hat extension which changes the syntax. That is why this PR failed in test.

[tao12345666333]

We should actually run it in GitHub Action to ensure that it meets expectations. #1721 (comment)

[ps-19]

I think the CI might have failed due to flaky errors.

[tao12345666333]

I will re-run CI.

[ps-19]

Can you please run the tests again please? It will be accepted.

solved.