Add E2E coverage for Trace and Logging

[Superskyyy]

• Change Fastapi to FastAPI component name (sync with OAP change)
• Add E2E coverage for Python agent (Trace and Logging), profiling is not tested for now.
• Renamed a build variable to remove possible mix-ups with CLI environment Var.
• Enhance plugin test to reuse images.
• Combined CI to pass if changes are non-essential to agent and workflows.

Note: There's a flaky test due to a possible {{- contains }} issue in the Infra-e2e verifier, the logs seem to be queried in an unstable order by the CLI where later log often placed first in log list, combining with the contains bug, it becomes flaky.

A time.sleep() workaround makes sure the log arrives in clear order which passes the e2e for now.

[kezhenxu94]

Pull requests require the CI check status context named CheckStatus to pass before they can be merged. And the check context is generated by the job CheckStatus in this file (line 123), if changes are in these paths-ignore, the workflow won't be run and the check status context won't be reported, thus all PRs can't be merged, you need to either remove these paths-ignore, or add a dummy workflow in a separate file that run a empty job named CheckStatus to generate the required context, but it is hard to set the reversed condition of these paths-ignore, you can see how I set in the main repo but that is still not perfect because under some cases the 2 workflows are all executed

[Superskyyy]

Ah I see how it works, gonna fix it later.

[Superskyyy]

Pull requests require the CI check status context named CheckStatus to pass before they can be merged. And the check context is generated by the job CheckStatus in this file (line 123), if changes are in these paths-ignore, the workflow won't be run and the check status context won't be reported, thus all PRs can't be merged, you need to either remove these paths-ignore, or add a dummy workflow in a separate file that run a empty job named CheckStatus to generate the required context, but it is hard to set the reversed condition of these paths-ignore, you can see how I set in the main repo but that is still not perfect because under some cases the 2 workflows are all executed

Looks like the paths_ignore option doesn't work like what I thought.. it's crazy.

Maybe the diff method is the ultimate solution given third party action cannot be run in asf repos.

Diff method:
https://github.community/t/paths-ignore-not-working-for-base-level-files/18445/4

[kezhenxu94]

Some third-party GHAs are approved by Apache infra and can be used, @Superskyyy take a look at this, though I haven't tried to use this GHA to achieve my goal as stated above

[Superskyyy]

I'm gonna try it and let you know if it works.

[Superskyyy]

Changes to non-essential files passes the statuscheck with skipping

Any failure fails the statuscheck

Modification to essential files triggers whole process

I think it is complete now. @kezhenxu94

[kezhenxu94]

I left some comments but generally is good to me

[Superskyyy]

All fixed according to comments :)

[kezhenxu94]

Thanks!

[wu-sheng]

@Superskyyy I think an issue is relative to this? Should we close that?

[Superskyyy]

@Superskyyy I think an issue is relative to this? Should we close that?

There's the profiling feature not yet tested by E2E, but I noticed the Java agent also didn't test it, was it not necessary?

[wu-sheng]

https://github.com/apache/skywalking/blob/master/.github/workflows/skywalking.yaml#L388 agent profiling is tested in main repo.

[Superskyyy]

https://github.com/apache/skywalking/blob/master/.github/workflows/skywalking.yaml#L388 agent profiling is tested in main repo.

Ok I see it now, I got confused last time I checked the profiling e2e parts.. 😄
Let me close that issue first, I'm gonna prioritize the SWCK agent initcontainer task then come back to this.

[Superskyyy]

Create ref link: apache/skywalking#7708

[kezhenxu94]

@Superskyyy Ci failed in master branch https://github.com/apache/skywalking-python/runs/5747416666?check_suite_focus=true , wanna take a look?

[Superskyyy]

@Superskyyy Ci failed in master branch apache/skywalking-python/runs/5747416666?check_suite_focus=true , wanna take a look?

Yes! Fixing along with another small enhancement in log reporter.. testing on my branch now.