Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Bias Mitigation Automation Workflow to IBM AIF 360 #527

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

JayanaGunaweera01
Copy link

@JayanaGunaweera01 JayanaGunaweera01 commented Apr 20, 2024

Bias Mitigation Automation Workflow to IBM AIF 360

Description:
This pull request adds a new feature to IBM AIF 360 by incorporating automation capabilities in notebook execution.I've created a YAML file named bias-mitigation-automation.yml to introduce automation capabilities to the Bias Mitigation Workflow in IBM AIF 360. This automation was rigorously tested using various notebooks developed by IBM AIF 360. Developers can now seamlessly integrate automation into their workflow by specifying a desired notebook name for execution, resulting in an output notebook with the .ipynb extension.

Changes Made:
Added bias-mitigation-automation.yml to enable Bias Mitigation Automation Workflow.
Integrated automated execution of IBM AIF 360 example notebooks.

Demonstration:

  1. Need to create a folder named automation in IBM AIF 360 github repository to save the executed notebooks.
  2. Navigate to actions and select Bias Mitigation Automation Workflow.
  3. Input a name for the output notebook.
  4. Developers can then select an example notebook from IBM AIF 360's collection for execution.
  5. They can initiate the workflow by clicking "Run workflow".
  6. Generated artifacts for users to download logs, aiding in debugging notebook execution issues. The artifact folder contains the executed notebook and a stack trace of notebook execution (ipynb_execution.txt).

demo

Execution Results:
Upon reviewing the execution of the notebook, it has been demonstrated that the automated platform achieved a 100% success rate with higher accuracy, all while maintaining shorter execution times compared to local, manual notebook execution (within GitHub action runners).

Workflow execution results can be found in:
https://github.com/JayanaGunaweera01/EthAIAuditHub/actions/workflows/bias-mitigation-automation.yml

 Introduced automation capabilities to the IBM AIF 360. This automation was rigorously tested using various notebooks developed by IBM AIF 360. Developers can now seamlessly integrate automation into their workflow by specifying a desired notebook name for execution, resulting in an output notebook with the .ipynb extension.

Signed-off-by: Jayana  Gunaweera <79576139+JayanaGunaweera01@users.noreply.github.com>
Added caching steps in setting up R and python packages.

Signed-off-by: Jayana  Gunaweera <79576139+JayanaGunaweera01@users.noreply.github.com>
Signed-off-by: Jayana  Gunaweera <79576139+JayanaGunaweera01@users.noreply.github.com>
Added caching steps for python and R setup.This will optimize the workflow by reducing the time to complete a workflow execution.

Signed-off-by: Jayana  Gunaweera <79576139+JayanaGunaweera01@users.noreply.github.com>
Signed-off-by: Jayana  Gunaweera <79576139+JayanaGunaweera01@users.noreply.github.com>
added caching to ci-cd pipeline

Signed-off-by: Jayana  Gunaweera <79576139+JayanaGunaweera01@users.noreply.github.com>
@JayanaGunaweera01 JayanaGunaweera01 changed the title add: Bias Mitigation Automation Workflow to IBM AIF 360 feat: Bias Mitigation Automation Workflow to IBM AIF 360 Apr 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant