Cognitive Project Management for AI (CPMAI) Methodology

Phase I: Business Understanding

Determine Business Objectives

Business and org Objectives

Bus. Success Criteria

Al Success Criteria

Assess Situation

Inventory of Resources

Requirements, Assumptions & Constraints

Risks & Contingencies

Terminology

Costs and Benefits

Cognitive Project Requirements

Al Go/No Go

Pattern Identification

Cognitive/Non-Cognitive Parts

Transparency Reqs.

Acceptable Metrics

Al Skills Assessment

Al Failure Modes

Operationalization Env.

Produce Project Plan

Project Plan

Initial Assessment of Tools and Techniques

Phase II: Data Understanding

Collect Initial Data

Initial Data Collection Report

Describe Data

Data Description Report

Data Source Formats

Training Data Ident.

Test Data Ident.

Edge Model Needs

Explore Data

Data Exploration Report

Verify Data Quality

Data Quality Report

Training Quality

Test Quality

Pre-Trained Models

Pre-Trained and 3rd Party Model Usage

Transfer Learning Reqs.

Phase III: Data Preparation

Select Data

Rationale for Inclusion/Exclusion

Clean Data

Data Cleaning Report

Construct Data

Derived Attributes

Generated Records

Data Labeling

Data Labeling Needs

Integrate Data

Merged Data

Data Augmentation

Format Data

Reformatted Data

Data Anonymization

Data Normalization

Data De-noising

Dataset

Dataset Description

Phase IV: Data Modeling

Select Modeling Techniques

Modeling Technique

Modeling Assumptions

Algorithm Selection

Ensemble Methods

Generate Test Design

Test Design

Build Model

Model training

AutoML Usage

Hyperparameter

Optimization

Model Descriptions

Pre-trained Model Fine Tuning or Usage

Assess Model

Model Assessment

Model Validation Revised

Hyperparameter

Settings

Phase V: Model Evaluation

Evaluate Results

Assessment of Data

Modeling Results and Business Success Criteria

Model Assessments

Validation Results

Confusion Matrices

KPI Evaluation

Approved Models

Review Process

Review of Process

Determine Next Steps

List of Possible Actions

Model iteration Decision

Phase VI: Model Operationalization

Model Operationalization

Deployment Plan

Model Operational Plan

Model Scaffolding

Monitoring and Maintenance

Monitoring and Maintenance Plan

Governance Framework

Produce Final Report

Final Report

Final Presentation

Review Project

Experience

Documentation