Skip to content
View ashokmanohar-ai's full-sized avatar
πŸ€–
πŸ€–

Block or report ashokmanohar-ai

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
ashokmanohar-ai/README.md

Hi, I'm Ashok Kumar Manohar πŸ‘‹

AI Quality Engineer | Test Architect | Agentic AI & Test Automation

I am a Test Architect and AI Quality Engineering professional with experience in enterprise test strategy, intelligent test automation, AI-powered quality engineering, and modern software-testing practices.

My current focus is on designing and building quality-engineering solutions using Agentic AI, Retrieval-Augmented Generation (RAG), Large Language Models, Playwright, multi-agent workflows, and automated AI evaluation.


πŸš€ Areas of Expertise

  • AI and LLM application testing
  • Agentic AI quality-engineering workflows
  • RAG application testing and evaluation
  • LLM-as-a-Judge validation
  • Hallucination, faithfulness, groundedness, and relevance testing
  • Playwright UI and API automation
  • BDD and Cucumber frameworks
  • Test architecture and automation strategy
  • API, performance, accessibility, and security testing
  • CI/CD quality gates
  • AI observability, latency, token, and cost monitoring
  • Responsible AI testing and governance

🧠 Current Focus

  • Building AI-powered test-design solutions
  • Generating test scenarios from requirements and user stories
  • Evaluating RAG retrieval precision, recall, and relevance
  • Measuring faithfulness, groundedness, hallucination, and answer quality
  • Creating multi-agent quality-engineering workflows
  • Integrating Playwright automation with AI agents
  • Implementing AI quality gates in CI/CD pipelines
  • Designing human-in-the-loop validation and governance controls
  • Tracking model performance, latency, token usage, and cost

πŸ› οΈ Technologies and Tools

Artificial Intelligence

Agentic AI Generative AI RAG LLM Evaluation Prompt Engineering LLM-as-a-Judge Responsible AI

AI Frameworks and Platforms

Azure OpenAI Amazon Bedrock LangChain LangGraph RAGAS Arize Phoenix ChromaDB Vector Databases

Test Automation

Playwright Selenium Appium Cucumber Pytest Postman Newman REST Assured Katalon

DevOps and Cloud

GitHub Actions Jenkins Azure DevOps Docker AWS Git Allure Reports

Programming

Python TypeScript JavaScript Java SQL Gherkin


πŸ“Œ Featured Projects

An AI-powered RAG platform that transforms requirement documents and user stories into structured, traceable, and review-ready test scenarios and test cases.

Key capabilities:

  • Multi-format requirement-document ingestion
  • ChromaDB-based vector storage
  • Hybrid semantic and BM25 retrieval
  • Project-isolated knowledge management
  • Positive, negative, boundary, and alternate-flow test generation
  • Requirement-to-test traceability
  • BDD and Gherkin scenario generation
  • LLM-as-a-Judge quality evaluation
  • Jira requirement ingestion
  • Token usage and AI observability
  • Structured test-case export
  • Role-based access and audit logging

Technologies:
Python Flask ChromaDB RAG LLM Evaluation RAGAS Arize Phoenix Azure OpenAI Amazon Bedrock


A multi-agent quality-engineering framework designed to support test analysis, automation implementation, execution, review, security validation, and reporting.

Key capabilities:

  • Specialized quality-engineering agents
  • Requirement and test-analysis workflows
  • AI-assisted test design
  • Automation implementation support
  • Playwright-based testing capabilities
  • Test execution and failure analysis
  • Security and quality-review workflows
  • Reusable agent skills, prompts, and templates
  • Human-in-the-loop approval controls
  • Documentation and governance guidance
  • Extensible multi-agent architecture

Technologies:
Agentic AI JavaScript Node.js Playwright Multi-Agent Systems Quality Engineering Security Testing


πŸ“Š LLM and RAG Evaluation Harness β€” Planned

A reusable evaluation framework for validating the quality, reliability, performance, and cost of RAG and LLM applications.

Planned evaluation capabilities:

  • Context precision and recall
  • Retrieval relevance
  • Faithfulness and groundedness
  • Answer relevance
  • Hallucination detection
  • Citation correctness
  • LLM-as-a-Judge evaluation
  • Ground-truth comparison
  • Prompt and model comparison
  • Configurable quality thresholds
  • Latency measurement
  • Token-consumption tracking
  • Cost estimation
  • JSON, CSV, and HTML reports
  • CI/CD quality gates
  • Phoenix and OpenTelemetry tracing

πŸ”„ End-to-End AI Quality Engineering Vision

Requirement Documents
        ↓
RAG-Based Knowledge Retrieval
        ↓
AI-Powered Test Design
        ↓
Multi-Agent Automation Workflow
        ↓
Playwright UI and API Execution
        ↓
LLM and RAG Quality Evaluation
        ↓
Observability, Governance, and Reporting

Popular repositories Loading

  1. prompt-eng-genaiapp prompt-eng-genaiapp Public

    Forked from 03sarath/prompt-eng-genaiapp

    Python 1

  2. ashokmanohar-ai ashokmanohar-ai Public

    Professional GitHub profile of Ashok Kumar Manohar

    1

  3. explore-with-postman explore-with-postman Public

    Forked from askherconsulting/explore-with-postman

    Various materials for Exploratory API Testing with Postman workshops

  4. appium-inspector appium-inspector Public

    Forked from appium/appium-inspector

    A GUI inspector for mobile apps and more, powered by a (separately installed) Appium server

    JavaScript

  5. PostmanReports PostmanReports Public

    Forked from velroy-moras/PostmanReports

    A repo showing github actions to write test reports using newman.

  6. x12-parser x12-parser Public

    Forked from apifocal/x12-parser

    Java library for parsing and creating ASC X12 EDI transactions

    Java