Skip to content

codeintegrity-ai/mutahunter

Repository files navigation

Mutahunter

Open-Source Language Agnostic LLM-based Mutation Testing

GitHub license Unit Tests Last Commit

Getting Started with Mutation Testing

# Install Mutahunter package via GitHub. Python 3.11+ is required.
$ pip install https://github.com/codeintegrity-ai/mutahunter

# Work with GPT-4o on your repo
$ export OPENAI_API_KEY=your-key-goes-here

# Run Mutahunter on a specific file. 
$ mutahunter run --test-command "mvn clean test" --model "gpt-4o-mini" --source-path "src/main/java/com/example/BankAccount.java" --test-path "src/test/java/BankAccountTest.java"


2025-03-05 18:56:42,528 INFO: 'mvn clean test' - '/Users/taikorind/Desktop/mutahunter/examples/java_maven/logs/_latest/mutants/34a5d8a5_BankAccount.java'
2025-03-05 18:56:44,935 INFO: πŸ›‘οΈ Mutant survived πŸ›‘οΈ

2025-03-05 18:56:44,936 INFO: 'mvn clean test' - '/Users/taikorind/Desktop/mutahunter/examples/java_maven/logs/_latest/mutants/183e6826_BankAccount.java'
2025-03-05 18:56:47,308 INFO: πŸ—‘οΈ Mutant killed πŸ—‘οΈ

. . . .-. .-. . . . . . . .-. .-. .-.
|\/| | | | |-| |-| | | |\| | |-| |
' ` `-' ' ` ` ' ' ` `-' ' ` `-' ' '

2024-07-29 12:31:22,045 INFO:
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

πŸ“Š Overall Mutation Coverage πŸ“Š
🎯 Mutation Coverage: 57.14% 🎯
🦠 Total Mutants: 7 🦠
πŸ›‘οΈ Survived Mutants: 3 πŸ›‘οΈ
πŸ—‘οΈ Killed Mutants: 4 πŸ—‘οΈ
πŸ•’ Timeout Mutants: 0 πŸ•’
πŸ”₯ Compile Error Mutants: 1 πŸ”₯
πŸ’° Total Cost: $0.00060 USD πŸ’°

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
2025-03-05 18:56:54,689 INFO: Mutation Testing Ended. Took 29s

Examples

Go to the examples directory to see how to run Mutahunter on different programming languages:

Check Java Example to see some interesting LLM-based mutation testing examples.