Skip to content

HelpMeTest CLI v1.21.0

Choose a tag to compare

View all tags
@slavaGanzin slavaGanzin released this 17 Jan 12:42
· 372 commits to main since this release
v1.21.0
99b6cc3

HelpMeTest CLI v1.21.0

New Features

  • Bidirectional Agent-UI Messaging: Real-time ZMQ-based communication between AI assistants and users enables interactive workflows with immediate feedback. AI assistants can now send messages to users and receive responses during test execution, creating truly conversational testing experiences.
  • Batch MCP Tool Approval: New init tool streamlines initial setup by triggering approval prompts for all MCP tools at once. Eliminates repetitive approval dialogs and gets you testing faster with a single "Always allow" for each tool category.
  • Idle Listening Mode: AI assistants now wait for user messages when idle instead of ending conversations. Enables continuous back-and-forth collaboration without restarting sessions, perfect for iterative test development and debugging workflows.
  • Parallel Interactive Sessions: Session-specific timestamp tracking allows multiple interactive debugging sessions to run simultaneously. Each session maintains its own state and can be resumed independently using timestamp parameters.
  • Network Request Debugging: New debug parameter in interactive commands controls network request/response body visibility. When enabled, shows complete HTTP payloads for debugging API interactions and troubleshooting integration issues.
  • FakeMail Testing Documentation: Comprehensive FakeMail documentation now auto-opens in artifacts during exploratory testing, providing ready-to-use patterns for email verification flows and temporary inbox testing.

Improvements

  • Session Message Routing: Room validation with session tracking prevents messages from being delivered to wrong sessions. Each interactive session gets isolated message routing for reliable multi-user and parallel session support.
  • Efficient Message Retrieval: Replaced polling with wait-based message retrieval that blocks until messages arrive. Dramatically reduces unnecessary API calls while maintaining instant responsiveness when messages are sent.
  • Reliable Stream Processing: Simplified error handling with increased timeout (from 30s to 180s) for stream processing, preventing premature timeouts during long-running test executions and large artifact operations.
  • Consistent AI Prompts: Extracted shared prompt constants into reusable function ensuring AI assistants receive consistent instructions across different MCP tools. Improves response quality and reduces prompt drift.
  • Better Code Organization: Moved keywords tool to documentation.js module for cleaner separation of concerns and easier maintenance of documentation-related functionality.
  • Enhanced Test Validation: Improved validation guidance in exploratory and interactive testing modes helps AI assistants create more reliable tests with fewer syntax errors and better Robot Framework compliance.

Bug Fixes

  • Interactive Status Display: Fixed CommandNotification status display that was showing incorrect execution state during interactive sessions, now properly reflects command success/failure.
  • Session Naming Consistency: Exploratory mode now uses room naming convention consistent with interactive mode, eliminating confusion and ensuring proper message routing across all testing workflows.
  • Tool Registration: Fixed init tool to use _registeredTools for proper MCP tool registration instead of incorrect property access that was causing initialization failures.
  • Error Reporting: Removed defensive error fallback that was hiding actual error messages, now lets errors surface cleanly for easier debugging and faster issue resolution.
  • Message Metadata: Added company field to ZMQ messages for consistency with other message types, ensuring complete context is always available for message routing and filtering.

📥 Installation

Quick Install (Recommended)

# Download and install the latest version
curl -fsSL https://helpmetest.com/install | bash

Manual Installation

  1. Download the binary for your platform:

    • Linux x86_64: helpmetest-cli_Linux_x86_64.tar.gz
    • Linux ARM64: helpmetest-cli_Linux_arm64.tar.gz
    • Linux i386: helpmetest-cli_Linux_i386.tar.gz
    • macOS ARM64 (Apple Silicon): helpmetest-cli_Darwin_arm64.tar.gz
    • macOS x86_64 (Intel): helpmetest-cli_Darwin_x86_64.tar.gz
    • Windows x86_64: helpmetest-cli_Windows_x86_64.zip
    • Windows ARM64: helpmetest-cli_Windows_arm64.zip
    • Windows i386: helpmetest-cli_Windows_i386.zip

  2. Extract and install:

    Linux/macOS:

    tar -xzf helpmetest-cli_*.tar.gz
sudo mv helpmetest /usr/local/bin/

    Windows:

    • Extract the .zip file
    • Move helpmetest.exe to a directory in your PATH

  3. Verify installation:

    helpmetest --version

🔐 Verification

All binaries are signed and checksums are provided. Verify your download:

# Download checksums
curl -fsSL https://github.com/help-me-test/cli/releases/latest/download/helpmetest-cli_*_checksums.txt

# Verify checksum (Linux/macOS)
sha256sum -c helpmetest-cli_*_checksums.txt

# Verify checksum (Windows PowerShell)
Get-FileHash helpmetest-cli_*.zip -Algorithm SHA256

📚 Documentation

For complete documentation, commands, and features, visit:

📖 HelpMeTest CLI Documentation

🆘 Support

Assets 11
Loading