CLI to support two way talk tests

[rquidute]

What Changed

This PR adds the Two-Way Talk support. -

TC-WEBRTC-1.6 Two-Way Talk support: New two_way_talk_handler.py starts an HTTP server on port 8999 serving a WebRTC browser peer page (two_way_talk_verification.html). The CLI now waits until the browser is detected as open before resuming test execution, and the prompt manager renders the PASS/FAIL form dynamically via /prompt_ready polling.

Related Issue

project-chip/certification-tool#904

Testing

New Unit test added and passing

CLI execution runs successfully. CLI command: th-cli run-tests -t TC_WEBRTC_1_6 --project-id 4
chip-camera-app command: rm -rf /tmp/chip_*;./chip-camera-app --camera-test-audiosrc --camera-audio-playback

ubuntu@ubuntu:~/certification-tool/cli$ th-cli run-tests -t TC_WEBRTC_1_6 --project-id 4
Project Config: {'test_parameters': {'endpoint': 1}, 'network': {'wifi': {'ssid': 'testharness', 'password': 'wifi-password'}, 'thread': {'rcp_serial_path': '/dev/ttyACM0', 'rcp_baudrate': 115200, 'on_mesh_prefix': 'fd11:22::/64', 'network_interface': 'eth0', 'dataset': {'channel': '15', 'panid': '0x1234', 'extpanid': '1111111122222222', 'networkkey': '00112233445566778899aabbccddeeff', 'networkname': 'DEMO'}, 'otbr_docker_image': None, 'ba_host': '127.0.0.1', 'ba_port': 5684}}, 'dut_config': {'discriminator': '3840', 'setup_code': '20202021', 'pairing_mode': 'onnetwork', 'chip_timeout': None, 'chip_use_paa_certs': False, 'trace_log': True, 'enhanced_setup_flow': None}}
PICS Used: {
"clusters": {}
}
Selected tests: {
"SDK Python Tests": {
"Python Testing Suite": {
"TC_WEBRTC_1_6": 1
}
}
}
Creating new test run with title: 2026-03-13-12:29:34
═════════════════════════════════════════════════════════
⚠ WebRTC Two-Way Talk — Action Required ⚠
═════════════════════════════════════════════════════════
Open this URL in a browser NOW and keep it open:
http://192.168.20.180:8999
The page will connect to the DUT automatically.
You will be asked to select PASS or FAIL during the test.
═════════════════════════════════════════════════════════

Waiting for browser to open the page...
✔ Browser connected — starting test.

Starting Test run:

• Title: 2026-03-13-12:29:34
• ID: 150

═══════════════════════════════════════════════════════
CHIP Server Information:

• Node ID: 0xda8fab5116165dad
• Manual Pairing Code: 34970112332
  ═══════════════════════════════════════════════════════

Test Run [EXECUTING]

• Python Testing Suite [EXECUTING]
  =======================================
  Do you want to reuse the previous commissioning information?
  If you select NO, a new commissioning will be performed
  1: YES
  2: NO
  Please enter a number for an option above:
  2
  =======================================
  =======================================
  Make sure the DUT is in Commissioning Mode
  1: DONE
  2: FAILED
  Please enter a number for an option above:
  1
  =======================================
  • TC-WEBRTC-1.6 [EXECUTING]
    - Start Python test [EXECUTING]
    - Start Python test [PASSED]
    - Commission DUT if not already done [EXECUTING]
    - Commission DUT if not already done [PASSED]
    - Confirm no active WebRTC sessions exist in DUT [EXECUTING]
    - Confirm no active WebRTC sessions exist in DUT [PASSED]
    - Confirm DUT(Camera) supports Speaker feature AVSM.S.F04(SPKR) [EXECUTING]
    - Confirm DUT(Camera) supports Speaker feature AVSM.S.F04(SPKR) [PASSED]
    - TH reads TwoWayTalkSupport Attribute from AVSM cluster from DUT [EXECUTING]
    - TH reads TwoWayTalkSupport Attribute from AVSM cluster from DUT [PASSED]
    - If DUT supports AVSM.S.F01(VDO) feature, TH sends the VideoStreamAllocate command with valid values of StreamUsage, VideoCodec, MinResolution, MaxResolution, MinBitRate, MaxBitRate, MinFrameRate, MaxFrameRate, KeyFrameInterval, WatermarkEnabled, OSDEnabled [EXECUTING]
    - If DUT supports AVSM.S.F01(VDO) feature, TH sends the VideoStreamAllocate command with valid values of StreamUsage, VideoCodec, MinResolution, MaxResolution, MinBitRate, MaxBitRate, MinFrameRate, MaxFrameRate, KeyFrameInterval, WatermarkEnabled, OSDEnabled [PASSED]
    - TH sends the AudioStreamAllocate command with valid values of StreamUsage, AudioCodec, ChannelCount, SampleRate, BitDepth, BitRate. [EXECUTING]
    - TH sends the AudioStreamAllocate command with valid values of StreamUsage, AudioCodec, ChannelCount, SampleRate, BitDepth, BitRate. [PASSED]
    - TH sends the ProvideOffer command with an SDP Offer, null WebRTCSessionID, VideoStreamID and AudioStreamID saved in steps 2, 3 to the DUT. [EXECUTING]
    - TH sends the ProvideOffer command with an SDP Offer, null WebRTCSessionID, VideoStreamID and AudioStreamID saved in steps 2, 3 to the DUT. [PASSED]
    - DUT sends Answer command to the TH/WEBRTCR. [EXECUTING]
    - DUT sends Answer command to the TH/WEBRTCR. [PASSED]
    - TH sends the SUCCESS status code to the DUT. [EXECUTING]
    - TH sends the SUCCESS status code to the DUT. [PASSED]
    - TH sends the ProvideICECandidates command with a its ICE candidates to the DUT. [EXECUTING]
    - TH sends the ProvideICECandidates command with a its ICE candidates to the DUT. [PASSED]
    - TH waits for 10 seconds [EXECUTING]
    =======================================
    🎤 Two-Way Talk Verification
    Verify if two way talk back is working
    Open http://192.168.20.180:8999 to verify audio/video and select PASS or FAIL.
    Waiting for your response in the browser...
    ✅ User selected: PASS
    =======================================
    - TH waits for 10 seconds [PASSED]
    - TH sends the EndSession command with the WebRTCSessionID saved in step 4 to the DUT. [EXECUTING]
    - TH sends the EndSession command with the WebRTCSessionID saved in step 4 to the DUT. [PASSED]
    - TH sends the VideoStreamDeallocate command if allocated, with the VideoStreamID saved in step 2 to the DUT. [EXECUTING]
    - TH sends the VideoStreamDeallocate command if allocated, with the VideoStreamID saved in step 2 to the DUT. [PASSED]
    - TH sends the AudioStreamDeallocate command with the AudioStreamID saved in step 3 to the DUT. [EXECUTING]
    - TH sends the AudioStreamDeallocate command with the AudioStreamID saved in step 3 to the DUT. [PASSED]
    - Show test logs [EXECUTING]
    - Show test logs [PASSED]
  • TC-WEBRTC-1.6 [PASSED]
• Python Testing Suite [PASSED]
  Test Run [PASSED]
  Log output in: ./output_logs/test_run_2026-03-13-12:29:34.log

[gemini-code-assist]

Summary of Changes

Hello, I'm Gemini Code Assist¹! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request significantly enhances the CLI's capability to support Two-Way Talk verification for WebRTC-enabled devices. It achieves this by integrating a local HTTP server that hosts a dedicated WebRTC client page, enabling seamless interaction between the CLI test harness and a user's browser. This allows for interactive audio/video verification during specific test cases, streamlining the testing process for complex multimedia functionalities.

Highlights

• Two-Way Talk Support: Introduced a new two_way_talk_handler.py module that starts an HTTP server on port 8999, serving a WebRTC browser peer page (two_way_talk_verification.html) to facilitate two-way audio/video communication for testing.
• CLI Integration: The CLI now intelligently detects if a Two-Way Talk test (e.g., TC_WEBRTC_1_6) is selected. If so, it initiates the WebRTC server and waits for the browser to connect before proceeding with test execution.
• Dynamic Prompt Management: The prompt manager (prompt_manager.py) has been updated to dynamically render PASS/FAIL forms within the browser page via /prompt_ready polling, allowing for interactive user verification during WebRTC tests.
• Enhanced User Feedback: A prominent banner is displayed in the CLI when a Two-Way Talk test is run, instructing the user to open the WebRTC verification URL in a browser and indicating when the browser has successfully connected.
• Robust Error Handling: Improved error detection and messaging for WebRTC-related failures, specifically providing a 'BROWSER TAB REQUIRED' warning if the browser peer connection is not found during a WebRTC test.
• Comprehensive Unit Testing: Added extensive unit tests for the new TwoWayTalkHandler and TwoWayTalkHTTPHandler classes, covering server lifecycle, prompt handling, browser waiting, user response, and HTTP routing, ensuring reliability and correctness.

🧠 New Feature in Public Preview: You can now enable Memory to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console.

Changelog

• tests/test_run/camera/test_two_way_talk_handler.py
  • Added comprehensive unit tests for the new TwoWayTalkHandler and TwoWayTalkHTTPHandler classes.
• tests/test_run/test_prompt_manager.py
  • Updated to import TwoWayTalkVerificationRequest.
  • Added extensive unit tests for _handle_two_way_talk_prompt, covering dispatch, active handler usage, response sending, and fallback handler creation.
• tests/test_run/test_websocket_socket.py
  • Modified WebRTC warning logic to remove specific error text checks.
  • Replaced detailed WebRTC warnings with a generic 'BROWSER TAB REQUIRED' message for peer connection failures.
• tests/test_run_tests.py
  • Updated imports to include new Two-Way Talk related functions and constants.
  • Added unit tests for _dict_contains_key, _contains_webrtc_two_way_talk, and _print_webrtc_banner_and_wait functions.
• th_cli/commands/run_tests.py
  • Integrated TwoWayTalkHandler to manage the WebRTC verification server.
  • Implemented logic to detect Two-Way Talk tests and start the WebRTC server conditionally.
  • Added _print_webrtc_banner_and_wait function to display user instructions and wait for browser connection.
  • Ensured proper cleanup of the TwoWayTalkHandler upon test completion or error.
  • Added helper functions _dict_contains_key and _contains_webrtc_two_way_talk for recursive dictionary key searching and WebRTC test detection.
• th_cli/test_run/camera/two_way_talk_handler.py
  • Added a new module defining TwoWayTalkHandler and TwoWayTalkHTTPHandler classes.
  • Implemented a local HTTP server to serve the WebRTC verification page.
  • Included functionality to manage browser connection, handle user input for prompts, and provide audio analysis.
  • Added methods for starting, stopping, and managing the server's state and communication queues.
• th_cli/test_run/camera/two_way_talk_verification.html
  • Added a new HTML file serving as the WebRTC browser peer page.
  • Included JavaScript for WebRTC signaling, audio/video display, audio level analysis, and interactive PASS/FAIL prompts.
• th_cli/test_run/prompt_manager.py
  • Updated to import TwoWayTalkVerificationRequest.
  • Added _handle_two_way_talk_prompt to manage interaction with the TwoWayTalkHandler for user prompts, including fallback server creation if the active handler is lost.
• th_cli/test_run/websocket.py
  • Removed outdated WebRTC-specific error indicators.
  • Simplified error logging to focus on a generic 'BROWSER TAB REQUIRED' warning for relevant failures.

Activity

• The author, rquidute, implemented the core Two-Way Talk support, including the HTTP server, WebRTC page, and CLI integration.
• Unit tests were added and verified to ensure the new functionality works as expected.
• CLI execution was successfully tested with th-cli run-tests -t TC_WEBRTC_1_6 --project-id 4, demonstrating the interactive browser prompt and audio/video verification.

Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature	Command	Description
Code Review	/gemini review	Performs a code review for the current pull request in its current state.
Pull Request Summary	/gemini summary	Provides a summary of the current pull request in its current state.
Comment	@gemini-code-assist	Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help	/gemini help	Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution. ↩

[gemini-code-assist]

Code Review

This PR introduces support for Two-Way Talk in the CLI by adding a local HTTP server to handle WebRTC interactions with a browser. The implementation is comprehensive, including a new handler, an HTML verification page, and extensive unit tests. The changes are well-structured, and the logic for detecting and managing the WebRTC test flow is sound. I have a few suggestions to improve robustness and maintainability by refining exception handling and refactoring the use of global state.