Updated testing

[rvguha]

Updated testing

[Copilot]

Pull Request Overview

This PR adds new test runner modules, test case definitions, and supporting shell/batch scripts for NLWeb to enable comprehensive testing of site retrieval, query retrieval, and end‐to‐end flows. It also significantly updates the documentation in the testing README to reflect these changes.

• Added new test modules and JSON files for site, query, and end-to-end testing.
• Introduced comprehensive and all-tests runner scripts for both Unix and Windows environments.
• Updated the README to provide clearer usage instructions and examples.

Reviewed Changes

Copilot reviewed 14 out of 14 changed files in this pull request and generated 1 comment.

Show a summary per file

File	Description
code/testing/site_retrieval_tests.py	New test runner and case definitions for site retrieval testing.
code/testing/site_retrieval_tests.json	Added JSON test cases for site retrieval.
code/testing/run_tests_comprehensive.sh	Comprehensive shell script for executing various test types.
code/testing/run_all_tests.sh	Shell script for running all tests.
code/testing/run_all_tests.bat	Windows batch script for running all tests.
code/testing/query_retrieval_tests.py	New test runner and case definitions for query retrieval testing.
code/testing/query_retrieval_tests.json	Added JSON test cases for query retrieval.
code/testing/end_to_end_tests.py	New test runner and case definitions for end-to-end testing.
code/testing/end_to_end_tests.json	Added JSON test cases for end-to-end testing.
code/testing/base_test_runner.py	Base class updated to support new test runners and additional logging.
code/testing/azure_openai_tests.json	Added JSON test cases for Azure OpenAI site retrieval.
code/testing/all_tests_example.json	Example JSON file covering all test types.
code/testing/README.md	Documentation updated with detailed usage instructions and examples.

Comments suppressed due to low confidence (1)

code/testing/query_retrieval_tests.py:97

• Consider adding an inline comment clarifying the fallback from 'top_k' to 'num_results' for legacy support.

num_results=test_case.get('num_results', test_case.get('top_k', 10)),

[Copilot]

Document the assumptions regarding the list structure (e.g., expecting the URL at index 2) to clarify the extraction logic.

Suggested change

	url = result[2] # Assuming [name, description, url, score, ...]
	# Assuming the list structure is [name, description, url, score, ...].
	# The URL is expected to be at index 2 based on the data source's format.
	url = result[2]