Releases: wet-boew/wet-boew-wpss
Version 6.15
Web and Open Data Validator version 6.15.0
The Web and Open Data Validator provides web developers and quality assurance testers the ability to perform a number of web site, web page validation and Open data validation tasks at one time. Web site checking includes
- Accessibility: WCAG 2.0, Deque AXE, ACT Rules, or Pa11y
- Link checking (e.g. broken links, broken anchors, cross language links)
- Mark-up validation (HTML, CSS, XML, Javascript)
- Mobile optimization (based on Yahoo's best practices)
Open data checking includes
- CSV, JSON, JSON schema and XML validation
- Content validation based on data dictionary patterns
- Data value consistency
Major Changes
Web Tool
- Add checks for WCAG plain text techniques and failures for plain text web pages and portions of
HTML web pages using the "pre" tag - WCAG_2.0-T1, WCAG_2.0-T2, WCAG_2.0-T3
- Checks for whitespace formatted tables and graphic character formatted tables in plain text web
pages and portions of HTML web pages using the "pre" tag - WCAG_2.0-F34
- Ignore SSL certificate errors in web feed validator - XML_VALIDATION
Open Data_Tool
- Fix bug in handling ordered list items found in unordered lists in multi-line text cells in
CSV files - OD_data
- Check for space separated or graphics character formatted tables and plain text lists and headings
in multi-line text fields in JSON files - OD_data
- Report plain text accessibility errors in accessibility tab rather than the open data tab.
- Ignore a single leading whitespace character in list items - OD_DATA
- Check roman numeral ordered lists in plain text content
- Set default limit of errors reported per URL to 1000 to avoid memory consumption problems.
Version 6.14.0 contains the following updates and additions
Web
- Add checks for WCAG plain text techniques and failures for plain text web pages and portions of
HTML web pages using the "pre" tag - WCAG_2.0-T1, WCAG_2.0-T2, WCAG_2.0-T3
- Checks for whitespace formatted tables and graphic character formatted tables in plain text web
pages and portions of HTML web pages using the "pre" tag - WCAG_2.0-F34
- Add checks for WCAG plain text techniques and failures for plain
text web pages and portions of HTML web pages using the
"pre" tag - WCAG_2.0-T1, WCAG_2.0-T2, WCAG_2.0-T3
- Correct function name in Deque Axe install script
- Ignore SSL certificate errors in web feed validator - XML_VALIDATION
Open Data
- Fix bug in handling ordered list items found in unordered lists in multi-line text cells in
CSV files - OD_data
- Check for space separated or graphics character formatted tables and plain text lists and headings
in multi-line text fields in JSON files - OD_data
- Report plain text accessibility errors in accessibility tab rather than the open data tab.
- Ignore a single leading whitespace character in list items - OD_DATA
- Check roman numeral ordered lists in plain text content
- Ignore case when checking for scientific notation in CSV cells
- Set default limit of errors reported per URL to 1000 to avoid memory consumption problems.
Web and Open Data Validator Installation on Windows
The tool installer, WPSS_Tool.exe, does NOT include the required Perl or Python installers.
Perl and Python must be installed on the workstation prior to installing the WPSS_Tool.
Supported versions of Perl include
- Strawberry Perl 5.26 or later (32 or 64 bit) available from http://strawberryperl.com
Does NOT work with Strawberry Perl versions earlier than 5.26 and does not work with ActiveState Perl's community release.
Supported versions of Python include
- Python 2.7.6 or newer available from https://www.python.org/downloads/windows/
- Python 3 or newer (some supporting tools don't work with Python 3, e.g. Web feed validator).
Required version of Java
- The HTML5 validator requires Oracle Java 8 or later and OpenJDK version 11.
The WPSS_Tool has been tested on the following platforms
- Windows 11 (64 bit), Strawberry Perl 5.26 (64 bit), Python 2.7.13
- Windows 11 (64 bit), Strawberry Perl 5.32 (64 bit), Python 3.10.0
The WPSS Tool installer is available as a release in this repository
Chrome Headless User agent (recommended)
The Chrome headless user agent and supporting files can be installed using the install_puppeteer.pl script in the WPSS_Tool folder.
If headless Chrome is not available, the WPSS_Tool will fall back to using PhantomJS and a message will be written to the stdout.txt file.
Pa11y Accessibility Test Tool
The Pa11y accessibility test tool (https://pa11y.org/) is an optional tool that may be used to run tests against web pages. The tool can be installed using the install_pa11y.pl script in the WPSS_Tool folder.
Deque AXE accessibility tool
The Deque AXE accessibility tool (https://github.com/dequelabs/axe-cli) is an optional tool that may be used to run tests against web pages. The tool can be installed using the install_deque_axe.pl script in the WPSS_Tool folder.
Web and Open Data Validator Installation on Linux
The tool distribution, WPSS_Tool_Linux.zip, does NOT include the required Perl or Python installers.
Perl and Python must be installed on the prior to installing the WPSS_Tool.
Supported versions of Perl include
- Perl 5.0 or later (32 or 64 bit).
Supported versions of Python include
- Python 2.7.6 or newer.
- Python 3 (some components will not work, e.g. Web feed validator)
Required version of Java
- The HTML5 validator required Oracle Java 8 or later and OpenJDK version 11.
The WPSS_Tool has been tested on the following platforms
- Redhat, Perl 5.24.2 (32 bit), Python 3.5.0
The Linux version has not been tested with headless chrome, pa11y or Deque AXE.
The WPSS Tool installer is available as a release in this repository
Installation steps
- Unzip the package; 'unzip WPSS_Tool_Linux.zip'
- Go to the installation directory; 'cd WPSS_Tool_Linux'
- Run the install script; 'perl install.pl'
Building WPSS_Tool
The WPSS_Tool and open_data_tool can be built from the repository as follows
- Clone the source from the repository
- Go to the Build folder
cd wet-boew-wpss-master/Build - Run the build_release.pl script. The default is to build a Windows release, to build a Linux release add the "Linux" argument.
perl build_release.pl
perl build_release.pl Linux - Releases are saved in the distribution folder; WPSS_Tool for Windows and WPSS_Tool_Linux for Linux.
cd ../distribution
Version 6.14.0
Web and Open Data Validator version 6.14.0
The Web and Open Data Validator provides web developers and quality assurance testers the ability to perform a number of web site, web page validation and Open data validation tasks at one time. Web site checking includes
- Accessibility: WCAG 2.0, Deque AXE, ACT Rules, or Pa11y
- Link checking (e.g. broken links, broken anchors, cross language links)
- Mark-up validation (HTML, CSS, XML, Javascript)
- Mobile optimization (based on Yahoo's best practices)
Open data checking includes
- CSV, JSON, JSON schema and XML validation
- Content validation based on data dictionary patterns
- Data value consistency
Major Changes
Support for Python 3 has been added for many components. Tools that do not work with Python 3 (web feed validator, PDF file checker) will report a runtime error.
Web Tool
- Check the chromedriver version against the chrome version when using the Deque AXE tool
- Ignore blank terms in dc.subject metadata
- Support both Python 2 and 3 for supporting tools
- Report runtime error if a supporting tool requires Python 2 if Python 3 is installed
- Add installation scripts for optional software (puppeteer, pa11y, Deque axe)
Open Data_Tool
- Support both Python 2 and 3 for supporting tools
- Report runtime error if a supporting tool requires Python 2 if Python 3 is installed
- Include user agent type in error messages.
- Add installation scripts for optional software (puppeteer, pa11y, Deque axe)
- Update csvlint to version 0.3.0
Version 6.14.0 contains the following updates and additions
Web
- Check the chromedriver version against the chrome version when using the Deque AXE tool
- Ignore blank terms in dc.subject metadata
- Support both Python 2 and 3 for supporting tools
- Report runtime error if a supporting tool requires Python 2 if Python 3 is installed
- Ignore http vs https protocol for vocab - SWI_E HTML_DATA_VOCAB
- Check headless browser by getting a URL to verify operation
- Include hidden text in parent tag to avoid false failures.
- Include user agent type in error messages.
- Return error message if PhantomJS fails to get the web page (e.g. timeout). Don't just report a 404 error.
- Add installation scripts for optional software (puppeteer, pa11y, Deque axe)
Open Data
- Support both Python 2 and 3 for supporting tools
- Report runtime error if a supporting tool requires Python 2 if Python 3 is installed
- Check headless browser by getting a URL to verify operation.
- Include user agent type in error messages.
- Add installation scripts for optional software (puppeteer, pa11y, Deque axe)
- Update csvlint to version 0.3.0
Web and Open Data Validator Installation on Windows
The tool installer, WPSS_Tool.exe, does NOT include the required Perl or Python installers.
Perl and Python must be installed on the workstation prior to installing the WPSS_Tool.
Supported versions of Perl include
- Strawberry Perl 5.26 or later (32 or 64 bit) available from http://strawberryperl.com
Does NOT work with Strawberry Perl versions earlier than 5.26 and does not work with ActiveState Perl's community release.
Supported versions of Python include
- Python 2.7.6 or newer available from https://www.python.org/downloads/windows/
- Python 3 or newer (some supporting tools don't work with Python 3, e.g. Web feed validator).
Required version of Java
- The HTML5 validator requires Oracle Java 8 or later and OpenJDK version 11.
The WPSS_Tool has been tested on the following platforms
- Windows 11 (64 bit), Strawberry Perl 5.26 (64 bit), Python 2.7.13
- Windows 10 (64 bit), Strawberry Perl 5.32 (64 bit), Python 3.10.0
The WPSS Tool installer is available as a release in this repository
Chrome Headless User agent (recommended)
The Chrome headless user agent and supporting files can be installed using the install_puppeteer.pl script in the WPSS_Tool folder.
If headless Chrome is not available, the WPSS_Tool will fall back to using PhantomJS and a message will be written to the stdout.txt file.
Pa11y Accessibility Test Tool
The Pa11y accessibility test tool (https://pa11y.org/) is an optional tool that may be used to run tests against web pages. The tool can be installed using the install_pa11y.pl script in the WPSS_Tool folder.
Deque AXE accessibility tool
The Deque AXE accessibility tool (https://github.com/dequelabs/axe-cli) is an optional tool that may be used to run tests against web pages. The tool can be installed using the install_deque_axe.pl script in the WPSS_Tool folder.
Web and Open Data Validator Installation on Linux
The tool distribution, WPSS_Tool_Linux.zip, does NOT include the required Perl or Python installers.
Perl and Python must be installed on the prior to installing the WPSS_Tool.
Supported versions of Perl include
- Perl 5.0 or later (32 or 64 bit).
Supported versions of Python include
- Python 2.7.6 or newer.
- Python 3 (some components will not work, e.g. Web feed validator)
Required version of Java
- The HTML5 validator required Oracle Java 8 or later and OpenJDK version 11.
The WPSS_Tool has been tested on the following platforms
- Redhat, Perl 5.24.2 (32 bit), Python 3.5.0
The Linux version has not been tested with headless chrome, pa11y or Deque AXE.
The WPSS Tool installer is available as a release in this repository
Installation steps
- Unzip the package; 'unzip WPSS_Tool_Linux.zip'
- Go to the installation directory; 'cd WPSS_Tool_Linux'
- Run the install script; 'perl install.pl'
Building WPSS_Tool
The WPSS_Tool and open_data_tool can be built from the repository as follows
- Clone the source from the repository
- Go to the Build folder
cd wet-boew-wpss-master/Build - Run the build_release.pl script. The default is to build a Windows release, to build a Linux release add the "Linux" argument.
perl build_release.pl
perl build_release.pl Linux - Releases are saved in the distribution folder; WPSS_Tool for Windows and WPSS_Tool_Linux for Linux.
cd ../distribution
Version 6.13.0
Web and Open Data Validator version 6.13.0
The Web and Open Data Validator provides web developers and quality assurance testers the ability to perform a number of web site, web page validation and Open data validation tasks at one time. Web site checking includes
- Accessibility: WCAG 2.0, Deque AXE, ACT Rules, or Pa11y
- Link checking (e.g. broken links, broken anchors, cross language links)
- Mark-up validation (HTML, CSS, XML, Javascript)
- Mobile optimization (based on Yahoo's best practices)
Open data checking includes
- CSV, JSON, JSON schema and XML validation
- Content validation based on data dictionary patterns
- Data value consistency
Major Changes
This version of the tool no longer works with Perl 5.24 or earlier on Windows. You must upgrade to Perl 5.26 or later. It supports both 32 and 64 bit installations.
Web Tool
- Update HTML5 validator to version 20.6.30 - HTML_VALIDATION
- Add testcase profile and checks for ACT rule set https://act-rules.github.io/rules/.
- Search for free port to use for markup server task.
- Add user agent version/installation details to output tabs.
- Add supporting tools (e.g. pa11y) versions to accessibility tab.
Open Data_Tool
- Check that the language appropriate label is used for headings with multiple language specific labels - OD_DATA
- Check that heading order matches in language variants of data files - OD_DATA
- Add testcase identifier TBS_QRS for TBS Quality Rating System checks.
- Use csvlint program to check CSV files - TBS_QRS
- Add testcase group profiles option
- Abort JSON schema validation if there are too many errors. This avoids the appearance of hanging when
validating large JSON files that contain lots of validation errors - OD_VAL
A new Open Data testcase profile “PWGSC OD (core)” is available that eliminates duplicate data and inconsistent data checks from testing. This should be used for datasets that have valid duplicate or inconsistent data cells as this reduces false error messages.
Version 6.13.0 contains the following updates and additions
Web
- Don't use exclusive list for label types that require label, only list exceptions - WCAG_2.0-H44
- Check for nested tables in thead, tfoot or th - WCAG_2.0-SC1.3.1
- Check for data cells in tables - WCAG_2.0-H51
- Check if multiple interface controls (input, button) have the same aria-labelledby reference - WCAG_2.0-ARIA16
- Don't report error on focusable tags with tabindex = -1 if they nested in aria-hidden="true" - WCAG_2.0-SC4.1.2
- Add option in configuration file to delay between fetches of pages from web sites to reduce the load on the web server.
- Update list of valid rel attribute values for HTML5 - WCAG_2.0-H88
- Update CSS validator to version cssval-20190320
- Add testcase profile and checks for ACT rule set https://act-rules.github.io/rules/
- Add runtime error messages to STDERR for supporting tools.
- Update HTML5 validator to version 20.6.30 - HTML_VALIDATION
- Check ChromeDriver version error with headless chrome.
- Update Core Subject Thesaurus to December 11, 2020 version - DC Subject
- Update the set of valid rel attribute values for tags.
- Search for free port to use for markup server task.
- Don't report error for allowed JavaScript in head (e.g. analytics) in mobile checks - JS_BOTTOM
- Suppress reporting of invalid schema types and properties. The schema definition file is out of date - SWI_E_RDFA
- Don't check supporting file version numbers for template consistency as there is no single version for
all supporting files - SWU_TEMPLATE
- Add user agent version/installation details to output tabs.
- Add supporting tools (e.g. pa11y) versions to accessibility tab.
- Create new testcase group profiles for PSPC Internet, GC Intranet and Intranet.
- Check for analytics markers in the HTML markup using patterns rather than just looking for links.
Open Data
- Add runtime error messages to STDERR for supporting tools.
- Check that the language appropriate label is used for headings with multiple language specific labels - OD_DATA
- Check that heading order matches in language variants of data files - OD_DATA
- Do language variant checks only if one of the primary languages (English or French) are found.
- Add testcase identifier TBS_QRS for TBS Quality Rating System checks.
- Use csvlint program to check CSV files - TBS_QRS
- Add testcase profile for TBS Quality Rating System checks
- Add user agent version/installation details to output tabs.
- Add supporting tools (e.g. pa11y) versions to accessibility tab.
- Report missing JSON schema under testcase id TP_PW_OD_VAL.
- Add testcase group profiles option.
Web and Open Data Validator Installation on Windows
The tool installer, WPSS_Tool.exe, does NOT include the required Perl or Python installers.
Perl and Python must be installed on the workstation prior to installing the WPSS_Tool.
Supported versions of Perl include
- Strawberry Perl 5.26 or later (32 or 64 bit) available from http://strawberryperl.com
Does NOT work with Strawberry Perl versions earlier than 5.26 and does not work with ActiveState Perl's community release.
Supported versions of Python include
- Python 2.7.6 or newer available from https://www.python.org/downloads/windows/
- Does not support Python 3.
Required version of Java
- The HTML5 validator requires Oracle Java 8 or later and OpenJDK version 11.
The WPSS_Tool has been tested on the following platforms
- Windows 10 (64 bit), Strawberry Perl 5.26 (64 bit), Python 2.7.13
The WPSS Tool installer is available as a release in this repository
Chrome Headless User agent
The Chrome headless user agent may be used rather than PhantomJS. The following must be installed in order to use Chrome
- Node version 8 or newer - https://nodejs.org/en/download/
- Chrome version 69 or newer - https://www.google.com/chrome/
- ChromeDriver node module that matches the Chrome browser version
- List locally installed chromedriver version ‘npm list chromedriver -g’
- List all available chromedriver versions ‘npm view chromedriver versions’
- Remove module ‘npm uninstall -g chromedriver’
- Install a specific version ‘npm install -g chromedriver@89.0.0’
- Puppeteer core module for node (install from command prompt) "npm install –g puppeteer-core"
If Chrome is not available, the WPSS_Tool will fall back to using PhantomJS and a message will be written to the stdout.txt file.
Pa11y Accessibility Test Tool
The Pa11y accessibility test tool may be run against web pages. The checks cannot be performed on pages behind a login (e.g. applications). A new accessibility testcase profile is available to enable this checking. Details on the Pa11y tool are available at https://github.com/pa11y/pa11y.
This tool requires
- Node version 8 or newer - https://nodejs.org/en/download/
- Pa11y module for node (install from command prompt) "npm install –g pa11y"
Deque AXE accessibility tool
The Deque AXE accessibility test tool may be run against web pages. The checks cannot be performed on pages behind a login (e.g. applications). A new accessibility testcase profile is available to enable this checking. Details on the Deque AXE tool are available at
This tool requires
- Node version 8 or newer - https://nodejs.org/en/download/
- Deque AXE core module and command line interface (CLI) module. Installed via command prompt.
- npm install @axe-core/cli -g
- Install the required chromedriver module (see above).
Web and Open Data Validator Installation on Linux
The tool distribution, WPSS_Tool_Linux.zip, does NOT include the required Perl or Python installers.
Perl and Python must be installed on the prior to installing the WPSS_Tool.
Supported versions of Perl include
- Perl 5.0 or later (32 or 64 bit).
Supported versions of Python include
- Python 2.7.6 or newer.
- Does not support Python 3.
Required version of Java
- The HTML5 validator required Oracle Java 8 or later and OpenJDK version 11.
The WPSS_Tool has been tested on the following platforms
- Redhat, Perl 5.24 (32 bit), Python 2.7.15
The Linux version has not been tested with headless chrome, pa11y or Deque AXE.
The WPSS Tool installer is available as a release in this repository
Installation steps
- Unzip the package; 'unzip WPSS_Tool_Linux.zip'
- Go to the installation directory; 'cd WPSS_Tool_Linux'
- Run the install script; 'perl install.pl'
Version 6.12.0
Web and Open Data Validator version 6.12.0
The Web and Open Data Validator provides web developers and quality assurance testers the ability to perform a number of web site, web page validation and Open data validation tasks at one time. Web site checking includes
- Accessibility: WCAG 2.0, Deque AXE or Pa11y
- Link checking (e.g. broken links, broken anchors, cross language links)
- Mark-up validation (HTML, CSS, XML, Javascript)
- Mobile optimization (based on Yahoo's best practices)
Open data checking includes
- CSV, JSON, JSON schema and XML validation
- Content validation based on data dictionary patterns
- Data value consistency
Major Changes
This version of the tool no longer works with Perl 5.24 or earlier on Windows. You must upgrade to Perl 5.26 or later. It supports both 32 and 64 bit installations.
Web Tool
- Upgrade Win32::GUI package to version 1.14
- Allow installation on latest Perl version (5.30) as well as 64 bit installations on Windows. Minimum Perl version 5.26.1 for Windows.
- Use axe-cli and axe-core to check Deque AXE testcases - AXE.
- Allow div tag to be a child tag of a dl tag - WCAG_2.0-SC1.3.1
- Add WCAG level A or AA to testcase results.
- Add tag Xpath to testcase results.
Open Data_Tool
- Upgrade Win32::GUI package to version 1.14
- Allow installation on latest Perl version (5.30) as well as 64 bit installations. Minimum Perl version 5.26.1 for Windows.
- Convert accented characters to unaccented when checking for consistent values in CSV fields - TP_PW_OD_CONT_CONSISTENCY
- Abort JSON schema validation if there are too many errors. This avoids the appearance of hanging when validating large JSON files that contain lots of validation errors - OD_VAL
- Check for possible scientific notation (e.g. 1.3e-005) in CSV cell values - TP_PW_OD_CONT
- Check for possible URLs in CSV cell values - TP_PW_OD_CONT
- Check for newline, linefeed or return characters in CSV column headings - TP_PW_OD_DATA
- Report multi-column data inconsistencies under a new testcase identifier - TP_PW_OD_CONT_COL_CONSISTENCY
- Check the Flesch Kincaid reading level of the English dataset description in the JSON dataset object - OD_REG
A new Open Data testcase profile “PWGSC OD (core)” is available that eliminates duplicate data and inconsistent data checks from testing. This should be used for datasets that have valid duplicate or inconsistent data cells as this reduces false error messages.
Version 6.12.0 contains the following updates and additions
Web
- Upgrade Win32::GUI package to version 1.14
- Allow installation on latest Perl version (5.30) as well as 64 bit installations on Windows. Minimum Perl version 5.26.1 for Windows.
- Eliminate support for ActiveState Perl as Win32::GUI PPM will not install on the latest community releases.
- Use axe-cli and axe-core to check Deque AXE testcases - AXE.
- Allow div tag to be a child tag of a dl tag - WCAG_2.0-SC1.3.1
- Defer some configuration and initialization until needed. This speeds up loading and starting of the program.
- Check for whitespace in URL strings.
- Report the list of URLs that are skipped during a crawl (e.g. duplicate content).
- Add WCAG level A or AA to testcase results.
- Add tag Xpath to testcase results.
Open Data
- Upgrade Win32::GUI package to version 1.14
- Allow installation on latest Perl version (5.30) as well as 64 bit installations. Minimum Perl version 5.26.1 for Windows.
- Allow spaces in file path for file: URLs.
- Add optional field to data dictionary specification to allow the specification of consistency of value between pairs of data columns across data rows - TP_PW_OD_CONT_CONSISTENCY
- Check JSON arrays for possible data dictionary terms, not just JSON objects.
- Convert accented characters to unaccented when checking for consistent values in CSV fields - TP_PW_OD_CONT_CONSISTENCY
- Abort JSON schema validation if there are too many errors. This avoids the appearance of hanging when validating large JSON files that contain lots of validation errors - OD_VAL
- Check for possible scientific notation (e.g. 1.3e-005) in CSV cell values - TP_PW_OD_CONT
- Check for possible URLs in CSV cell values - TP_PW_OD_CONT
- Check for newline, linefeed or return characters in CSV column headings - TP_PW_OD_DATA
- Defer some configuration and initialization until needed. This speeds up loading and starting of the program.
- If a data dictionary heading has language specific labels, check that all required languages are found - TP_PW_OD_DD
- Check some Open Government registry metata values (e.g. date released, data modified, update frequency) - OD_REG
- Report multi-column data inconsistencies under a new testcase identifier - TP_PW_OD_CONT_COL_CONSISTENCY
- Check the Flesch Kincaid reading level of the English dataset description in the JSON dataset object - OD_REG
Web and Open Data Validator Installation on Windows
The tool installer, WPSS_Tool.exe, does NOT include the required Perl or Python installers.
Perl and Python must be installed on the workstation prior to installing the WPSS_Tool.
Supported versions of Perl include
- Strawberry Perl 5.26 or later (32 or 64 bit) available from http://strawberryperl.com
Does NOT work with Strawberry Perl versions earlier than 5.26 and does not work with ActiveState Perl's community release.
Supported versions of Python include
- Python 2.7.6 or newer available from https://www.python.org/downloads/windows/
- Does not support Python 3.
Required version of Java
- The HTML5 validator required Oracle Java 8 or later and OpenJDK version 11.
The WPSS_Tool has been tested on the following platforms
- Windows 10 (64 bit), Strawberry Perl 5.26 (64 bit), Python 2.7.13
Chrome Headless User agent
The Chrome headless user agent may be used rather than PhantomJS. The following must be installed in order to use Chrome
- Chrome version 69 or newer - https://www.google.com/chrome/
- Node version 8 or newer - https://nodejs.org/en/download/
- Puppeteer core module for node (install from command prompt) "npm install –g puppeteer-core"
If Chrome is not available, the WPSS_Tool will fall back to using PhantomJS and a message will be written to the stdout.txt file.
Pa11y Accessibility Test Tool
The Pa11y accessibility test tool may be run against web pages. The checks cannot be performed on pages behind a login (e.g. applications). A new accessibility testcase profile is available to enable this checking. Details on the Pa11y tool are available at https://github.com/pa11y/pa11y.
This tool requires
- Node version 8 or newer - https://nodejs.org/en/download/
- Pa11y module for node (install from command prompt) "npm install –g pa11y"
Deque AXE accessibility tool
The Deque AXE accessibility test tool may be run against web pages. The checks cannot be performed on pages behind a login (e.g. applications). A new accessibility testcase profile is available to enable this checking. Details on the Deque AXE tool are available at o https://github.com/dequelabs/axe-core and https://github.com/dequelabs/axe-cli.
This tool requires
- Node version 8 or newer - https://nodejs.org/en/download/
- Deque AXE core (install from command prompt) "npm install –g axe-core"
- Deque AXE CLI (install from command prompt) "npm install –g axe-cli"
The WPSS Tool installer is available as a release in this repository
Web and Open Data Validator Installation on Linux
The tool distribution, WPSS_Tool_Linux.zip, does NOT include the required Perl or Python installers.
Perl and Python must be installed on the prior to installing the WPSS_Tool.
Supported versions of Perl include
- Perl 5.0 or later (32 or 64 bit).
Supported versions of Python include
- Python 2.7.6 or newer.
- Does not support Python 3.
Required version of Java
- The HTML5 validator required Oracle Java 8 or later and OpenJDK version 11.
The WPSS_Tool has been tested on the following platforms
- Redhat, Perl 5.24 (32 bit), Python 2.7.15
The Linux version has not been tested with headless chrome, pa11y or Deque AXE.
The WPSS Tool installer is available as a release in this repository
Web and Open Data Validator version 6.11.0 - Linux
Linux version of release 6.11.0
Installation
- Unzip the release
unzip WPSS_Tool_Linux.zip - run install script
cd WPSS_Tool_Linux
perl install.pl
There is no GUI available for Linux, only command line access. See documentation for details
- Web validator: https://github.com/wet-boew/wet-boew-wpss/wiki/WPSS-Validation-Tool-User-Guide#command-line-interface
- Open Data tool: https://github.com/wet-boew/wet-boew-wpss/wiki/Open-Data-Tool-User-Guide#command-line-interface
The WPSS_Tool has been tested on the following platforms
Redhat 6, Perl 5.24.2 , Python 2.7.15, java 1.8.0_144
Version 6.11.0
Web and Open Data Validator version 6.11.0
The Web and Open Data Validator provides web developers and quality assurance testers the ability to perform a number of web site, web page validation and Open data validation tasks at one time. Web site checking includes
- Accessibility: WCAG 2.0, Deque AXE orPa11y
- Link checking (e.g. broken links, broken anchors, cross language links)
- Mark-up validation (HTML, CSS, XML, Javascript)
- Mobile optimization (based on Yahoo's best practices)
Open data checking includes
- CSV, JSON, JSON schema and XML validation
- Content validation based on data dictionary patterns
- Data value consistency
Major Changes
Web Tool
- Update HTML5 validator to version 18.11.5 - HTML_VALIDATION
- Check that ARIA properties have valid values - WCAG_2.0-SC4.1.2
- Check that role values are valid - WCAG_2.0-SC4.1.2
- Check for focusable content inside aria-hidden tags - WCAG_2.0-SC4.1.2
- Don't report missing content for tags that have a presentation role - WCAG_2.0-G115
- Use chrome as headless user agent if the browser and required node/puppeteer installation
is available. Use PhantomJS as fallback.
- Check for link text that is just punctuation - WCAG_2.0-H30
- Check for nested interactive tags - WCAG_2.0-SC2.4.3
- Check for valid role and tag combinations - WCAG_2.0-SC4.1.2
- Check for text alternative on images with role="presentation" - WCAG_2.0-F39
- Add testcases, checks and accessibility profile for Deque AXE rules.
- Add testcases, checks and accessibility profile for Pa11y accessibility tool.
Chrome Headless User agent
The Chrome headless user agent may be used rather than PhantomJS. The following must be installed in order to use Chrome
- Chrome version 69 or newer
- Node version 8 or newer - https://nodejs.org/en/download/
- Puppeteer core module for node (install from command prompt) "npm install –g puppeteer-core"
If Chrome is not available, the WPSS_Tool will fall back to using PhantomJS and a message will be written to the stdout.txt file.
Deque AXE accessibility ruleset
Some of the Deque AXE accessibility rules may be checked. A new accessibility testcase profile is available to enable this checking. Details of the ruleset is available at https://dequeuniversity.com/rules/axe/3.3.
Pa11y Accessibility Test Tool
The Pa11y accessibility test tool may be run against web pages. The checks cannot be performed on pages behind a login (e.g. applications). A new accessibility testcase profile is available to enable this checking. Details on the Pa11y tool are available at https://github.com/pa11y/pa11y.
This tool requires
- Node version 8 or newer - https://nodejs.org/en/download/
- Pa11y module for node (install from command prompt) "npm install –g pa11y"
Open Data_Tool
- Check that minimum and maximum values match in numeric and date columns for language
variants of data files - OD_DATA
- Use first value in column as possible header label if no data dictionary is specified - OD_DATA
- Check that heading descriptions are not the same as the heading label - TP_PW_OD_DD
- Check that descriptions are different for each language - TP_PW_OD_DD
- Don't check value inconsistencies for columns that have data patterns that would
report errors - TP_PW_OD_CONT
- Report duplicate data rows or columns under testcase id TP_PW_OD_CONT_DUP so it can be filtered
- Report inconsistent data values under testcase id TP_PW_OD_CONT_CONSISTENCY so it can be
filtered
- Check for inconsistent capitalization for short (fewer than 100 characters) text
cells - TP_PW_OD_CONT_CONSISTENCY
A new Open Data testcase profile “PWGSC OD (core)” is available that eliminates duplicate data and inconsistent data checks from testing. This should be used for datasets that have valid duplicate or inconsistent data cells as this reduces false error messages.
Version 6.11.0 contains the following updates and additions
Web
- Update HTML5 validator to version 18.11.5 - HTML_VALIDATION
- Check that ARIA properties have valid values - WCAG_2.0-SC4.1.2
- If there are multiple role values, use first non-abstract role.
- Check that role values are valid - WCAG_2.0-SC4.1.2
- Check for focusable content inside aria-hidden tags - WCAG_2.0-SC4.1.2
- Don't report missing content for tags that have a presentation role - WCAG_2.0-G115
- Use chrome as headless user agent if the browser and required node/puppeteer installation
is available. Use PhantomJS as fallback.
- If a <video> is inside a <figure>, the <figcaption> can be used for the video captions
text - WCAG_2.0-G87
- Report missing captions or descriptions track for <audio> tags under technique
WCAG_2.0-G158 rather than G87.
- Check that li, dt and dd tags appear in lists - WCAG_2.0-H88
- Check for link text that is just punctuation - WCAG_2.0-H30
- Check for nested interactive tags - WCAG_2.0-SC2.4.3
- Check for valid role and tag combinations - WCAG_2.0-SC4.1.2
- Update to epubcheck 4.2.1 - EPUB_VALIDATION
- Check for text alternative on images with role="presentation" - WCAG_2.0-F39
- Add testcases, checks and accessibility profile for Deque AXE rules.
https://dequeuniversity.com/rules/axe/3.3
- Add testcases, checks and accessibility profile for Pa11y
accessibility tool. https://github.com/pa11y/pa11y
Open Data
- Don't check file suffix and mime-type for resources marked as "Other" in the
dataset description JSON object - OD_URL
- Check that minimum and maximum values match in numeric and date columns for language
variants of data files - OD_DATA
- Use first value in column as possible header label if no data dictionary is specified - OD_DATA
- Check that heading descriptions are not the same as the heading label - TP_PW_OD_DD
- Check that descriptions are different for each language - TP_PW_OD_DD
- Record XML data file tags that match data dictionary terms as
being equivalent to CSV column/Data dictionary headings.
- Ignore directory paths when determining if data files are language variants of the same data.
- Don't check value inconsistencies for columns that have data patterns that would report
errors - TP_PW_OD_CONT
- Check for duplicate resource URLs in dataset description JSON - TP_PW_OD_DATA
- Update Xerces2 XML parser to version 2.12.0.
- Report duplicate data rows or columns under testcase id TP_PW_OD_CONT_DUP so it can be filtered
- Report inconsistent data values under testcase id TP_PW_OD_CONT_CONSISTENCY so it can be
filtered
- Check for inconsistent capitalization for short (fewer than 100 characters) text
cells - TP_PW_OD_CONT_CONSISTENCY
Web and Open Data Validator Installer
The tool installer, WPSS_Tool.exe, does NOT include the required Perl or Python installers.
Perl and Python must be installed on the workstation prior to installing the WPSS_Tool.
Supported versions of Perl include
- Strawberry Perl 5.24 (32 bit) available from http://strawberryperl.com/download/5.24.4.1/strawberry-perl-5.24.4.1-32bit.msi
Does NOT work with Strawberry Perl versions greater than 5.25, or 64 bit versions.
Supported versions of Python include
- Python 2.7.6 available from http://python.org/ftp/python/2.7.6/python-2.7.6.msi
Required version of Java
- The HTML5 validator required Oracle Java 8 or later and OpenJDK version 11.
The WPSS_Tool has been tested on the following platforms
- Windows 10 (64 bit), Strawberry Perl 5.24 (32 bit), Python 2.7.6
- Windows 7 (64 bit), Strawberry Perl 5.24 (32 bit), Python 2.7.6
The WPSS Tool installer is available as a release in this repository
Version 6.10.0
Web and Open Data Validator version 6.10.0
The Web and Open Data Validator provides web developers and quality assurance testers the ability to perform a number of web site, web page validation and Open data validation tasks at one time. Web site checking includes
- WCAG 2.0 A and AA
- Link checking (e.g. broken links, broken anchors, cross language links)
- Mark-up validation (HTML, CSS, XML, Javascript)
- Mobile optimization (based on Yahoo's best practices)
Open data checking includes
- CSV, JSON, JSON schema and XML validation
- Content validation based on data dictionary patterns
Major Changes
Web Tool
- Update HTML5 validator to version 18.8.29- HTML_VALIDATION
- Changes and additional JAR files for Open JDK version 11 support.
- Update to epubcheck 4.1.0 - EPUB_VALIDATION
Open Data_Tool
- Remove punctuation only after letters (i.e. not in numbers) to reduce false
errors - TP_PW_OD_CONT
- Check for at least 1 comma in the first line of CSV file - OD_VAL
- Check for possible tab separator rather than comma separator in CSV files - OD_VAL
- Report possible currency values in CSV fields (leading or trailing $ sign) - TP_PW_OD_CONT
- Report thousands separator in numeric values in CSV fields (comma or space
separator) - TP_PW_OD_CONT
- Report MARC validation errors as content errors rather than Open Data errors - TP_PW_OD_CONT
- Validate very large XML files (> 100Mb) with a command line validator. Perl validation may fail
due to a limitation in the XML::Parser module - OD_VAL
- Check for very large text cells (> 32767 characters) in CSV files. These may be truncated by
spreadsheet tools (e.g. Excel) - TP_PW_OD_CONT
Version 6.10.0 contains the following updates and additions
Web
- Update HTML5 validator to version 18.8.29- HTML_VALIDATION
- Skip check of property attribute in meta tags - SWI_E_RDFA
- Check for illegal ancestor tag for main landmark - WCAG_2.0-SC1.3.1
- Changes and additional JAR files for Open JDK version 11 support.
- Update to epubcheck 4.1.0 - EPUB_VALIDATION
Open Data
- Include headings from data dictionary in file inventory CSV.
- Remove punctuation only after letters (i.e. not in numbers) to reduce false
errors - TP_PW_OD_CONT
- Check for at least 1 comma in the first line of CSV file - OD_VAL
- Check for possible tab separator rather than comma separator in CSV files - OD_VAL
- Include floating point (e.g. 0.00) as zero/blank values when checking for duplicate
columns - TP_PW_OD_CONT
- Report possible currency values in CSV fields (leading or trailing $ sign) - TP_PW_OD_CONT
- Report thousands separator in numeric values in CSV fields (comma or space
separator) - TP_PW_OD_CONT
- Report MARC validation errors as content errors rather than Open Data errors - TP_PW_OD_CONT
- Validate very large XML files (> 100Mb) with a command line validator. Perl validation
may fail due to a limitation in the XML::Parser module - OD_VAL
- Check that ZIP file is properly received before attempting to read it.
- Check for very large text cells (> 32767 characters) in CSV files. These may be truncated
by spreadsheet tools (e.g. Excel) - TP_PW_OD_CONT
Web and Open Data Validator Installer
The tool installer, WPSS_Tool.exe, does NOT include the required Perl or Python installers.
Perl and Python must be installed on the workstation prior to installing the WPSS_Tool.
Supported versions of Perl include
- Strawberry Perl 5.24 (32 bit) available from http://strawberryperl.com/download/5.24.4.1/strawberry-perl-5.24.4.1-32bit.msi
Does NOT work with Strawberry Perl versions greater than 5.25, or 64 bit versions.
Supported versions of Python include
- Python 2.7.6 available from http://python.org/ftp/python/2.7.6/python-2.7.6.msi
Required version of Java
- The HTML5 validator required Oracle Java 8 or later and OpenJDK version 11.
The WPSS_Tool has been tested on the following platforms
- Windows 10 (64 bit), Strawberry Perl 5.24 (32 bit), Python 2.7.6
The WPSS Tool installer is available as a release in this repository
Version 6.9.0
Web and Open Data Validator version 6.9.0
The Web and Open Data Validator provides web developers and quality assurance testers the ability to perform a number of web site, web page validation and Open data validation tasks at one time. Web site checking includes
- WCAG 2.0 A an AA
- Link checking (e.g. broken links, broken anchors, cross language links)
- Mark-up validation (HTML, CSS, XML, Javascript)
- Mobile optimization (based on Yahoo's best practices)
Open data checking includes
- CSV, JSON, JSON schema and XML validation
- Content validation based on data dictionary patterns
Major Changes
Web Tool
- A number of new EPUB checks added based on the International Digital Publishing Forum
accessibility techniques.
- Include ARIA landmarks in error messages reported for HTML pages to help detect page
template issues.
- Check for proper use and nesting of WAI-ARIA role values.
Open Data_Tool
- Content errors are reported in a separate content tab and results file.
- A number of content checks are performed such as identical values in a column,
inconsistent spacing, punctuation, pluralization in values - TP_PW_OD_CONT
- Check for leading or trailing whitespace in CSV fields - TP_PW_OD_CONT
- Check for whitespace inside of heading labels - TP_PW_OD_CONT
- Allow for MARC data files.
Version 6.9.0 contains the following updates and additions
Web
- Check heading levels are in proper nested order in EPUB files - EPUB_TITLE_002
- Check that there is only 1 top level heading in a <section> in EPUB files - EPUB_TITLE_002
- Check for list of tables in navigation if there are tables in EPUB content
documents - EPUB-ACCESS-002
- Check for no redirect URL after login form submission.
- Include ARIA landmarks in error messages reported for HTML pages to help detect
page template issues.
- Set the hash bang line in Perl and Python scripts in case of non-standard installs.
- Check that a tag with a role is contained by a tag with the required context
role - WCAG_2.0-H88.
- Check that tags that have WAI-ARIA attributes are contained in tags that have
an appropriate role value - WCAG_2.0-H88.
- Don't report errors for emphasised text inside headings - WCAG_2.0-F2
- Validate MARC files using the Metadata-qa-marc validator - WCAG_2.0-G134
- Add testcase group profile for PWGSC WET 4.0 Intranet.
- Check for required context roles if a tag has an explicit or implicit
WAI-ARIA role - WCAG_2.0-H88.
Open Data
- Check for identical values for all cells in a column - TP_PW_OD_CONT
- Display content errors in content tab.
- Check for leading or trailing whitespace in CSV fields - TP_PW_OD_CONT
- Check for whitespace inside of heading labels - TP_PW_OD_CONT
- Check that the number of columns match for all data files in a dataset - TP_PW_OD_CONT
- Check that date (YYYY-MM-DD) columns match for language variants of data files - OD_DATA
- Check text columns for consistency in spacing, punctuation and pluralization
of values - TP_PW_OD_CONT
- Allow for MARC data files.
- Report duplicate CSV rows under testcase identifier TP_PW_OD_CONT
- Report duplicate JSON-CSV arrays under testcase identifier TP_PW_OD_CONT
- Accept application/csv as a mime type for CSV files.
Web and Open Data Validator Installer
The tool installer, WPSS_Tool.exe, does NOT include the required Perl or Python installers.
Perl and Python must be installed on the workstation prior to installing the WPSS_Tool.
Supported versions of Perl include
- Strawberry Perl 5.18 (32 bit) available from http://strawberry-perl.googlecode.com/files/strawberry-perl-5.18.1.1-32bit.msi
Supported versions of Python include
- Python 2.7.6 available from http://python.org/ftp/python/2.7.6/python-2.7.6.msi
Required version of Java
- The HTML5 validator required Java 8 or later.
The WPSS_Tool has been tested on the following platforms
- Windows 7 (32 bit), Strawberry Perl 5.18 (32 bit), Python 2.7.6
The WPSS Tool installer is available as a release in this repository
Version 6.8.0
Web and Open Data Validator version 6.8.0
The Web and Open Data Validator provides web developers and quality assurance testers the ability to perform a number of web site, web page validation and Open data validation tasks at one time. Web site checking includes
- WCAG 2.0 A an AA
- Link checking (e.g. broken links, broken anchors, cross language links)
- Mark-up validation (HTML, CSS, XML, Javascript)
- Mobile optimization (based on Yahoo's best practices)
Open data checking includes
- CSV, JSON, JSON schema and XML validation
- Content validation based on data dictionary patterns
Major Changes
Web Tool
- Limit size of link check cache by content size as well as number of links to control memory usage.
- Update HTML5 validator to version 17.11.1.
- Generate a link details CSV file for all links in web pages.
- Add checks for EPUB Accessibility Techniques version 1.0
http://www.idpf.org/epub/a11y/techniques/techniques.html
Open Data_Tool
- Check for blank column heading - TP_PW_OD_DATA
- Use JSON::PP, the pure Perl backend to JSON.pm. In Strawberry Perl 5.22 and later on
Windows, the JSON::XS module fails to decode a JSON string in a multi-threaded program.
- Include all non-blank lines in list item - OD_DATA
Version 6.8.0 contains the following updates and additions
Web
- Add "WPSS_Tool" to user agent string for PhantomJS.
- Limit size of link check cache by content size as well as number of links to control memory usage.
- Update HTML5 validator to version 17.11.1.
- Generate a link details CSV file for all links in web pages.
- Add checks for EPUB Accessibility Techniques version 1.0
http://www.idpf.org/epub/a11y/techniques/techniques.html
- Add configuration item to limit the number of errors to report for a single URL.
Open Data
- Check for blank column heading - TP_PW_OD_DATA
- Use JSON::PP, the pure Perl backend to JSON.pm. In Strawberry Perl 5.22 and later on
Windows, the JSON::XS module fails to decode a JSON string in a multi threaded program.
- Include all non-blank lines in list item - OD_DATA
- Add configuration item to limit the number of errors to report for a single URL.
Web and Open Data Validator Installer
The tool installer, WPSS_Tool.exe, does NOT include the required Perl or Python installers.
Perl and Python must be installed on the workstation prior to installing the WPSS_Tool.
Supported versions of Perl include
- Strawberry Perl 5.18 (32 bit) available from http://strawberry-perl.googlecode.com/files/strawberry-perl-5.18.1.1-32bit.msi
Supported versions of Python include
- Python 2.7.6 available from http://python.org/ftp/python/2.7.6/python-2.7.6.msi
Required version of Java
- The HTML5 validator required Java 8 or later.
The WPSS_Tool has been tested on the following platforms
- Windows 7 (32 bit), Strawberry Perl 5.18 (32 bit), Python 2.7.6
The WPSS Tool installer is available as a release in this repository
Version 6.7.0
Web and Open Data Validator version 6.7.0
The Web and Open Data Validator provides web developers and quality assurance testers the ability to perform a number of web site, web page validation and Open data validation tasks at one time. Web site checking includes
- WCAG 2.0 A an AA
- Link checking (e.g. broken links, broken anchors, cross language links)
- Mark-up validation (HTML, CSS, XML, Javascript)
- Mobile optimization (based on Yahoo's best practices)
Open data checking includes
- CSV, JSON, JSON schema and XML validation
- Content validation based on data dictionary patterns
Major Changes
Web Tool
- Stop redirecting if a URL redirects back to itself.
- Allow input to be nested in label - WCAG_2.0-F68
Open Data_Tool
- Clarify error message if header row is not found - TP_PW_OD_DATA
- Ensure file: protocol URLs have 3 slash characters after the colon.
- Don't report row count mismatch errors for language variants of CSV files, report
mismatches in the number of non-blank cells in columns - OD_DATA
- Check data dictionary labels and CSV column headings for leading or trailing
whitespace - TP_PW_OD_DATA
- Check for UTF-8 BOM in JSON data files - TP_PW_OD_DATA
- Check for duplicate data files - OD_DATA
Version 6.7.0 contains the following updates and additions
Web
- Stop redirecting if a URL redirects back to itself.
- Allow input to be nested in label - WCAG_2.0-F68
Open Data
- Clarify error message if header row is not found - TP_PW_OD_DATA
- Ensure file: protocol URLs have 3 slash characters after the colon.
- Don't report row count mismatch errors for language variants of CSV files, report
mismatches in the number of non-blank cells in columns - OD_DATA
- Check data dictionary labels and CSV column headings for leading or trailing
whitespace - TP_PW_OD_DATA
- Check for UTF-8 BOM in JSON data files - TP_PW_OD_DATA
- Check for duplicate data files - OD_DATA
- Check for python 2.7.0 or later at install time.
- Set the user agent string for the non-robots user agent.
- Add "WPSS_Tool" to user agent string for Java tools.
- Strip named anchors from URL when checking <data_type> URL in data dictionary
to avoid possible multiple retrievals of the data dictionary file.
Web and Open Data Validator Installer
The tool installer, WPSS_Tool.exe, does NOT include the required Perl or Python installers.
Perl and Python must be installed on the workstation prior to installing the WPSS_Tool.
Supported versions of Perl include
- Strawberry Perl 5.18 (32 bit) available from http://strawberry-perl.googlecode.com/files/strawberry-perl-5.18.1.1-32bit.msi
Supported versions of Python include
- Python 2.7.6 available from http://python.org/ftp/python/2.7.6/python-2.7.6.msi
Required version of Java
- The HTML5 validator required Java 8 or later.
The WPSS_Tool has been tested on the following platforms
- Windows 7 (32 bit), Strawberry Perl 5.18 (32 bit), Python 2.7.6
The WPSS Tool installer is available as a release in this repository