The Level Agreement Tool is a tool designed to compare two sets of processed data: 'X' serving as the ground truth and 'Y' as the comparison set. The tool focuses on specific columns, namely [id, comments, prediction]. By utilizing this tool, users can merge the datasets and assess label differences effectively. It provides computed metrics that facilitate the identification of the more accurate and aligned dataset, aligning with the users' expectations. All data used for testing is augmented and generated.
- Data Comparison: Compare processed data sets 'X' and 'Y' based on specified columns.
- Merged File Creation: Generate a merged file to assess label differences and discrepancies.
- Computed Metrics: Utilize computed metrics to identify accurate and aligned datasets.
- User-Friendly Interface: Intuitive and easy-to-use interface for seamless data comparison.
-
Input Data:
- Prepare two sets of processed data: 'X' (ground truth) and 'Y' (comparison set).
- Ensure the data includes columns: [id, comments, prediction].
-
Run the Tool:
- Use the tool to compare datasets and generate a merged file.
- Analyze computed metrics to identify accurate and aligned data.
This tool does not require installation. Simply download the provided files and run the tool on your preferred platform or environment.
For support or inquiries, please contact [insert email address or link to the issue tracker here].
We welcome contributions from the community. If you want to contribute to this project, please follow these steps:
- Fork the repository and create your branch from
main. - Make your changes, ensuring code quality and adherence to project standards.
- Test your changes thoroughly.
- Create a pull request, describing the changes you made and their purpose.
This tool is maintained by Craig Munthali.
MIT License
Copyright (c) [2023] [Craig Munthali]
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NON-INFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Development of this project is active and ongoing. We encourage contributions and feedback from the community to enhance the tool further.