1: Create a standardized FAIR guideline framework that balances data requirements, accessibility, availability, connectivity, and value generation.
2: Design a Livestock Health Ontology (LHO) tailored to specific species, enriching knowledge graphs with domain expertise.
3: Convert raw cattle, pig and poultry data into RDF format, harnessing RDF benefits for improved data sharing, integration, and querying.
4:Create a mapping process to match the cleaned RDF data with the species-specific LHO ontology, ensuring that the data can work together smoothly and be easily understood. You can find the code in R, PySpark, and Python notebooks here.
5: Implement a data visualization tool to analyze and report farm animal disease management data, empowering insightful decision-making and data interpretation.
We've made CattleUse work on three platforms: Python, R, and Pyspark. We did this by using data from different animal health service labs in Europe.
In summary, while the Pyspark implementation was showcased with the Lab1 dataset, the same methodology was followed for the remaining datasets (Lab2, Lab3, Lab4, and Lab5), albeit without a separate Pyspark demonstration. In the 'UnionOfAllRDF.ipynb' notebook, we aggregate RDF data from Lab1, Lab2, Lab3, Lab4, and Lab5. This process involves combining RDF files from these sources into a unified representation. The resulting unified RDF representation is then utilized in visualization tools for example Tableau for comprehensive analysis.
| Platforms | Lab1 | Lab2 | Lab3 | Lab4 | Lab5 |
|---|---|---|---|---|---|
| Python Panda | CattleLab1DataPandacode.ipynb | CattleLab2DataPandaCode.ipynb | CattleLab3DataPandaCode.ipynb | CattleLab4DataPandacode.ipynb | CattleLab5DataPandaCode.ipynb |
| R | CattleLab1DataRCode.ipynb | CattleLab2DataRCode.ipynb | CattleLab3DataRCode.ipynb | CattleLab4RCode.ipynb | CattleLab5DataRCode.ipynb |
| PySpark | CattleLab1DataPysparkcode.ipynb | ---------------------- | ----------------------------- | ----------------------- | ------------------------ |
| Python Panda | PigLab1DataPandacode.ipynb | PigLab2DataPandaCode.ipynb | PigLab3DataPandaCode.ipynb | PigLab4Pandacode.ipynb | PigLab5DataPandaCode.ipynb |
| Python Panda | PoultryLab1DataPandacode.ipynb | ------------------------ | ------------------------ | ------------------------ | ------------------------ |
| Union of All RDF | ------------------------- | -UnionOfAllRDF.ipynb-- | ----------------------------- | ------------------------ | ------------------------- |