Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
111 changes: 65 additions & 46 deletions _pages/projects/gaia.md
Original file line number Diff line number Diff line change
Expand Up @@ -38,24 +38,24 @@ classes: wide
height: 100%;
object-fit: cover;
}

</style>
</head>


<div class="container" style="overflow: hidden;">
<div style="width: 33%; float: left;margin-bottom: 20px; text-align: center;">
<div style="width: 33%; float: left;margin-bottom: 20px; text-align: center;">
<a href="http://www.urjc.es">
<img style="max-width: 60%; height: auto; margin-bottom: 10px;" src="https://upload.wikimedia.org/wikipedia/commons/thumb/8/84/URJC_logo.svg/2560px-URJC_logo.svg.png" alt="">
<img style="max-width: 60%; height: auto; margin-bottom: 10px;" src="https://upload.wikimedia.org/wikipedia/commons/thumb/8/84/URJC_logo.svg/2560px-URJC_logo.svg.png" alt="">
</a>
</div>
<div style="width: 33%; float: left; margin-bottom: 20px; text-align: center;">
<div style="width: 33%; float: left; margin-bottom: 20px; text-align: center;">
<a href="https://roboticslaburjc.github.io/">
<img style="max-width: 30%; height: auto; margin-bottom: 10px;" src="https://pbs.twimg.com/profile_images/1709157413134188544/MHuOqgeK_400x400.jpg" alt="">
<img style="max-width: 30%; height: auto; margin-bottom: 10px;" src="https://pbs.twimg.com/profile_images/1709157413134188544/MHuOqgeK_400x400.jpg" alt="">
</a>
</div>
<div style="width: 33%; float: left; margin-bottom: 100px; text-align: center;">
<img style="max-width: 33%; height: auto; margin-bottom: 10px;" src="/assets/images/lines/gaia.jpg" alt="">
<div style="width: 33%; float: left; margin-bottom: 100px; text-align: center;">
<img style="max-width: 33%; height: auto; margin-bottom: 10px;" src="/assets/images/lines/gaia.jpg" alt="">
</div>
</div>

Expand All @@ -69,29 +69,29 @@ Wildfires that burn for weeks and affect millions of people represent a challeng

The main 3 contributions of the RoboticsLab group are:

<b> * LIDAR Signal Densification Algorithms:</b> Research focuses on algorithms and software techniques for densifying the LIDAR sensor signal, commonly used in outdoor robots.
<b> * LIDAR Signal Densification Algorithms:</b> Research focuses on algorithms and software techniques for densifying the LIDAR sensor signal, commonly used in outdoor robots.

<b> * Outdoor Navigation Algorithms:</b> This involves developing and evaluating point-to-point autonomous navigation algorithms for robots in unstructured environments, such as forests.
<b> * Outdoor Navigation Algorithms:</b> This involves developing and evaluating point-to-point autonomous navigation algorithms for robots in unstructured environments, such as forests.

<b> * Deep Learning for Object and Surface Detection:</b> Evolution of techniques for detecting objects and surfaces in unstructured environments using Deep Learning and sensors like LIDAR and visual cameras, aimed at autonomous robot navigation.
<b> * Deep Learning for Object and Surface Detection:</b> Evolution of techniques for detecting objects and surfaces in unstructured environments using Deep Learning and sensors like LIDAR and visual cameras, aimed at autonomous robot navigation.

<div style="display: flex; justify-content: space-around; align-items: flex-start;">
<div style="width: 70%; float: left; margin-bottom: 100px; text-align: center;">
<img style="max-width: 70%; height: auto; margin-bottom: 10px;" src="https://gaia-project.es/media/uploads/bloques/general_/bosque__en_llamas.jpg" alt="">
<div style="width: 70%; float: left; margin-bottom: 100px; text-align: center;">
<img style="max-width: 70%; height: auto; margin-bottom: 10px;" src="https://gaia-project.es/media/uploads/bloques/general_/bosque__en_llamas.jpg" alt="">
</div>
</div>

## Videos

### Lidar Segmentation
### LiDAR Segmentation
<div class="swiper mySwiper">
<div class="swiper-wrapper">
<div class="swiper-slide">
<iframe
id="video-lidar-1"
id="video-lidar-3"
width="560"
height="315"
src="https://www.youtube.com/embed/MCsIj0M7fzM?enablejsapi=1&rel=0&modestbranding=1"
src="https://www.youtube.com/embed/AcJvDmwYneQ?enablejsapi=1&rel=0&modestbranding=1"
title="YouTube video player"
frameborder="0"
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share"
Expand All @@ -100,7 +100,7 @@ The main 3 contributions of the RoboticsLab group are:
</div>
<div class="swiper-slide">
<iframe
id="video-liDAR-2"
id="video-lidar-2"
width="560"
height="315"
src="https://www.youtube.com/embed/qwk5qm3bDOw?enablejsapi=1&rel=0&modestbranding=1"
Expand All @@ -112,10 +112,10 @@ The main 3 contributions of the RoboticsLab group are:
</div>
<div class="swiper-slide">
<iframe
id="video-lidar-3"
id="video-lidar-1"
width="560"
height="315"
src="https://www.youtube.com/embed/AcJvDmwYneQ?enablejsapi=1&rel=0&modestbranding=1"
src="https://www.youtube.com/embed/MCsIj0M7fzM?enablejsapi=1&rel=0&modestbranding=1"
title="YouTube video player"
frameborder="0"
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share"
Expand All @@ -128,27 +128,36 @@ The main 3 contributions of the RoboticsLab group are:
<div class="swiper-pagination"></div>
</div>

### Environments and Visual Segmentation
### Image Segmentation
<div class="swiper mySwiper">
<div class="swiper-wrapper">
<div class="swiper-slide">
<iframe
id="video-env-1"
id="video-img-1"
width="560"
height="315"
src="https://www.youtube.com/embed/Zoy12gF2pFw?enablejsapi=1&rel=0&modestbranding=1"
src="https://www.youtube.com/embed/pZQ4GW4Rv3E?enablejsapi=1&rel=0&modestbranding=1"
title="YouTube video player"
frameborder="0"
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share"
allowfullscreen>
</iframe>
</div>
</div>
<div class="swiper-button-next"></div>
<div class="swiper-button-prev"></div>
<div class="swiper-pagination"></div>
</div>

### Simulated Environments
<div class="swiper mySwiper">
<div class="swiper-wrapper">
<div class="swiper-slide">
<iframe
id="video-env-2"
id="video-env-4"
width="560"
height="315"
src="https://www.youtube.com/embed/ySQJ98mw5pQ?enablejsapi=1&rel=0&modestbranding=1"
src="https://www.youtube.com/embed/W-XWX9uMyDU?enablejsapi=1&rel=0&modestbranding=1"
title="YouTube video player"
frameborder="0"
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share"
Expand All @@ -160,7 +169,7 @@ The main 3 contributions of the RoboticsLab group are:
id="video-env-3"
width="560"
height="315"
src="https://www.youtube.com/embed/ZRoQ_49oX1k?enablejsapi=1&rel=0&modestbranding=1"
src="https://www.youtube.com/embed/Zoy12gF2pFw?enablejsapi=1&rel=0&modestbranding=1"
title="YouTube video player"
frameborder="0"
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share"
Expand All @@ -169,10 +178,10 @@ The main 3 contributions of the RoboticsLab group are:
</div>
<div class="swiper-slide">
<iframe
id="video-env-4"
id="video-env-2"
width="560"
height="315"
src="https://www.youtube.com/embed/W-XWX9uMyDU?enablejsapi=1&rel=0&modestbranding=1"
src="https://www.youtube.com/embed/ySQJ98mw5pQ?enablejsapi=1&rel=0&modestbranding=1"
title="YouTube video player"
frameborder="0"
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share"
Expand All @@ -181,17 +190,17 @@ The main 3 contributions of the RoboticsLab group are:
</div>
<div class="swiper-slide">
<iframe
id="video-env-5"
id="video-env-1"
width="560"
height="315"
src="https://www.youtube.com/embed/pZQ4GW4Rv3E?enablejsapi=1&rel=0&modestbranding=1"
src="https://www.youtube.com/embed/ZRoQ_49oX1k?enablejsapi=1&rel=0&modestbranding=1"
title="YouTube video player"
frameborder="0"
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share"
allowfullscreen>
</iframe>
</div>
</div>
</div>
<div class="swiper-button-next"></div>
<div class="swiper-button-prev"></div>
<div class="swiper-pagination"></div>
Expand Down Expand Up @@ -223,7 +232,7 @@ The main 3 contributions of the RoboticsLab group are:
<div class="swiper-wrapper">
<div class="swiper-slide">
<iframe
id="video-trash-1"
id="video-trash-2"
width="560"
height="315"
src="https://www.youtube.com/embed/E3NFhQJKh64?enablejsapi=1&rel=0&modestbranding=1"
Expand All @@ -235,7 +244,7 @@ The main 3 contributions of the RoboticsLab group are:
</div>
<div class="swiper-slide">
<iframe
id="video-trash-2"
id="video-trash-1"
width="560"
height="315"
src="https://www.youtube.com/embed/qjQ6a4S5jp4?enablejsapi=1&rel=0&modestbranding=1"
Expand Down Expand Up @@ -295,8 +304,8 @@ The main 3 contributions of the RoboticsLab group are:
},
},
});


// Cargar la API de YouTube
function onYouTubeIframeAPIReady() {
// YouTube IFrames ya estarán listos
Expand All @@ -307,36 +316,36 @@ The main 3 contributions of the RoboticsLab group are:
firstScriptTag.parentNode.insertBefore(tag, firstScriptTag);
</script>

<!--
<!--
<div style="display: flex; justify-content: space-around; align-items: flex-start;">


<div style="width: 60%; text-align: center; padding: 10px;">
<div style="width: 60%; text-align: center; padding: 10px;">
<h2>Real-Time 3D Lidar Visualizer</h2>
<iframe width="560" height="315" src="https://www.youtube.com/embed/qwk5qm3bDOw?si=vETtTTi4hGcqeiGt" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
</div>



<div style="width: 60%; text-align: center; padding: 10px;">
<div style="width: 60%; text-align: center; padding: 10px;">
<h2>Realistic Unstructured environment v3</h2>
<iframe width="560" height="315" src="https://www.youtube.com/embed/Zoy12gF2pFw?si=UcfMKxeauzWipMyf" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
</div>






</div>

<div style="display: flex; justify-content: space-around; align-items: flex-start;">


<div style="width: 60%; text-align: center; padding: 10px;">
<div style="width: 60%; text-align: center; padding: 10px;">
<h2>Unstructured environment v2</h2>
<iframe width="560" height="315" src="https://www.youtube.com/embed/ySQJ98mw5pQ?si=yR3h9Cu_G6WgOkjS" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
</div>

<div style="width: 60%; text-align: center; padding: 10px;">
<div style="width: 60%; text-align: center; padding: 10px;">
<h2>Unstructured environment</h2>
<iframe width="560" height="315" src="https://www.youtube.com/embed/ZRoQ_49oX1k?si=eto7gPZoU0TwweIQ" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
</div>
Expand All @@ -347,6 +356,18 @@ The main 3 contributions of the RoboticsLab group are:


## Publications
<div style="display: flex; justify-content: space-around; max-width: 1200px; margin: auto;">
<div style="background-color: #f2f2f2; box-shadow: -8px 0 15px -3px rgba(0, 0, 0, 0.1); padding: 20px; margin: 10px; flex: 1;">
<div style="font-size: 18px; font-weight: bold; margin-bottom: 5px;">Cross-Dataset Evaluation of Visual Semantic Segmentation Models for Off-Road Autonomous Driving</div>
<div style="font-size: 16px; color: #555; margin-bottom: 5px;">David Pascual-Hernández, Sergio Paniego, Roberto Calvo-Palomino, Inmaculada Mora-Jiménez, Jose Maria Cañas-Plaza</div>
<div style="font-size: 14px; color: #555;">Expert Systems with Applications, Elsevier, 2026</div>
</div>
<div style="background-color: #f2f2f2; box-shadow: -8px 0 15px -3px rgba(0, 0, 0, 0.1); padding: 20px; margin: 10px; flex: 1;">
<div style="font-size: 18px; font-weight: bold; margin-bottom: 5px;">Deep Learning-Based Semantic Segmentation of LiDAR Point Clouds for Autonomous Driving in Unstructured Environments</div>
<div style="font-size: 16px; color: #555; margin-bottom: 5px;"> Félix Martínez, David Pascual-Hernández, Daniel Borja Fernández, Inmaculada Mora Jiménez, José María Cañas</div>
<div style="font-size: 14px; color: #555;">Proceedings of the XXV International Workshop on Physical Agents (WAF), 2025</div>
</div>
</div>

<div style="display: flex; justify-content: space-around; max-width: 1200px; margin: auto;">
<div style="background-color: #f2f2f2; box-shadow: -8px 0 15px -3px rgba(0, 0, 0, 0.1); padding: 20px; margin: 10px; flex: 1;">
Expand Down Expand Up @@ -374,21 +395,19 @@ The main 3 contributions of the RoboticsLab group are:
<div style="font-size: 14px; color: #555;">SoftwareX, Elsevier, 2024</div>
</div>


</div>




## Founded by



<div class="container" style="overflow: hidden;">
<div style="width: 100%; float: left;margin-bottom: 20px; text-align: center;">
<img style="max-width: 100%; height: auto; margin-bottom: 10px;" src="/assets/images/lines/gaia_founded.png" alt="Paper">
<img style="max-width: 100%; height: auto; margin-bottom: 10px;" src="/assets/images/lines/gaia_founded.png" alt="Paper">
</div>

</div>


</div>
Original file line number Diff line number Diff line change
@@ -0,0 +1,68 @@
---
permalink: /publications/2026/cross_dataset_evaluation_of_visual_semantic_segmentation_models_for_off_road_autonomous_driving
title: "Cross-dataset Evaluation of Visual Semantic Segmentation Models for Off-road Autonomous Driving"


layout: single

classes: wide
---

<p style="text-align: center; font-weight: bold;">Neurocomputing, 2024</p>

<p style="text-align: center"><a href="https://sergiopaniego.github.io/">David Pascual-Hernández<sup>1</sup></a>, <a href="https://sergiopaniego.github.io/">Sergio Paniego<sup>1</sup></a>, <a href="https://servicios.urjc.es/pdi/ver/roberto.calvo">Roberto Calvo-Palomino<sup>1</sup></a></p>, <a href="https://servicios.urjc.es/pdi/ver/inmaculada.mora">Inmaculada Mora-Jiménez<sup>1</sup></a></p>, <a href="https://gsyc.urjc.es/jmplaza/">Jose Maria Cañas-Plaza<sup>1</sup></a></p>
<div class="container" style="overflow: hidden;">
<p style="text-align: center; width: 50%; float: left;">1: <a href="https://www.urjc.es/"><img src="https://upload.wikimedia.org/wikipedia/commons/thumb/8/84/URJC_logo.svg/1280px-URJC_logo.svg.png" width="40%" height="40%" alt="URJC"/></a></p>
</div>
<p style="text-align: center">DOI: <a href="https://doi.org/10.1016/j.eswa.2026.132656">10.1016/j.eswa.2026.132656</a></p>


## Abstract

Intelligent autonomous driving in off-road environments is an emerging field with great potential to impact areas such as agriculture, forestry, and rescue operations. Perception in these scenarios presents unique challenges due to the diversity of elements and weather conditions, along with the inherent ambiguity in class definitions. Consequently, off-road visual semantic segmentation datasets remain underdeveloped, roughly ten times smaller than their urban counterparts, hindering dependable performance assessment and potentially compromising the safety of autonomous systems. To address these challenges, we present a comprehensive cross-dataset evaluation of visual semantic segmentation models for autonomous off-road navigation. We propose a unified ontology that harmonizes class definitions across relevant datasets, enabling their combination for both training and testing. This approach ensures fair model comparisons and reliable assessment of generalization to unseen domains. We further benchmark models on the original datasets, analyze the impact of different ontology harmonization criteria and conversion strategies, and evaluate the trade-off between segmentation performance and computational cost. Results show that Transformer-based architectures achieve the most consistent segmentation performance across datasets. While often computationally demanding, some variants maintain real-time inference (≈12 ms) with top-tier accuracy. The unified ontology simplifies the segmentation task, yielding more reliable models and about 40% faster training convergence. Cross-dataset training further enhances generalization, improving mean IoU by up to +20% on RUGD and +13% on WildScenes compared to RELLIS-3D-only training. Overall, this study provides valuable insights for developing robust perception modules for off-road autonomous vehicles.

<div style="display: flex;justify-content: space-around;margin-bottom: 20px;">
<div style="width: 45%;">
<img src="https://ars.els-cdn.com/content/image/1-s2.0-S0957417426015691-gr2_lrg.jpg" frameborder="0" allowfullscreen></img>
</div>
<div style="width: 45%;">
<img src="https://ars.els-cdn.com/content/image/1-s2.0-S0957417426015691-gr11_lrg.jpg" frameborder="0" allowfullscreen></img>
</div>
</div>

## Materials

<div class="container" style="overflow: hidden;">
<div style="width: 33%; float: left;margin-bottom: 20px; text-align: center;">
<a href="https://doi.org/10.1016/j.eswa.2026.132656">
<img style="max-width: 30%; height: auto; margin-bottom: 10px;" src="https://cdn-icons-png.flaticon.com/512/3731/3731553.png" alt="Paper">
<p>Paper</p>
</a>
</div>
<div style="width: 33%; float: left;margin-bottom: 20px; text-align: center;">
<a href="https://github.com/JdeRobot/PerceptionMetrics">
<img style="max-width: 30%; height: auto; margin-bottom: 10px;" src="https://static.thenounproject.com/png/1448954-200.png" alt="Code">
<p>Evaluation Code</p>
</a>
</div>
<div style="width: 33%; float: left;margin-bottom: 20px; text-align: center;">
<a href="https://huggingface.co/roboticslaburjc-org/cross-dataset-visual-offroad-segmentation">
<img style="max-width: 30%; height: auto; margin-bottom: 10px;" src="https://cdn-icons-png.flaticon.com/512/6461/6461819.png" alt="Models' weights">
<p>Models' weights</p>
</a>
</div>
</div>


## Citation

```
@article{pascual2026cross,
title={Cross-Dataset Evaluation of Visual Semantic Segmentation Models for Off-Road Autonomous Driving},
author={Pascual-Hern{\'a}ndez, David and Paniego, Sergio and Calvo-Palomino, Roberto and Mora-Jim{\'e}nez, Inmaculada and Ca{\~n}as-Plaza, Jos{\'e} Mar{\'\i}a},
journal={Expert Systems with Applications},
pages={132656},
year={2026},
publisher={Elsevier}
}
```
Loading