1
- # pytorch_ros
1
+ # pytorch_scene_recognition_ros
2
2
3
3
## 1. Overview
4
4
5
- A ROS package to use [ LibTorch] ( https://pytorch.org/cppdocs/ ) , a PyTorch C++ API, for inference on a trained model .
5
+ A ROS package to use [ LibTorch] ( https://pytorch.org/cppdocs/ ) , a PyTorch C++ API, for inference with our scene recognition models .
6
6
7
7
A Docker environment for running this package is [ here] ( https://github.com/ActiveIntelligentSystemsLab/pytorch-enet-docker ) .
8
8
This package is ** only tested in the virtual environment** .
9
9
10
- ## 2. Nodes
10
+ ## 2. Requirements
11
11
12
- ### 2.1 ` pytorch_seg_trav_path_node `
12
+ - PyTorch with LibTorch built
13
+ - Tested with 1.5.0
14
+ - [ semantic_segmentation_srvs/GetLabelAndProbability] ( https://github.com/ActiveIntelligentSystemsLab/aisl_utils/blob/master/aisl_srvs/semantic_segmentation_srv/srv/GetLabelAndProbability.srv )
13
15
14
- #### ** 2.1.1 Subscribed topics**
16
+ ## 3. Nodes
17
+
18
+ ### 3.1 ` pytorch_seg_trav_path_node `
19
+
20
+ A node to use a multi-task model for semantic segmentation, traversability estimation, and path estimation.
21
+
22
+ #### ** 3.1.1 Subscribed topics**
15
23
16
24
- ` image ` ([ sensor_msgs/Image] ( http://docs.ros.org/melodic/api/sensor_msgs/html/msg/Image.html ) )
17
25
18
26
An input image
19
27
20
- #### ** 2 .1.2 Published topics**
28
+ #### ** 3 .1.2 Published topics**
21
29
22
30
- ` label ` ([ sensor_msgs/Image] ( http://docs.ros.org/melodic/api/sensor_msgs/html/msg/Image.html ) )
23
31
@@ -39,15 +47,15 @@ This package is **only tested in the virtual environment**.
39
47
40
48
End point of the estimated path line
41
49
42
- #### ** 2 .1.3 Service**
50
+ #### ** 3 .1.3 Service**
43
51
44
52
- ` get_label_image ` ([ semantic_segmentation_srvs/GetLabelAndProbability] ( https://github.com/ActiveIntelligentSystemsLab/aisl_utils/blob/master/aisl_srvs/semantic_segmentation_srv/srv/GetLabelAndProbability.srv ) )
45
53
46
54
Return inference results (segmentation and traversability) for a given image.
47
55
48
- ### ** 2 .2 visualizer.py**
56
+ ### ** 3 .2 visualizer.py**
49
57
50
- #### ** 2 .2.1 Subscribed topics**
58
+ #### ** 3 .2.1 Subscribed topics**
51
59
52
60
- ` image ` ([ sensor_msgs/Image] ( http://docs.ros.org/melodic/api/sensor_msgs/html/msg/Image.html ) )
53
61
@@ -61,19 +69,19 @@ This package is **only tested in the virtual environment**.
61
69
62
70
End point of the estimated path line from the inference node
63
71
64
- #### ** 2 .2.2 Published topics**
72
+ #### ** 3 .2.2 Published topics**
65
73
66
74
- ` image_with_path ` ([ sensor_msgs/Image] ( http://docs.ros.org/melodic/api/sensor_msgs/html/msg/Image.html ) )
67
75
68
76
An image with the path overlaid
69
77
70
- ## 3 . How to run the node
78
+ ## 4 . How to run the node
71
79
72
80
```
73
81
roslaunch pytorch_enet_ros.launch image:=<image topic name> model_name:=<model name>
74
82
```
75
83
76
- ## 4 . Weight files
84
+ ## 5 . Weight files
77
85
78
86
The ROS nodes in this package use models saved as a serialized Torch Script file.
79
87
@@ -86,7 +94,7 @@ If the version of PyTorch that runs this ROS package and that you generate your
86
94
87
95
For example, if you use [ our Docker environment] ( https://github.com/ActiveIntelligentSystemsLab/pytorch-enet-docker ) , the weights should be generated using PyTorch 1.5.0.
88
96
89
- ## 5 . Color map
97
+ ## 6 . Color map
90
98
91
99
For visualization of semantic segmentation, we use a color map image.
92
100
0 commit comments