No version for distro humble showing github. Known supported distros are highlighted in the buttons above.
![]() |
genmos_object_search_ros package from genmos_object_search repogenmos_object_search_ros genmos_object_search_ros2 |
ROS Distro
|
Package Summary
Tags | No category tags. |
Version | 0.2.0 |
License | MIT |
Build type | CATKIN |
Use | RECOMMENDED |
Repository Summary
Description | GenMOS - A System for Generalized (off-the-shelf) 3D Multi-Object Search | ICRA 2023 |
Checkout URI | https://github.com/zkytony/genmos_object_search.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2023-05-17 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | No category tags. |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
The genmos_object_search_ros package
Additional Links
No additional links.
Maintainers
- kaiyu
Authors
No additional authors.
* Example ROS package that uses genmos_object_search
Note that genmos_object_search is written in Python 3. For ROS, it is
best integrated with ROS Noetic.
** Setup
*** Create symbolic link
Go to the `src` folder of your ROS workspace. Then run:
#+begin_src
ln -s path/to/genmos_object_search/ros genmos_object_search_ros
#+end_src
This effectively adds a ROS package called "genmos_object_search_ros" into your workspace
*** Install Dependencies
This is a ROS package; Therefore, it is expected to operate within a ROS workspace.
Before building this package, make sure you have activated a virtualenv. Then, run
#+begin_src
source install_dependencies.bash
#+end_src
to install python dependencies.
*Note* that we use [[https://github.com/eric-wieser/ros_numpy][ros_numpy]] to convert point cloud ROS message to numpy array,
so that point cloud observation can be used to update the search region (see [[./src/genmos_ros/genmos_ros.py#117][code]]).
Typically, one installs ros_numpy by ~sudo apt-get install ros-noetic-ros-numpy~.
However, there are two issues (1) [[https://github.com/eric-wieser/ros_numpy/issues/37][this issue]] where numpy > 1.24 causes an AttributeError on `numpy.float`,
and that (2) the ros_numpy package was no longer maintained.
As a result, we folded the source code of ros_numpy into our repository,
under [[./thirdparty/ros_numpy]]. It is modified to be a standard Python
package that can be pip-installed. The installation is, still, handled
by ~source install_dependencies.bash~ so you do not need to do anything.
*** Build the ROS package
#+begin_src
catkin_make -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
Note that if you are using the [robotdev Spot environment](https://github.com/zkytony/robotdev/tree/master/spot),
you need to run the following command instead
#+begin_src
build_spot -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
*** Download Dataset and Models (Optional)
Install [[https://github.com/wkentaro/gdown][gdown]], then run download script:
#+begin_src
pip install gdown
python download.py
#+end_src
This will download both the ~SL\_OSM\_Dataset~ and the frame of reference
prediction models. The ~SL\_OSM\_Dataset~ will be saved under ~data~, while the
models will be saved under ~models~.
Also, you will need to download spacy models. We use ~en_core_web_lg~ (400MB). To download it:
#+begin_src
python -m spacy download en_core_web_lg
#+end_src
CHANGELOG
No CHANGELOG found.
Package Dependencies
System Dependencies
No direct system dependencies.
Dependant Packages
No known dependants.
Launch files
- launch/local_cloud_publisher.launch
-
- robot_pose_topic
- global_cloud_topic [default: /graphnav_map_publisher/graphnav_points]
- output [default: region_points]
- name [default: local_cloud_publisher]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.4]
- retain_ratio [default: 0.1]
- launch/movo/genmos_movo_action_executor.launch
- launch/movo/genmos_movo_exp1_scili8_living_room.launch
-
- local_search [default: false]
- launch/movo/genmos_movo_system.launch
-
- map_name
- world_frame [default: map]
- local_search [default: false]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.0]
- retain_ratio [default: 0.2]
- launch/movo/view_movo_object_search.launch
-
- rviz [default: true]
- rviz_file [default: $(find genmos_object_search_ros)/rviz/movo/movo_object_search.rviz]
- launch/occupancy_grid_to_cloud.launch
- launch/spot/deprecated/sloop_mos_spot.launch
-
- map_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/deprecated/sloop_mos_spot_automate_task.launch
-
- max_steps [default: 50]
- replan_freq [default: 1.0]
- launch/spot/deprecated/spot_octree_belief_publisher.launch
- launch/spot/experiments/genmos_spot_action_executor.launch
- launch/spot/experiments/genmos_spot_search.launch
- Launches - local point cloud publisher that takes in full point cloud and filters out points outside of a region (box). (this point cloud should be at /spot/local_region/input_points) - the task client - the process that talks to the GenMOS gRPC server and responsible for interfacing with the actual robot to receive observations & execute actions
-
- exp_name
- local_search [default: true]
- retain_ratio [default: 0.5]
- launch/spot/experiments/genmos_spot_system.launch
-
- map_name
- world_frame [default: graphnav_map]
- local_search [default: false]
- frontleft_depth [default: /spot/stream_image/frontleft_depth_in_visual_frame]
- frontright_depth [default: /spot/stream_image/frontright_depth_in_visual_frame]
- hand_depth [default: /spot/stream_image/hand_depth_in_hand_color_frame]
- launch/spot/experiments/legacy/genmos_spot_exp1_local_lab121.launch
-
- spot
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp2_kitchen_lab115.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp3_atrium_cit1f.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/view_spot_local_search.launch
- launch/spot/genmos_spot_landmark_recorder.launch
-
- max_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/genmos_spot_publish_grid_map.launch
-
- map_name
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/spot_local_cloud_publisher.launch
-
- robot_pose_topic [default: /spot_body_pose]
- tests/spot/grpc/simple_sim/simple_sim_env.launch
-
- map_name
- world_frame [default: graphnav_map]
- tests/spot/grpc/simple_sim/view_simple_sim.launch
- tests/spot/grpc/view_process_detection_test.launch
Services
No service files found
Plugins
No plugins found.
Recent questions tagged genmos_object_search_ros at Robotics Stack Exchange
No version for distro jazzy showing github. Known supported distros are highlighted in the buttons above.
![]() |
genmos_object_search_ros package from genmos_object_search repogenmos_object_search_ros genmos_object_search_ros2 |
ROS Distro
|
Package Summary
Tags | No category tags. |
Version | 0.2.0 |
License | MIT |
Build type | CATKIN |
Use | RECOMMENDED |
Repository Summary
Description | GenMOS - A System for Generalized (off-the-shelf) 3D Multi-Object Search | ICRA 2023 |
Checkout URI | https://github.com/zkytony/genmos_object_search.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2023-05-17 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | No category tags. |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
The genmos_object_search_ros package
Additional Links
No additional links.
Maintainers
- kaiyu
Authors
No additional authors.
* Example ROS package that uses genmos_object_search
Note that genmos_object_search is written in Python 3. For ROS, it is
best integrated with ROS Noetic.
** Setup
*** Create symbolic link
Go to the `src` folder of your ROS workspace. Then run:
#+begin_src
ln -s path/to/genmos_object_search/ros genmos_object_search_ros
#+end_src
This effectively adds a ROS package called "genmos_object_search_ros" into your workspace
*** Install Dependencies
This is a ROS package; Therefore, it is expected to operate within a ROS workspace.
Before building this package, make sure you have activated a virtualenv. Then, run
#+begin_src
source install_dependencies.bash
#+end_src
to install python dependencies.
*Note* that we use [[https://github.com/eric-wieser/ros_numpy][ros_numpy]] to convert point cloud ROS message to numpy array,
so that point cloud observation can be used to update the search region (see [[./src/genmos_ros/genmos_ros.py#117][code]]).
Typically, one installs ros_numpy by ~sudo apt-get install ros-noetic-ros-numpy~.
However, there are two issues (1) [[https://github.com/eric-wieser/ros_numpy/issues/37][this issue]] where numpy > 1.24 causes an AttributeError on `numpy.float`,
and that (2) the ros_numpy package was no longer maintained.
As a result, we folded the source code of ros_numpy into our repository,
under [[./thirdparty/ros_numpy]]. It is modified to be a standard Python
package that can be pip-installed. The installation is, still, handled
by ~source install_dependencies.bash~ so you do not need to do anything.
*** Build the ROS package
#+begin_src
catkin_make -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
Note that if you are using the [robotdev Spot environment](https://github.com/zkytony/robotdev/tree/master/spot),
you need to run the following command instead
#+begin_src
build_spot -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
*** Download Dataset and Models (Optional)
Install [[https://github.com/wkentaro/gdown][gdown]], then run download script:
#+begin_src
pip install gdown
python download.py
#+end_src
This will download both the ~SL\_OSM\_Dataset~ and the frame of reference
prediction models. The ~SL\_OSM\_Dataset~ will be saved under ~data~, while the
models will be saved under ~models~.
Also, you will need to download spacy models. We use ~en_core_web_lg~ (400MB). To download it:
#+begin_src
python -m spacy download en_core_web_lg
#+end_src
CHANGELOG
No CHANGELOG found.
Package Dependencies
System Dependencies
No direct system dependencies.
Dependant Packages
No known dependants.
Launch files
- launch/local_cloud_publisher.launch
-
- robot_pose_topic
- global_cloud_topic [default: /graphnav_map_publisher/graphnav_points]
- output [default: region_points]
- name [default: local_cloud_publisher]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.4]
- retain_ratio [default: 0.1]
- launch/movo/genmos_movo_action_executor.launch
- launch/movo/genmos_movo_exp1_scili8_living_room.launch
-
- local_search [default: false]
- launch/movo/genmos_movo_system.launch
-
- map_name
- world_frame [default: map]
- local_search [default: false]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.0]
- retain_ratio [default: 0.2]
- launch/movo/view_movo_object_search.launch
-
- rviz [default: true]
- rviz_file [default: $(find genmos_object_search_ros)/rviz/movo/movo_object_search.rviz]
- launch/occupancy_grid_to_cloud.launch
- launch/spot/deprecated/sloop_mos_spot.launch
-
- map_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/deprecated/sloop_mos_spot_automate_task.launch
-
- max_steps [default: 50]
- replan_freq [default: 1.0]
- launch/spot/deprecated/spot_octree_belief_publisher.launch
- launch/spot/experiments/genmos_spot_action_executor.launch
- launch/spot/experiments/genmos_spot_search.launch
- Launches - local point cloud publisher that takes in full point cloud and filters out points outside of a region (box). (this point cloud should be at /spot/local_region/input_points) - the task client - the process that talks to the GenMOS gRPC server and responsible for interfacing with the actual robot to receive observations & execute actions
-
- exp_name
- local_search [default: true]
- retain_ratio [default: 0.5]
- launch/spot/experiments/genmos_spot_system.launch
-
- map_name
- world_frame [default: graphnav_map]
- local_search [default: false]
- frontleft_depth [default: /spot/stream_image/frontleft_depth_in_visual_frame]
- frontright_depth [default: /spot/stream_image/frontright_depth_in_visual_frame]
- hand_depth [default: /spot/stream_image/hand_depth_in_hand_color_frame]
- launch/spot/experiments/legacy/genmos_spot_exp1_local_lab121.launch
-
- spot
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp2_kitchen_lab115.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp3_atrium_cit1f.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/view_spot_local_search.launch
- launch/spot/genmos_spot_landmark_recorder.launch
-
- max_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/genmos_spot_publish_grid_map.launch
-
- map_name
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/spot_local_cloud_publisher.launch
-
- robot_pose_topic [default: /spot_body_pose]
- tests/spot/grpc/simple_sim/simple_sim_env.launch
-
- map_name
- world_frame [default: graphnav_map]
- tests/spot/grpc/simple_sim/view_simple_sim.launch
- tests/spot/grpc/view_process_detection_test.launch
Services
No service files found
Plugins
No plugins found.
Recent questions tagged genmos_object_search_ros at Robotics Stack Exchange
No version for distro kilted showing github. Known supported distros are highlighted in the buttons above.
![]() |
genmos_object_search_ros package from genmos_object_search repogenmos_object_search_ros genmos_object_search_ros2 |
ROS Distro
|
Package Summary
Tags | No category tags. |
Version | 0.2.0 |
License | MIT |
Build type | CATKIN |
Use | RECOMMENDED |
Repository Summary
Description | GenMOS - A System for Generalized (off-the-shelf) 3D Multi-Object Search | ICRA 2023 |
Checkout URI | https://github.com/zkytony/genmos_object_search.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2023-05-17 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | No category tags. |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
The genmos_object_search_ros package
Additional Links
No additional links.
Maintainers
- kaiyu
Authors
No additional authors.
* Example ROS package that uses genmos_object_search
Note that genmos_object_search is written in Python 3. For ROS, it is
best integrated with ROS Noetic.
** Setup
*** Create symbolic link
Go to the `src` folder of your ROS workspace. Then run:
#+begin_src
ln -s path/to/genmos_object_search/ros genmos_object_search_ros
#+end_src
This effectively adds a ROS package called "genmos_object_search_ros" into your workspace
*** Install Dependencies
This is a ROS package; Therefore, it is expected to operate within a ROS workspace.
Before building this package, make sure you have activated a virtualenv. Then, run
#+begin_src
source install_dependencies.bash
#+end_src
to install python dependencies.
*Note* that we use [[https://github.com/eric-wieser/ros_numpy][ros_numpy]] to convert point cloud ROS message to numpy array,
so that point cloud observation can be used to update the search region (see [[./src/genmos_ros/genmos_ros.py#117][code]]).
Typically, one installs ros_numpy by ~sudo apt-get install ros-noetic-ros-numpy~.
However, there are two issues (1) [[https://github.com/eric-wieser/ros_numpy/issues/37][this issue]] where numpy > 1.24 causes an AttributeError on `numpy.float`,
and that (2) the ros_numpy package was no longer maintained.
As a result, we folded the source code of ros_numpy into our repository,
under [[./thirdparty/ros_numpy]]. It is modified to be a standard Python
package that can be pip-installed. The installation is, still, handled
by ~source install_dependencies.bash~ so you do not need to do anything.
*** Build the ROS package
#+begin_src
catkin_make -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
Note that if you are using the [robotdev Spot environment](https://github.com/zkytony/robotdev/tree/master/spot),
you need to run the following command instead
#+begin_src
build_spot -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
*** Download Dataset and Models (Optional)
Install [[https://github.com/wkentaro/gdown][gdown]], then run download script:
#+begin_src
pip install gdown
python download.py
#+end_src
This will download both the ~SL\_OSM\_Dataset~ and the frame of reference
prediction models. The ~SL\_OSM\_Dataset~ will be saved under ~data~, while the
models will be saved under ~models~.
Also, you will need to download spacy models. We use ~en_core_web_lg~ (400MB). To download it:
#+begin_src
python -m spacy download en_core_web_lg
#+end_src
CHANGELOG
No CHANGELOG found.
Package Dependencies
System Dependencies
No direct system dependencies.
Dependant Packages
No known dependants.
Launch files
- launch/local_cloud_publisher.launch
-
- robot_pose_topic
- global_cloud_topic [default: /graphnav_map_publisher/graphnav_points]
- output [default: region_points]
- name [default: local_cloud_publisher]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.4]
- retain_ratio [default: 0.1]
- launch/movo/genmos_movo_action_executor.launch
- launch/movo/genmos_movo_exp1_scili8_living_room.launch
-
- local_search [default: false]
- launch/movo/genmos_movo_system.launch
-
- map_name
- world_frame [default: map]
- local_search [default: false]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.0]
- retain_ratio [default: 0.2]
- launch/movo/view_movo_object_search.launch
-
- rviz [default: true]
- rviz_file [default: $(find genmos_object_search_ros)/rviz/movo/movo_object_search.rviz]
- launch/occupancy_grid_to_cloud.launch
- launch/spot/deprecated/sloop_mos_spot.launch
-
- map_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/deprecated/sloop_mos_spot_automate_task.launch
-
- max_steps [default: 50]
- replan_freq [default: 1.0]
- launch/spot/deprecated/spot_octree_belief_publisher.launch
- launch/spot/experiments/genmos_spot_action_executor.launch
- launch/spot/experiments/genmos_spot_search.launch
- Launches - local point cloud publisher that takes in full point cloud and filters out points outside of a region (box). (this point cloud should be at /spot/local_region/input_points) - the task client - the process that talks to the GenMOS gRPC server and responsible for interfacing with the actual robot to receive observations & execute actions
-
- exp_name
- local_search [default: true]
- retain_ratio [default: 0.5]
- launch/spot/experiments/genmos_spot_system.launch
-
- map_name
- world_frame [default: graphnav_map]
- local_search [default: false]
- frontleft_depth [default: /spot/stream_image/frontleft_depth_in_visual_frame]
- frontright_depth [default: /spot/stream_image/frontright_depth_in_visual_frame]
- hand_depth [default: /spot/stream_image/hand_depth_in_hand_color_frame]
- launch/spot/experiments/legacy/genmos_spot_exp1_local_lab121.launch
-
- spot
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp2_kitchen_lab115.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp3_atrium_cit1f.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/view_spot_local_search.launch
- launch/spot/genmos_spot_landmark_recorder.launch
-
- max_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/genmos_spot_publish_grid_map.launch
-
- map_name
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/spot_local_cloud_publisher.launch
-
- robot_pose_topic [default: /spot_body_pose]
- tests/spot/grpc/simple_sim/simple_sim_env.launch
-
- map_name
- world_frame [default: graphnav_map]
- tests/spot/grpc/simple_sim/view_simple_sim.launch
- tests/spot/grpc/view_process_detection_test.launch
Services
No service files found
Plugins
No plugins found.
Recent questions tagged genmos_object_search_ros at Robotics Stack Exchange
No version for distro rolling showing github. Known supported distros are highlighted in the buttons above.
![]() |
genmos_object_search_ros package from genmos_object_search repogenmos_object_search_ros genmos_object_search_ros2 |
ROS Distro
|
Package Summary
Tags | No category tags. |
Version | 0.2.0 |
License | MIT |
Build type | CATKIN |
Use | RECOMMENDED |
Repository Summary
Description | GenMOS - A System for Generalized (off-the-shelf) 3D Multi-Object Search | ICRA 2023 |
Checkout URI | https://github.com/zkytony/genmos_object_search.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2023-05-17 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | No category tags. |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
The genmos_object_search_ros package
Additional Links
No additional links.
Maintainers
- kaiyu
Authors
No additional authors.
* Example ROS package that uses genmos_object_search
Note that genmos_object_search is written in Python 3. For ROS, it is
best integrated with ROS Noetic.
** Setup
*** Create symbolic link
Go to the `src` folder of your ROS workspace. Then run:
#+begin_src
ln -s path/to/genmos_object_search/ros genmos_object_search_ros
#+end_src
This effectively adds a ROS package called "genmos_object_search_ros" into your workspace
*** Install Dependencies
This is a ROS package; Therefore, it is expected to operate within a ROS workspace.
Before building this package, make sure you have activated a virtualenv. Then, run
#+begin_src
source install_dependencies.bash
#+end_src
to install python dependencies.
*Note* that we use [[https://github.com/eric-wieser/ros_numpy][ros_numpy]] to convert point cloud ROS message to numpy array,
so that point cloud observation can be used to update the search region (see [[./src/genmos_ros/genmos_ros.py#117][code]]).
Typically, one installs ros_numpy by ~sudo apt-get install ros-noetic-ros-numpy~.
However, there are two issues (1) [[https://github.com/eric-wieser/ros_numpy/issues/37][this issue]] where numpy > 1.24 causes an AttributeError on `numpy.float`,
and that (2) the ros_numpy package was no longer maintained.
As a result, we folded the source code of ros_numpy into our repository,
under [[./thirdparty/ros_numpy]]. It is modified to be a standard Python
package that can be pip-installed. The installation is, still, handled
by ~source install_dependencies.bash~ so you do not need to do anything.
*** Build the ROS package
#+begin_src
catkin_make -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
Note that if you are using the [robotdev Spot environment](https://github.com/zkytony/robotdev/tree/master/spot),
you need to run the following command instead
#+begin_src
build_spot -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
*** Download Dataset and Models (Optional)
Install [[https://github.com/wkentaro/gdown][gdown]], then run download script:
#+begin_src
pip install gdown
python download.py
#+end_src
This will download both the ~SL\_OSM\_Dataset~ and the frame of reference
prediction models. The ~SL\_OSM\_Dataset~ will be saved under ~data~, while the
models will be saved under ~models~.
Also, you will need to download spacy models. We use ~en_core_web_lg~ (400MB). To download it:
#+begin_src
python -m spacy download en_core_web_lg
#+end_src
CHANGELOG
No CHANGELOG found.
Package Dependencies
System Dependencies
No direct system dependencies.
Dependant Packages
No known dependants.
Launch files
- launch/local_cloud_publisher.launch
-
- robot_pose_topic
- global_cloud_topic [default: /graphnav_map_publisher/graphnav_points]
- output [default: region_points]
- name [default: local_cloud_publisher]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.4]
- retain_ratio [default: 0.1]
- launch/movo/genmos_movo_action_executor.launch
- launch/movo/genmos_movo_exp1_scili8_living_room.launch
-
- local_search [default: false]
- launch/movo/genmos_movo_system.launch
-
- map_name
- world_frame [default: map]
- local_search [default: false]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.0]
- retain_ratio [default: 0.2]
- launch/movo/view_movo_object_search.launch
-
- rviz [default: true]
- rviz_file [default: $(find genmos_object_search_ros)/rviz/movo/movo_object_search.rviz]
- launch/occupancy_grid_to_cloud.launch
- launch/spot/deprecated/sloop_mos_spot.launch
-
- map_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/deprecated/sloop_mos_spot_automate_task.launch
-
- max_steps [default: 50]
- replan_freq [default: 1.0]
- launch/spot/deprecated/spot_octree_belief_publisher.launch
- launch/spot/experiments/genmos_spot_action_executor.launch
- launch/spot/experiments/genmos_spot_search.launch
- Launches - local point cloud publisher that takes in full point cloud and filters out points outside of a region (box). (this point cloud should be at /spot/local_region/input_points) - the task client - the process that talks to the GenMOS gRPC server and responsible for interfacing with the actual robot to receive observations & execute actions
-
- exp_name
- local_search [default: true]
- retain_ratio [default: 0.5]
- launch/spot/experiments/genmos_spot_system.launch
-
- map_name
- world_frame [default: graphnav_map]
- local_search [default: false]
- frontleft_depth [default: /spot/stream_image/frontleft_depth_in_visual_frame]
- frontright_depth [default: /spot/stream_image/frontright_depth_in_visual_frame]
- hand_depth [default: /spot/stream_image/hand_depth_in_hand_color_frame]
- launch/spot/experiments/legacy/genmos_spot_exp1_local_lab121.launch
-
- spot
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp2_kitchen_lab115.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp3_atrium_cit1f.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/view_spot_local_search.launch
- launch/spot/genmos_spot_landmark_recorder.launch
-
- max_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/genmos_spot_publish_grid_map.launch
-
- map_name
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/spot_local_cloud_publisher.launch
-
- robot_pose_topic [default: /spot_body_pose]
- tests/spot/grpc/simple_sim/simple_sim_env.launch
-
- map_name
- world_frame [default: graphnav_map]
- tests/spot/grpc/simple_sim/view_simple_sim.launch
- tests/spot/grpc/view_process_detection_test.launch
Services
No service files found
Plugins
No plugins found.
Recent questions tagged genmos_object_search_ros at Robotics Stack Exchange
![]() |
genmos_object_search_ros package from genmos_object_search repogenmos_object_search_ros genmos_object_search_ros2 |
ROS Distro
|
Package Summary
Tags | No category tags. |
Version | 0.2.0 |
License | MIT |
Build type | CATKIN |
Use | RECOMMENDED |
Repository Summary
Description | GenMOS - A System for Generalized (off-the-shelf) 3D Multi-Object Search | ICRA 2023 |
Checkout URI | https://github.com/zkytony/genmos_object_search.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2023-05-17 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | No category tags. |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
The genmos_object_search_ros package
Additional Links
No additional links.
Maintainers
- kaiyu
Authors
No additional authors.
* Example ROS package that uses genmos_object_search
Note that genmos_object_search is written in Python 3. For ROS, it is
best integrated with ROS Noetic.
** Setup
*** Create symbolic link
Go to the `src` folder of your ROS workspace. Then run:
#+begin_src
ln -s path/to/genmos_object_search/ros genmos_object_search_ros
#+end_src
This effectively adds a ROS package called "genmos_object_search_ros" into your workspace
*** Install Dependencies
This is a ROS package; Therefore, it is expected to operate within a ROS workspace.
Before building this package, make sure you have activated a virtualenv. Then, run
#+begin_src
source install_dependencies.bash
#+end_src
to install python dependencies.
*Note* that we use [[https://github.com/eric-wieser/ros_numpy][ros_numpy]] to convert point cloud ROS message to numpy array,
so that point cloud observation can be used to update the search region (see [[./src/genmos_ros/genmos_ros.py#117][code]]).
Typically, one installs ros_numpy by ~sudo apt-get install ros-noetic-ros-numpy~.
However, there are two issues (1) [[https://github.com/eric-wieser/ros_numpy/issues/37][this issue]] where numpy > 1.24 causes an AttributeError on `numpy.float`,
and that (2) the ros_numpy package was no longer maintained.
As a result, we folded the source code of ros_numpy into our repository,
under [[./thirdparty/ros_numpy]]. It is modified to be a standard Python
package that can be pip-installed. The installation is, still, handled
by ~source install_dependencies.bash~ so you do not need to do anything.
*** Build the ROS package
#+begin_src
catkin_make -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
Note that if you are using the [robotdev Spot environment](https://github.com/zkytony/robotdev/tree/master/spot),
you need to run the following command instead
#+begin_src
build_spot -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
*** Download Dataset and Models (Optional)
Install [[https://github.com/wkentaro/gdown][gdown]], then run download script:
#+begin_src
pip install gdown
python download.py
#+end_src
This will download both the ~SL\_OSM\_Dataset~ and the frame of reference
prediction models. The ~SL\_OSM\_Dataset~ will be saved under ~data~, while the
models will be saved under ~models~.
Also, you will need to download spacy models. We use ~en_core_web_lg~ (400MB). To download it:
#+begin_src
python -m spacy download en_core_web_lg
#+end_src
CHANGELOG
No CHANGELOG found.
Package Dependencies
System Dependencies
No direct system dependencies.
Dependant Packages
No known dependants.
Launch files
- launch/local_cloud_publisher.launch
-
- robot_pose_topic
- global_cloud_topic [default: /graphnav_map_publisher/graphnav_points]
- output [default: region_points]
- name [default: local_cloud_publisher]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.4]
- retain_ratio [default: 0.1]
- launch/movo/genmos_movo_action_executor.launch
- launch/movo/genmos_movo_exp1_scili8_living_room.launch
-
- local_search [default: false]
- launch/movo/genmos_movo_system.launch
-
- map_name
- world_frame [default: map]
- local_search [default: false]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.0]
- retain_ratio [default: 0.2]
- launch/movo/view_movo_object_search.launch
-
- rviz [default: true]
- rviz_file [default: $(find genmos_object_search_ros)/rviz/movo/movo_object_search.rviz]
- launch/occupancy_grid_to_cloud.launch
- launch/spot/deprecated/sloop_mos_spot.launch
-
- map_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/deprecated/sloop_mos_spot_automate_task.launch
-
- max_steps [default: 50]
- replan_freq [default: 1.0]
- launch/spot/deprecated/spot_octree_belief_publisher.launch
- launch/spot/experiments/genmos_spot_action_executor.launch
- launch/spot/experiments/genmos_spot_search.launch
- Launches - local point cloud publisher that takes in full point cloud and filters out points outside of a region (box). (this point cloud should be at /spot/local_region/input_points) - the task client - the process that talks to the GenMOS gRPC server and responsible for interfacing with the actual robot to receive observations & execute actions
-
- exp_name
- local_search [default: true]
- retain_ratio [default: 0.5]
- launch/spot/experiments/genmos_spot_system.launch
-
- map_name
- world_frame [default: graphnav_map]
- local_search [default: false]
- frontleft_depth [default: /spot/stream_image/frontleft_depth_in_visual_frame]
- frontright_depth [default: /spot/stream_image/frontright_depth_in_visual_frame]
- hand_depth [default: /spot/stream_image/hand_depth_in_hand_color_frame]
- launch/spot/experiments/legacy/genmos_spot_exp1_local_lab121.launch
-
- spot
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp2_kitchen_lab115.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp3_atrium_cit1f.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/view_spot_local_search.launch
- launch/spot/genmos_spot_landmark_recorder.launch
-
- max_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/genmos_spot_publish_grid_map.launch
-
- map_name
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/spot_local_cloud_publisher.launch
-
- robot_pose_topic [default: /spot_body_pose]
- tests/spot/grpc/simple_sim/simple_sim_env.launch
-
- map_name
- world_frame [default: graphnav_map]
- tests/spot/grpc/simple_sim/view_simple_sim.launch
- tests/spot/grpc/view_process_detection_test.launch
Services
No service files found
Plugins
No plugins found.
Recent questions tagged genmos_object_search_ros at Robotics Stack Exchange
No version for distro galactic showing github. Known supported distros are highlighted in the buttons above.
![]() |
genmos_object_search_ros package from genmos_object_search repogenmos_object_search_ros genmos_object_search_ros2 |
ROS Distro
|
Package Summary
Tags | No category tags. |
Version | 0.2.0 |
License | MIT |
Build type | CATKIN |
Use | RECOMMENDED |
Repository Summary
Description | GenMOS - A System for Generalized (off-the-shelf) 3D Multi-Object Search | ICRA 2023 |
Checkout URI | https://github.com/zkytony/genmos_object_search.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2023-05-17 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | No category tags. |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
The genmos_object_search_ros package
Additional Links
No additional links.
Maintainers
- kaiyu
Authors
No additional authors.
* Example ROS package that uses genmos_object_search
Note that genmos_object_search is written in Python 3. For ROS, it is
best integrated with ROS Noetic.
** Setup
*** Create symbolic link
Go to the `src` folder of your ROS workspace. Then run:
#+begin_src
ln -s path/to/genmos_object_search/ros genmos_object_search_ros
#+end_src
This effectively adds a ROS package called "genmos_object_search_ros" into your workspace
*** Install Dependencies
This is a ROS package; Therefore, it is expected to operate within a ROS workspace.
Before building this package, make sure you have activated a virtualenv. Then, run
#+begin_src
source install_dependencies.bash
#+end_src
to install python dependencies.
*Note* that we use [[https://github.com/eric-wieser/ros_numpy][ros_numpy]] to convert point cloud ROS message to numpy array,
so that point cloud observation can be used to update the search region (see [[./src/genmos_ros/genmos_ros.py#117][code]]).
Typically, one installs ros_numpy by ~sudo apt-get install ros-noetic-ros-numpy~.
However, there are two issues (1) [[https://github.com/eric-wieser/ros_numpy/issues/37][this issue]] where numpy > 1.24 causes an AttributeError on `numpy.float`,
and that (2) the ros_numpy package was no longer maintained.
As a result, we folded the source code of ros_numpy into our repository,
under [[./thirdparty/ros_numpy]]. It is modified to be a standard Python
package that can be pip-installed. The installation is, still, handled
by ~source install_dependencies.bash~ so you do not need to do anything.
*** Build the ROS package
#+begin_src
catkin_make -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
Note that if you are using the [robotdev Spot environment](https://github.com/zkytony/robotdev/tree/master/spot),
you need to run the following command instead
#+begin_src
build_spot -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
*** Download Dataset and Models (Optional)
Install [[https://github.com/wkentaro/gdown][gdown]], then run download script:
#+begin_src
pip install gdown
python download.py
#+end_src
This will download both the ~SL\_OSM\_Dataset~ and the frame of reference
prediction models. The ~SL\_OSM\_Dataset~ will be saved under ~data~, while the
models will be saved under ~models~.
Also, you will need to download spacy models. We use ~en_core_web_lg~ (400MB). To download it:
#+begin_src
python -m spacy download en_core_web_lg
#+end_src
CHANGELOG
No CHANGELOG found.
Package Dependencies
System Dependencies
No direct system dependencies.
Dependant Packages
No known dependants.
Launch files
- launch/local_cloud_publisher.launch
-
- robot_pose_topic
- global_cloud_topic [default: /graphnav_map_publisher/graphnav_points]
- output [default: region_points]
- name [default: local_cloud_publisher]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.4]
- retain_ratio [default: 0.1]
- launch/movo/genmos_movo_action_executor.launch
- launch/movo/genmos_movo_exp1_scili8_living_room.launch
-
- local_search [default: false]
- launch/movo/genmos_movo_system.launch
-
- map_name
- world_frame [default: map]
- local_search [default: false]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.0]
- retain_ratio [default: 0.2]
- launch/movo/view_movo_object_search.launch
-
- rviz [default: true]
- rviz_file [default: $(find genmos_object_search_ros)/rviz/movo/movo_object_search.rviz]
- launch/occupancy_grid_to_cloud.launch
- launch/spot/deprecated/sloop_mos_spot.launch
-
- map_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/deprecated/sloop_mos_spot_automate_task.launch
-
- max_steps [default: 50]
- replan_freq [default: 1.0]
- launch/spot/deprecated/spot_octree_belief_publisher.launch
- launch/spot/experiments/genmos_spot_action_executor.launch
- launch/spot/experiments/genmos_spot_search.launch
- Launches - local point cloud publisher that takes in full point cloud and filters out points outside of a region (box). (this point cloud should be at /spot/local_region/input_points) - the task client - the process that talks to the GenMOS gRPC server and responsible for interfacing with the actual robot to receive observations & execute actions
-
- exp_name
- local_search [default: true]
- retain_ratio [default: 0.5]
- launch/spot/experiments/genmos_spot_system.launch
-
- map_name
- world_frame [default: graphnav_map]
- local_search [default: false]
- frontleft_depth [default: /spot/stream_image/frontleft_depth_in_visual_frame]
- frontright_depth [default: /spot/stream_image/frontright_depth_in_visual_frame]
- hand_depth [default: /spot/stream_image/hand_depth_in_hand_color_frame]
- launch/spot/experiments/legacy/genmos_spot_exp1_local_lab121.launch
-
- spot
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp2_kitchen_lab115.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp3_atrium_cit1f.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/view_spot_local_search.launch
- launch/spot/genmos_spot_landmark_recorder.launch
-
- max_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/genmos_spot_publish_grid_map.launch
-
- map_name
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/spot_local_cloud_publisher.launch
-
- robot_pose_topic [default: /spot_body_pose]
- tests/spot/grpc/simple_sim/simple_sim_env.launch
-
- map_name
- world_frame [default: graphnav_map]
- tests/spot/grpc/simple_sim/view_simple_sim.launch
- tests/spot/grpc/view_process_detection_test.launch
Services
No service files found
Plugins
No plugins found.
Recent questions tagged genmos_object_search_ros at Robotics Stack Exchange
No version for distro iron showing github. Known supported distros are highlighted in the buttons above.
![]() |
genmos_object_search_ros package from genmos_object_search repogenmos_object_search_ros genmos_object_search_ros2 |
ROS Distro
|
Package Summary
Tags | No category tags. |
Version | 0.2.0 |
License | MIT |
Build type | CATKIN |
Use | RECOMMENDED |
Repository Summary
Description | GenMOS - A System for Generalized (off-the-shelf) 3D Multi-Object Search | ICRA 2023 |
Checkout URI | https://github.com/zkytony/genmos_object_search.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2023-05-17 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | No category tags. |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
The genmos_object_search_ros package
Additional Links
No additional links.
Maintainers
- kaiyu
Authors
No additional authors.
* Example ROS package that uses genmos_object_search
Note that genmos_object_search is written in Python 3. For ROS, it is
best integrated with ROS Noetic.
** Setup
*** Create symbolic link
Go to the `src` folder of your ROS workspace. Then run:
#+begin_src
ln -s path/to/genmos_object_search/ros genmos_object_search_ros
#+end_src
This effectively adds a ROS package called "genmos_object_search_ros" into your workspace
*** Install Dependencies
This is a ROS package; Therefore, it is expected to operate within a ROS workspace.
Before building this package, make sure you have activated a virtualenv. Then, run
#+begin_src
source install_dependencies.bash
#+end_src
to install python dependencies.
*Note* that we use [[https://github.com/eric-wieser/ros_numpy][ros_numpy]] to convert point cloud ROS message to numpy array,
so that point cloud observation can be used to update the search region (see [[./src/genmos_ros/genmos_ros.py#117][code]]).
Typically, one installs ros_numpy by ~sudo apt-get install ros-noetic-ros-numpy~.
However, there are two issues (1) [[https://github.com/eric-wieser/ros_numpy/issues/37][this issue]] where numpy > 1.24 causes an AttributeError on `numpy.float`,
and that (2) the ros_numpy package was no longer maintained.
As a result, we folded the source code of ros_numpy into our repository,
under [[./thirdparty/ros_numpy]]. It is modified to be a standard Python
package that can be pip-installed. The installation is, still, handled
by ~source install_dependencies.bash~ so you do not need to do anything.
*** Build the ROS package
#+begin_src
catkin_make -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
Note that if you are using the [robotdev Spot environment](https://github.com/zkytony/robotdev/tree/master/spot),
you need to run the following command instead
#+begin_src
build_spot -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
*** Download Dataset and Models (Optional)
Install [[https://github.com/wkentaro/gdown][gdown]], then run download script:
#+begin_src
pip install gdown
python download.py
#+end_src
This will download both the ~SL\_OSM\_Dataset~ and the frame of reference
prediction models. The ~SL\_OSM\_Dataset~ will be saved under ~data~, while the
models will be saved under ~models~.
Also, you will need to download spacy models. We use ~en_core_web_lg~ (400MB). To download it:
#+begin_src
python -m spacy download en_core_web_lg
#+end_src
CHANGELOG
No CHANGELOG found.
Package Dependencies
System Dependencies
No direct system dependencies.
Dependant Packages
No known dependants.
Launch files
- launch/local_cloud_publisher.launch
-
- robot_pose_topic
- global_cloud_topic [default: /graphnav_map_publisher/graphnav_points]
- output [default: region_points]
- name [default: local_cloud_publisher]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.4]
- retain_ratio [default: 0.1]
- launch/movo/genmos_movo_action_executor.launch
- launch/movo/genmos_movo_exp1_scili8_living_room.launch
-
- local_search [default: false]
- launch/movo/genmos_movo_system.launch
-
- map_name
- world_frame [default: map]
- local_search [default: false]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.0]
- retain_ratio [default: 0.2]
- launch/movo/view_movo_object_search.launch
-
- rviz [default: true]
- rviz_file [default: $(find genmos_object_search_ros)/rviz/movo/movo_object_search.rviz]
- launch/occupancy_grid_to_cloud.launch
- launch/spot/deprecated/sloop_mos_spot.launch
-
- map_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/deprecated/sloop_mos_spot_automate_task.launch
-
- max_steps [default: 50]
- replan_freq [default: 1.0]
- launch/spot/deprecated/spot_octree_belief_publisher.launch
- launch/spot/experiments/genmos_spot_action_executor.launch
- launch/spot/experiments/genmos_spot_search.launch
- Launches - local point cloud publisher that takes in full point cloud and filters out points outside of a region (box). (this point cloud should be at /spot/local_region/input_points) - the task client - the process that talks to the GenMOS gRPC server and responsible for interfacing with the actual robot to receive observations & execute actions
-
- exp_name
- local_search [default: true]
- retain_ratio [default: 0.5]
- launch/spot/experiments/genmos_spot_system.launch
-
- map_name
- world_frame [default: graphnav_map]
- local_search [default: false]
- frontleft_depth [default: /spot/stream_image/frontleft_depth_in_visual_frame]
- frontright_depth [default: /spot/stream_image/frontright_depth_in_visual_frame]
- hand_depth [default: /spot/stream_image/hand_depth_in_hand_color_frame]
- launch/spot/experiments/legacy/genmos_spot_exp1_local_lab121.launch
-
- spot
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp2_kitchen_lab115.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp3_atrium_cit1f.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/view_spot_local_search.launch
- launch/spot/genmos_spot_landmark_recorder.launch
-
- max_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/genmos_spot_publish_grid_map.launch
-
- map_name
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/spot_local_cloud_publisher.launch
-
- robot_pose_topic [default: /spot_body_pose]
- tests/spot/grpc/simple_sim/simple_sim_env.launch
-
- map_name
- world_frame [default: graphnav_map]
- tests/spot/grpc/simple_sim/view_simple_sim.launch
- tests/spot/grpc/view_process_detection_test.launch
Services
No service files found
Plugins
No plugins found.
Recent questions tagged genmos_object_search_ros at Robotics Stack Exchange
No version for distro melodic showing github. Known supported distros are highlighted in the buttons above.
![]() |
genmos_object_search_ros package from genmos_object_search repogenmos_object_search_ros genmos_object_search_ros2 |
ROS Distro
|
Package Summary
Tags | No category tags. |
Version | 0.2.0 |
License | MIT |
Build type | CATKIN |
Use | RECOMMENDED |
Repository Summary
Description | GenMOS - A System for Generalized (off-the-shelf) 3D Multi-Object Search | ICRA 2023 |
Checkout URI | https://github.com/zkytony/genmos_object_search.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2023-05-17 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | No category tags. |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
The genmos_object_search_ros package
Additional Links
No additional links.
Maintainers
- kaiyu
Authors
No additional authors.
* Example ROS package that uses genmos_object_search
Note that genmos_object_search is written in Python 3. For ROS, it is
best integrated with ROS Noetic.
** Setup
*** Create symbolic link
Go to the `src` folder of your ROS workspace. Then run:
#+begin_src
ln -s path/to/genmos_object_search/ros genmos_object_search_ros
#+end_src
This effectively adds a ROS package called "genmos_object_search_ros" into your workspace
*** Install Dependencies
This is a ROS package; Therefore, it is expected to operate within a ROS workspace.
Before building this package, make sure you have activated a virtualenv. Then, run
#+begin_src
source install_dependencies.bash
#+end_src
to install python dependencies.
*Note* that we use [[https://github.com/eric-wieser/ros_numpy][ros_numpy]] to convert point cloud ROS message to numpy array,
so that point cloud observation can be used to update the search region (see [[./src/genmos_ros/genmos_ros.py#117][code]]).
Typically, one installs ros_numpy by ~sudo apt-get install ros-noetic-ros-numpy~.
However, there are two issues (1) [[https://github.com/eric-wieser/ros_numpy/issues/37][this issue]] where numpy > 1.24 causes an AttributeError on `numpy.float`,
and that (2) the ros_numpy package was no longer maintained.
As a result, we folded the source code of ros_numpy into our repository,
under [[./thirdparty/ros_numpy]]. It is modified to be a standard Python
package that can be pip-installed. The installation is, still, handled
by ~source install_dependencies.bash~ so you do not need to do anything.
*** Build the ROS package
#+begin_src
catkin_make -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
Note that if you are using the [robotdev Spot environment](https://github.com/zkytony/robotdev/tree/master/spot),
you need to run the following command instead
#+begin_src
build_spot -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
*** Download Dataset and Models (Optional)
Install [[https://github.com/wkentaro/gdown][gdown]], then run download script:
#+begin_src
pip install gdown
python download.py
#+end_src
This will download both the ~SL\_OSM\_Dataset~ and the frame of reference
prediction models. The ~SL\_OSM\_Dataset~ will be saved under ~data~, while the
models will be saved under ~models~.
Also, you will need to download spacy models. We use ~en_core_web_lg~ (400MB). To download it:
#+begin_src
python -m spacy download en_core_web_lg
#+end_src
CHANGELOG
No CHANGELOG found.
Package Dependencies
System Dependencies
No direct system dependencies.
Dependant Packages
No known dependants.
Launch files
- launch/local_cloud_publisher.launch
-
- robot_pose_topic
- global_cloud_topic [default: /graphnav_map_publisher/graphnav_points]
- output [default: region_points]
- name [default: local_cloud_publisher]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.4]
- retain_ratio [default: 0.1]
- launch/movo/genmos_movo_action_executor.launch
- launch/movo/genmos_movo_exp1_scili8_living_room.launch
-
- local_search [default: false]
- launch/movo/genmos_movo_system.launch
-
- map_name
- world_frame [default: map]
- local_search [default: false]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.0]
- retain_ratio [default: 0.2]
- launch/movo/view_movo_object_search.launch
-
- rviz [default: true]
- rviz_file [default: $(find genmos_object_search_ros)/rviz/movo/movo_object_search.rviz]
- launch/occupancy_grid_to_cloud.launch
- launch/spot/deprecated/sloop_mos_spot.launch
-
- map_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/deprecated/sloop_mos_spot_automate_task.launch
-
- max_steps [default: 50]
- replan_freq [default: 1.0]
- launch/spot/deprecated/spot_octree_belief_publisher.launch
- launch/spot/experiments/genmos_spot_action_executor.launch
- launch/spot/experiments/genmos_spot_search.launch
- Launches - local point cloud publisher that takes in full point cloud and filters out points outside of a region (box). (this point cloud should be at /spot/local_region/input_points) - the task client - the process that talks to the GenMOS gRPC server and responsible for interfacing with the actual robot to receive observations & execute actions
-
- exp_name
- local_search [default: true]
- retain_ratio [default: 0.5]
- launch/spot/experiments/genmos_spot_system.launch
-
- map_name
- world_frame [default: graphnav_map]
- local_search [default: false]
- frontleft_depth [default: /spot/stream_image/frontleft_depth_in_visual_frame]
- frontright_depth [default: /spot/stream_image/frontright_depth_in_visual_frame]
- hand_depth [default: /spot/stream_image/hand_depth_in_hand_color_frame]
- launch/spot/experiments/legacy/genmos_spot_exp1_local_lab121.launch
-
- spot
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp2_kitchen_lab115.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp3_atrium_cit1f.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/view_spot_local_search.launch
- launch/spot/genmos_spot_landmark_recorder.launch
-
- max_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/genmos_spot_publish_grid_map.launch
-
- map_name
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/spot_local_cloud_publisher.launch
-
- robot_pose_topic [default: /spot_body_pose]
- tests/spot/grpc/simple_sim/simple_sim_env.launch
-
- map_name
- world_frame [default: graphnav_map]
- tests/spot/grpc/simple_sim/view_simple_sim.launch
- tests/spot/grpc/view_process_detection_test.launch
Services
No service files found
Plugins
No plugins found.
Recent questions tagged genmos_object_search_ros at Robotics Stack Exchange
No version for distro noetic showing github. Known supported distros are highlighted in the buttons above.
![]() |
genmos_object_search_ros package from genmos_object_search repogenmos_object_search_ros genmos_object_search_ros2 |
ROS Distro
|
Package Summary
Tags | No category tags. |
Version | 0.2.0 |
License | MIT |
Build type | CATKIN |
Use | RECOMMENDED |
Repository Summary
Description | GenMOS - A System for Generalized (off-the-shelf) 3D Multi-Object Search | ICRA 2023 |
Checkout URI | https://github.com/zkytony/genmos_object_search.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2023-05-17 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | No category tags. |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
The genmos_object_search_ros package
Additional Links
No additional links.
Maintainers
- kaiyu
Authors
No additional authors.
* Example ROS package that uses genmos_object_search
Note that genmos_object_search is written in Python 3. For ROS, it is
best integrated with ROS Noetic.
** Setup
*** Create symbolic link
Go to the `src` folder of your ROS workspace. Then run:
#+begin_src
ln -s path/to/genmos_object_search/ros genmos_object_search_ros
#+end_src
This effectively adds a ROS package called "genmos_object_search_ros" into your workspace
*** Install Dependencies
This is a ROS package; Therefore, it is expected to operate within a ROS workspace.
Before building this package, make sure you have activated a virtualenv. Then, run
#+begin_src
source install_dependencies.bash
#+end_src
to install python dependencies.
*Note* that we use [[https://github.com/eric-wieser/ros_numpy][ros_numpy]] to convert point cloud ROS message to numpy array,
so that point cloud observation can be used to update the search region (see [[./src/genmos_ros/genmos_ros.py#117][code]]).
Typically, one installs ros_numpy by ~sudo apt-get install ros-noetic-ros-numpy~.
However, there are two issues (1) [[https://github.com/eric-wieser/ros_numpy/issues/37][this issue]] where numpy > 1.24 causes an AttributeError on `numpy.float`,
and that (2) the ros_numpy package was no longer maintained.
As a result, we folded the source code of ros_numpy into our repository,
under [[./thirdparty/ros_numpy]]. It is modified to be a standard Python
package that can be pip-installed. The installation is, still, handled
by ~source install_dependencies.bash~ so you do not need to do anything.
*** Build the ROS package
#+begin_src
catkin_make -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
Note that if you are using the [robotdev Spot environment](https://github.com/zkytony/robotdev/tree/master/spot),
you need to run the following command instead
#+begin_src
build_spot -DCATKIN_WHITELIST_PACKAGES="genmos_object_search_ros"
#+end_src
*** Download Dataset and Models (Optional)
Install [[https://github.com/wkentaro/gdown][gdown]], then run download script:
#+begin_src
pip install gdown
python download.py
#+end_src
This will download both the ~SL\_OSM\_Dataset~ and the frame of reference
prediction models. The ~SL\_OSM\_Dataset~ will be saved under ~data~, while the
models will be saved under ~models~.
Also, you will need to download spacy models. We use ~en_core_web_lg~ (400MB). To download it:
#+begin_src
python -m spacy download en_core_web_lg
#+end_src
CHANGELOG
No CHANGELOG found.
Package Dependencies
System Dependencies
No direct system dependencies.
Dependant Packages
No known dependants.
Launch files
- launch/local_cloud_publisher.launch
-
- robot_pose_topic
- global_cloud_topic [default: /graphnav_map_publisher/graphnav_points]
- output [default: region_points]
- name [default: local_cloud_publisher]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.4]
- retain_ratio [default: 0.1]
- launch/movo/genmos_movo_action_executor.launch
- launch/movo/genmos_movo_exp1_scili8_living_room.launch
-
- local_search [default: false]
- launch/movo/genmos_movo_system.launch
-
- map_name
- world_frame [default: map]
- local_search [default: false]
- region_size_x [default: 4.0]
- region_size_y [default: 4.0]
- region_size_z [default: 2.0]
- retain_ratio [default: 0.2]
- launch/movo/view_movo_object_search.launch
-
- rviz [default: true]
- rviz_file [default: $(find genmos_object_search_ros)/rviz/movo/movo_object_search.rviz]
- launch/occupancy_grid_to_cloud.launch
- launch/spot/deprecated/sloop_mos_spot.launch
-
- map_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/deprecated/sloop_mos_spot_automate_task.launch
-
- max_steps [default: 50]
- replan_freq [default: 1.0]
- launch/spot/deprecated/spot_octree_belief_publisher.launch
- launch/spot/experiments/genmos_spot_action_executor.launch
- launch/spot/experiments/genmos_spot_search.launch
- Launches - local point cloud publisher that takes in full point cloud and filters out points outside of a region (box). (this point cloud should be at /spot/local_region/input_points) - the task client - the process that talks to the GenMOS gRPC server and responsible for interfacing with the actual robot to receive observations & execute actions
-
- exp_name
- local_search [default: true]
- retain_ratio [default: 0.5]
- launch/spot/experiments/genmos_spot_system.launch
-
- map_name
- world_frame [default: graphnav_map]
- local_search [default: false]
- frontleft_depth [default: /spot/stream_image/frontleft_depth_in_visual_frame]
- frontright_depth [default: /spot/stream_image/frontright_depth_in_visual_frame]
- hand_depth [default: /spot/stream_image/hand_depth_in_hand_color_frame]
- launch/spot/experiments/legacy/genmos_spot_exp1_local_lab121.launch
-
- spot
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp2_kitchen_lab115.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/legacy/genmos_spot_exp3_atrium_cit1f.launch
-
- map_type [default: lidar]
- local_search [default: false]
- launch/spot/experiments/view_spot_local_search.launch
- launch/spot/genmos_spot_landmark_recorder.launch
-
- max_name
- object_detection_camera [default: hand]
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/genmos_spot_publish_grid_map.launch
-
- map_name
- grid_size [default: 0.4]
- layout_cut [default: 0.1]
- launch/spot/spot_local_cloud_publisher.launch
-
- robot_pose_topic [default: /spot_body_pose]
- tests/spot/grpc/simple_sim/simple_sim_env.launch
-
- map_name
- world_frame [default: graphnav_map]
- tests/spot/grpc/simple_sim/view_simple_sim.launch
- tests/spot/grpc/view_process_detection_test.launch
Services
No service files found
Plugins
No plugins found.