Package Summary
Tags | No category tags. |
Version | 0.47.0 |
License | Apache License 2.0 |
Build type | AMENT_CMAKE |
Use | RECOMMENDED |
Repository Summary
Description | |
Checkout URI | https://github.com/autowarefoundation/autoware_universe.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2025-08-16 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | planner ros calibration self-driving-car autonomous-driving autonomous-vehicles ros2 3d-map autoware |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
Additional Links
Maintainers
- Yukihiro Saito
- Yoshi Ri
- Taekjin Lee
- Lei Gu
Authors
Tracking Object Merger
Purpose
This package try to merge two tracking objects from different sensor.
Inner-workings / Algorithms
Merging tracking objects from different sensor is a combination of data association and state fusion algorithms.
Detailed process depends on the merger policy.
decorative_tracker_merger
In decorative_tracker_merger, we assume there are dominant tracking objects and sub tracking objects.
The name decorative
means that sub tracking objects are used to complement the main objects.
Usually the dominant tracking objects are from LiDAR and sub tracking objects are from Radar or Camera.
Here show the processing pipeline.
time sync
Sub object(Radar or Camera) often has higher frequency than dominant object(LiDAR). So we need to sync the time of sub object to dominant object.
data association
In the data association, we use the following rules to determine whether two tracking objects are the same object.
- gating
-
distance gate
: distance between two tracking objects -
angle gate
: angle between two tracking objects -
mahalanobis_distance_gate
: Mahalanobis distance between two tracking objects -
min_iou_gate
: minimum IoU between two tracking objects -
max_velocity_gate
: maximum velocity difference between two tracking objects
-
- score
- score used in matching is equivalent to the distance between two tracking objects
tracklet update
Sub tracking objects are merged into dominant tracking objects.
Depends on the tracklet input sensor state, we update the tracklet state with different rules.
state\priority | 1st | 2nd | 3rd |
---|---|---|---|
Kinematics except velocity | LiDAR | Radar | Camera |
Forward velocity | Radar | LiDAR | Camera |
Object classification | Camera | LiDAR | Radar |
tracklet management
We use the existence_probability
to manage tracklet.
- When we create a new tracklet, we set the
existence_probability
to $p_{sensor}$ value. - In each update with specific sensor, we set the
existence_probability
to $p_{sensor}$ value. - When tracklet does not have update with specific sensor, we reduce the
existence_probability
bydecay_rate
- Object can be published if
existence_probability
is larger thanpublish_probability_threshold
and time from last update is smaller thanmax_dt
- Object will be removed if
existence_probability
is smaller thanremove_probability_threshold
and time from last update is larger thanmax_dt
These parameter can be set in config/decorative_tracker_merger.param.yaml
.
tracker_state_parameter:
remove_probability_threshold: 0.3
publish_probability_threshold: 0.6
default_lidar_existence_probability: 0.7
default_radar_existence_probability: 0.6
default_camera_existence_probability: 0.6
decay_rate: 0.1
max_dt: 1.0
input/parameters
topic name | message type | description |
---|---|---|
~input/main_object |
autoware_perception_msgs::TrackedObjects |
Dominant tracking objects. Output will be published with this dominant object stamps. |
~input/sub_object |
autoware_perception_msgs::TrackedObjects |
Sub tracking objects. |
output/object |
autoware_perception_msgs::TrackedObjects |
Merged tracking objects. |
debug/interpolated_sub_object |
autoware_perception_msgs::TrackedObjects |
Interpolated sub tracking objects. |
Default parameters are set in config/decorative_tracker_merger.param.yaml.
parameter name | description | default value |
---|---|---|
base_link_frame_id |
base link frame id. This is used to transform the tracking object. | “base_link” |
time_sync_threshold |
time sync threshold. If the time difference between two tracking objects is smaller than this value, we consider these two tracking objects are the same object. | 0.05 |
sub_object_timeout_sec |
sub object timeout. If the sub object is not updated for this time, we consider this object is not exist. | 0.5 |
main_sensor_type |
main sensor type. This is used to determine the dominant tracking object. | “lidar” |
sub_sensor_type |
sub sensor type. This is used to determine the sub tracking object. | “radar” |
tracker_state_parameter |
tracker state parameter. This is used to manage the tracklet. |
- the detail of
tracker_state_parameter
is described in tracklet management
File truncated at 100 lines see the full file
Changelog for package autoware_tracking_object_merger
0.47.0 (2025-08-11)
0.46.0 (2025-06-20)
0.45.0 (2025-05-22)
-
Merge remote-tracking branch 'origin/main' into tmp/notbot/bump_version_base
-
chore: perception code owner update (#10645)
- chore: update maintainers in multiple perception packages
* Revert "chore: update maintainers in multiple perception packages" This reverts commit f2838c33d6cd82bd032039e2a12b9cb8ba6eb584.
- chore: update maintainers in multiple perception packages
* chore: add Kok Seang Tan as maintainer in multiple perception packages ---------
-
Contributors: Taekjin LEE, TaikiYamada4
0.44.2 (2025-06-10)
0.44.1 (2025-05-01)
0.44.0 (2025-04-18)
-
Merge remote-tracking branch 'origin/main' into humble
-
feat(autoware_tracker_object_merger): add diagnostics (#10257)
- add diagnostics
- style(pre-commit): autofix
- fix how to check as diag
- style(pre-commit): autofix
- delete unnecesary include row
- change the way to check time
- pre-commit
- chore
- fix warn msg
* change msg string to int Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
- fix msg
* add unit ---------Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
-
Contributors: Masato Saeki, Ryohsuke Mitsudome
0.43.0 (2025-03-21)
- Merge remote-tracking branch 'origin/main' into chore/bump-version-0.43
- chore: rename from [autoware.universe]{.title-ref} to [autoware_universe]{.title-ref} (#10306)
- Contributors: Hayato Mizushima, Yutaka Kondo
0.42.0 (2025-03-03)
- Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
- feat(autoware_utils): replace autoware_universe_utils with autoware_utils (#10191)
- Contributors: Fumiya Watanabe, 心刚
0.41.2 (2025-02-19)
- chore: bump version to 0.41.1 (#10088)
- Contributors: Ryohsuke Mitsudome
0.41.1 (2025-02-10)
0.41.0 (2025-01-29)
-
Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
-
feat(autoware_tracking_object_merger)!: tier4_debug_msgs changed to autoware_internal_debug_msgs in autoware_tracking_object_merger (#9899)
-
feat(autoware_object_merger, autoware_tracking_object_merger): enable anonymized node names to be configurable (#9733) feat: enable anonymized node names to be configurable
-
fix(autoware_tracking_object_merger): fix bugprone-branch-clone
File truncated at 100 lines see the full file
Package Dependencies
System Dependencies
Name |
---|
eigen |
Dependant Packages
Name | Deps |
---|---|
tier4_perception_launch |
Launch files
- launch/decorative_tracker_merger.launch.xml
-
- node_name [default: $(anon decorative_tracker_merger)]
- input/main_object [default: main_object]
- input/sub_object [default: sub_object]
- output [default: merged_object]
- data_association_matrix_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/data_association_matrix.param.yaml]
- merge_options_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger_policy.param.yaml]
- node_param_file_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger.param.yaml]
Messages
Services
Plugins
Recent questions tagged autoware_tracking_object_merger at Robotics Stack Exchange
Package Summary
Tags | No category tags. |
Version | 0.47.0 |
License | Apache License 2.0 |
Build type | AMENT_CMAKE |
Use | RECOMMENDED |
Repository Summary
Description | |
Checkout URI | https://github.com/autowarefoundation/autoware_universe.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2025-08-16 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | planner ros calibration self-driving-car autonomous-driving autonomous-vehicles ros2 3d-map autoware |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
Additional Links
Maintainers
- Yukihiro Saito
- Yoshi Ri
- Taekjin Lee
- Lei Gu
Authors
Tracking Object Merger
Purpose
This package try to merge two tracking objects from different sensor.
Inner-workings / Algorithms
Merging tracking objects from different sensor is a combination of data association and state fusion algorithms.
Detailed process depends on the merger policy.
decorative_tracker_merger
In decorative_tracker_merger, we assume there are dominant tracking objects and sub tracking objects.
The name decorative
means that sub tracking objects are used to complement the main objects.
Usually the dominant tracking objects are from LiDAR and sub tracking objects are from Radar or Camera.
Here show the processing pipeline.
time sync
Sub object(Radar or Camera) often has higher frequency than dominant object(LiDAR). So we need to sync the time of sub object to dominant object.
data association
In the data association, we use the following rules to determine whether two tracking objects are the same object.
- gating
-
distance gate
: distance between two tracking objects -
angle gate
: angle between two tracking objects -
mahalanobis_distance_gate
: Mahalanobis distance between two tracking objects -
min_iou_gate
: minimum IoU between two tracking objects -
max_velocity_gate
: maximum velocity difference between two tracking objects
-
- score
- score used in matching is equivalent to the distance between two tracking objects
tracklet update
Sub tracking objects are merged into dominant tracking objects.
Depends on the tracklet input sensor state, we update the tracklet state with different rules.
state\priority | 1st | 2nd | 3rd |
---|---|---|---|
Kinematics except velocity | LiDAR | Radar | Camera |
Forward velocity | Radar | LiDAR | Camera |
Object classification | Camera | LiDAR | Radar |
tracklet management
We use the existence_probability
to manage tracklet.
- When we create a new tracklet, we set the
existence_probability
to $p_{sensor}$ value. - In each update with specific sensor, we set the
existence_probability
to $p_{sensor}$ value. - When tracklet does not have update with specific sensor, we reduce the
existence_probability
bydecay_rate
- Object can be published if
existence_probability
is larger thanpublish_probability_threshold
and time from last update is smaller thanmax_dt
- Object will be removed if
existence_probability
is smaller thanremove_probability_threshold
and time from last update is larger thanmax_dt
These parameter can be set in config/decorative_tracker_merger.param.yaml
.
tracker_state_parameter:
remove_probability_threshold: 0.3
publish_probability_threshold: 0.6
default_lidar_existence_probability: 0.7
default_radar_existence_probability: 0.6
default_camera_existence_probability: 0.6
decay_rate: 0.1
max_dt: 1.0
input/parameters
topic name | message type | description |
---|---|---|
~input/main_object |
autoware_perception_msgs::TrackedObjects |
Dominant tracking objects. Output will be published with this dominant object stamps. |
~input/sub_object |
autoware_perception_msgs::TrackedObjects |
Sub tracking objects. |
output/object |
autoware_perception_msgs::TrackedObjects |
Merged tracking objects. |
debug/interpolated_sub_object |
autoware_perception_msgs::TrackedObjects |
Interpolated sub tracking objects. |
Default parameters are set in config/decorative_tracker_merger.param.yaml.
parameter name | description | default value |
---|---|---|
base_link_frame_id |
base link frame id. This is used to transform the tracking object. | “base_link” |
time_sync_threshold |
time sync threshold. If the time difference between two tracking objects is smaller than this value, we consider these two tracking objects are the same object. | 0.05 |
sub_object_timeout_sec |
sub object timeout. If the sub object is not updated for this time, we consider this object is not exist. | 0.5 |
main_sensor_type |
main sensor type. This is used to determine the dominant tracking object. | “lidar” |
sub_sensor_type |
sub sensor type. This is used to determine the sub tracking object. | “radar” |
tracker_state_parameter |
tracker state parameter. This is used to manage the tracklet. |
- the detail of
tracker_state_parameter
is described in tracklet management
File truncated at 100 lines see the full file
Changelog for package autoware_tracking_object_merger
0.47.0 (2025-08-11)
0.46.0 (2025-06-20)
0.45.0 (2025-05-22)
-
Merge remote-tracking branch 'origin/main' into tmp/notbot/bump_version_base
-
chore: perception code owner update (#10645)
- chore: update maintainers in multiple perception packages
* Revert "chore: update maintainers in multiple perception packages" This reverts commit f2838c33d6cd82bd032039e2a12b9cb8ba6eb584.
- chore: update maintainers in multiple perception packages
* chore: add Kok Seang Tan as maintainer in multiple perception packages ---------
-
Contributors: Taekjin LEE, TaikiYamada4
0.44.2 (2025-06-10)
0.44.1 (2025-05-01)
0.44.0 (2025-04-18)
-
Merge remote-tracking branch 'origin/main' into humble
-
feat(autoware_tracker_object_merger): add diagnostics (#10257)
- add diagnostics
- style(pre-commit): autofix
- fix how to check as diag
- style(pre-commit): autofix
- delete unnecesary include row
- change the way to check time
- pre-commit
- chore
- fix warn msg
* change msg string to int Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
- fix msg
* add unit ---------Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
-
Contributors: Masato Saeki, Ryohsuke Mitsudome
0.43.0 (2025-03-21)
- Merge remote-tracking branch 'origin/main' into chore/bump-version-0.43
- chore: rename from [autoware.universe]{.title-ref} to [autoware_universe]{.title-ref} (#10306)
- Contributors: Hayato Mizushima, Yutaka Kondo
0.42.0 (2025-03-03)
- Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
- feat(autoware_utils): replace autoware_universe_utils with autoware_utils (#10191)
- Contributors: Fumiya Watanabe, 心刚
0.41.2 (2025-02-19)
- chore: bump version to 0.41.1 (#10088)
- Contributors: Ryohsuke Mitsudome
0.41.1 (2025-02-10)
0.41.0 (2025-01-29)
-
Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
-
feat(autoware_tracking_object_merger)!: tier4_debug_msgs changed to autoware_internal_debug_msgs in autoware_tracking_object_merger (#9899)
-
feat(autoware_object_merger, autoware_tracking_object_merger): enable anonymized node names to be configurable (#9733) feat: enable anonymized node names to be configurable
-
fix(autoware_tracking_object_merger): fix bugprone-branch-clone
File truncated at 100 lines see the full file
Package Dependencies
System Dependencies
Name |
---|
eigen |
Dependant Packages
Name | Deps |
---|---|
tier4_perception_launch |
Launch files
- launch/decorative_tracker_merger.launch.xml
-
- node_name [default: $(anon decorative_tracker_merger)]
- input/main_object [default: main_object]
- input/sub_object [default: sub_object]
- output [default: merged_object]
- data_association_matrix_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/data_association_matrix.param.yaml]
- merge_options_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger_policy.param.yaml]
- node_param_file_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger.param.yaml]
Messages
Services
Plugins
Recent questions tagged autoware_tracking_object_merger at Robotics Stack Exchange
Package Summary
Tags | No category tags. |
Version | 0.47.0 |
License | Apache License 2.0 |
Build type | AMENT_CMAKE |
Use | RECOMMENDED |
Repository Summary
Description | |
Checkout URI | https://github.com/autowarefoundation/autoware_universe.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2025-08-16 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | planner ros calibration self-driving-car autonomous-driving autonomous-vehicles ros2 3d-map autoware |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
Additional Links
Maintainers
- Yukihiro Saito
- Yoshi Ri
- Taekjin Lee
- Lei Gu
Authors
Tracking Object Merger
Purpose
This package try to merge two tracking objects from different sensor.
Inner-workings / Algorithms
Merging tracking objects from different sensor is a combination of data association and state fusion algorithms.
Detailed process depends on the merger policy.
decorative_tracker_merger
In decorative_tracker_merger, we assume there are dominant tracking objects and sub tracking objects.
The name decorative
means that sub tracking objects are used to complement the main objects.
Usually the dominant tracking objects are from LiDAR and sub tracking objects are from Radar or Camera.
Here show the processing pipeline.
time sync
Sub object(Radar or Camera) often has higher frequency than dominant object(LiDAR). So we need to sync the time of sub object to dominant object.
data association
In the data association, we use the following rules to determine whether two tracking objects are the same object.
- gating
-
distance gate
: distance between two tracking objects -
angle gate
: angle between two tracking objects -
mahalanobis_distance_gate
: Mahalanobis distance between two tracking objects -
min_iou_gate
: minimum IoU between two tracking objects -
max_velocity_gate
: maximum velocity difference between two tracking objects
-
- score
- score used in matching is equivalent to the distance between two tracking objects
tracklet update
Sub tracking objects are merged into dominant tracking objects.
Depends on the tracklet input sensor state, we update the tracklet state with different rules.
state\priority | 1st | 2nd | 3rd |
---|---|---|---|
Kinematics except velocity | LiDAR | Radar | Camera |
Forward velocity | Radar | LiDAR | Camera |
Object classification | Camera | LiDAR | Radar |
tracklet management
We use the existence_probability
to manage tracklet.
- When we create a new tracklet, we set the
existence_probability
to $p_{sensor}$ value. - In each update with specific sensor, we set the
existence_probability
to $p_{sensor}$ value. - When tracklet does not have update with specific sensor, we reduce the
existence_probability
bydecay_rate
- Object can be published if
existence_probability
is larger thanpublish_probability_threshold
and time from last update is smaller thanmax_dt
- Object will be removed if
existence_probability
is smaller thanremove_probability_threshold
and time from last update is larger thanmax_dt
These parameter can be set in config/decorative_tracker_merger.param.yaml
.
tracker_state_parameter:
remove_probability_threshold: 0.3
publish_probability_threshold: 0.6
default_lidar_existence_probability: 0.7
default_radar_existence_probability: 0.6
default_camera_existence_probability: 0.6
decay_rate: 0.1
max_dt: 1.0
input/parameters
topic name | message type | description |
---|---|---|
~input/main_object |
autoware_perception_msgs::TrackedObjects |
Dominant tracking objects. Output will be published with this dominant object stamps. |
~input/sub_object |
autoware_perception_msgs::TrackedObjects |
Sub tracking objects. |
output/object |
autoware_perception_msgs::TrackedObjects |
Merged tracking objects. |
debug/interpolated_sub_object |
autoware_perception_msgs::TrackedObjects |
Interpolated sub tracking objects. |
Default parameters are set in config/decorative_tracker_merger.param.yaml.
parameter name | description | default value |
---|---|---|
base_link_frame_id |
base link frame id. This is used to transform the tracking object. | “base_link” |
time_sync_threshold |
time sync threshold. If the time difference between two tracking objects is smaller than this value, we consider these two tracking objects are the same object. | 0.05 |
sub_object_timeout_sec |
sub object timeout. If the sub object is not updated for this time, we consider this object is not exist. | 0.5 |
main_sensor_type |
main sensor type. This is used to determine the dominant tracking object. | “lidar” |
sub_sensor_type |
sub sensor type. This is used to determine the sub tracking object. | “radar” |
tracker_state_parameter |
tracker state parameter. This is used to manage the tracklet. |
- the detail of
tracker_state_parameter
is described in tracklet management
File truncated at 100 lines see the full file
Changelog for package autoware_tracking_object_merger
0.47.0 (2025-08-11)
0.46.0 (2025-06-20)
0.45.0 (2025-05-22)
-
Merge remote-tracking branch 'origin/main' into tmp/notbot/bump_version_base
-
chore: perception code owner update (#10645)
- chore: update maintainers in multiple perception packages
* Revert "chore: update maintainers in multiple perception packages" This reverts commit f2838c33d6cd82bd032039e2a12b9cb8ba6eb584.
- chore: update maintainers in multiple perception packages
* chore: add Kok Seang Tan as maintainer in multiple perception packages ---------
-
Contributors: Taekjin LEE, TaikiYamada4
0.44.2 (2025-06-10)
0.44.1 (2025-05-01)
0.44.0 (2025-04-18)
-
Merge remote-tracking branch 'origin/main' into humble
-
feat(autoware_tracker_object_merger): add diagnostics (#10257)
- add diagnostics
- style(pre-commit): autofix
- fix how to check as diag
- style(pre-commit): autofix
- delete unnecesary include row
- change the way to check time
- pre-commit
- chore
- fix warn msg
* change msg string to int Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
- fix msg
* add unit ---------Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
-
Contributors: Masato Saeki, Ryohsuke Mitsudome
0.43.0 (2025-03-21)
- Merge remote-tracking branch 'origin/main' into chore/bump-version-0.43
- chore: rename from [autoware.universe]{.title-ref} to [autoware_universe]{.title-ref} (#10306)
- Contributors: Hayato Mizushima, Yutaka Kondo
0.42.0 (2025-03-03)
- Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
- feat(autoware_utils): replace autoware_universe_utils with autoware_utils (#10191)
- Contributors: Fumiya Watanabe, 心刚
0.41.2 (2025-02-19)
- chore: bump version to 0.41.1 (#10088)
- Contributors: Ryohsuke Mitsudome
0.41.1 (2025-02-10)
0.41.0 (2025-01-29)
-
Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
-
feat(autoware_tracking_object_merger)!: tier4_debug_msgs changed to autoware_internal_debug_msgs in autoware_tracking_object_merger (#9899)
-
feat(autoware_object_merger, autoware_tracking_object_merger): enable anonymized node names to be configurable (#9733) feat: enable anonymized node names to be configurable
-
fix(autoware_tracking_object_merger): fix bugprone-branch-clone
File truncated at 100 lines see the full file
Package Dependencies
System Dependencies
Name |
---|
eigen |
Dependant Packages
Name | Deps |
---|---|
tier4_perception_launch |
Launch files
- launch/decorative_tracker_merger.launch.xml
-
- node_name [default: $(anon decorative_tracker_merger)]
- input/main_object [default: main_object]
- input/sub_object [default: sub_object]
- output [default: merged_object]
- data_association_matrix_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/data_association_matrix.param.yaml]
- merge_options_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger_policy.param.yaml]
- node_param_file_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger.param.yaml]
Messages
Services
Plugins
Recent questions tagged autoware_tracking_object_merger at Robotics Stack Exchange
Package Summary
Tags | No category tags. |
Version | 0.47.0 |
License | Apache License 2.0 |
Build type | AMENT_CMAKE |
Use | RECOMMENDED |
Repository Summary
Description | |
Checkout URI | https://github.com/autowarefoundation/autoware_universe.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2025-08-16 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | planner ros calibration self-driving-car autonomous-driving autonomous-vehicles ros2 3d-map autoware |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
Additional Links
Maintainers
- Yukihiro Saito
- Yoshi Ri
- Taekjin Lee
- Lei Gu
Authors
Tracking Object Merger
Purpose
This package try to merge two tracking objects from different sensor.
Inner-workings / Algorithms
Merging tracking objects from different sensor is a combination of data association and state fusion algorithms.
Detailed process depends on the merger policy.
decorative_tracker_merger
In decorative_tracker_merger, we assume there are dominant tracking objects and sub tracking objects.
The name decorative
means that sub tracking objects are used to complement the main objects.
Usually the dominant tracking objects are from LiDAR and sub tracking objects are from Radar or Camera.
Here show the processing pipeline.
time sync
Sub object(Radar or Camera) often has higher frequency than dominant object(LiDAR). So we need to sync the time of sub object to dominant object.
data association
In the data association, we use the following rules to determine whether two tracking objects are the same object.
- gating
-
distance gate
: distance between two tracking objects -
angle gate
: angle between two tracking objects -
mahalanobis_distance_gate
: Mahalanobis distance between two tracking objects -
min_iou_gate
: minimum IoU between two tracking objects -
max_velocity_gate
: maximum velocity difference between two tracking objects
-
- score
- score used in matching is equivalent to the distance between two tracking objects
tracklet update
Sub tracking objects are merged into dominant tracking objects.
Depends on the tracklet input sensor state, we update the tracklet state with different rules.
state\priority | 1st | 2nd | 3rd |
---|---|---|---|
Kinematics except velocity | LiDAR | Radar | Camera |
Forward velocity | Radar | LiDAR | Camera |
Object classification | Camera | LiDAR | Radar |
tracklet management
We use the existence_probability
to manage tracklet.
- When we create a new tracklet, we set the
existence_probability
to $p_{sensor}$ value. - In each update with specific sensor, we set the
existence_probability
to $p_{sensor}$ value. - When tracklet does not have update with specific sensor, we reduce the
existence_probability
bydecay_rate
- Object can be published if
existence_probability
is larger thanpublish_probability_threshold
and time from last update is smaller thanmax_dt
- Object will be removed if
existence_probability
is smaller thanremove_probability_threshold
and time from last update is larger thanmax_dt
These parameter can be set in config/decorative_tracker_merger.param.yaml
.
tracker_state_parameter:
remove_probability_threshold: 0.3
publish_probability_threshold: 0.6
default_lidar_existence_probability: 0.7
default_radar_existence_probability: 0.6
default_camera_existence_probability: 0.6
decay_rate: 0.1
max_dt: 1.0
input/parameters
topic name | message type | description |
---|---|---|
~input/main_object |
autoware_perception_msgs::TrackedObjects |
Dominant tracking objects. Output will be published with this dominant object stamps. |
~input/sub_object |
autoware_perception_msgs::TrackedObjects |
Sub tracking objects. |
output/object |
autoware_perception_msgs::TrackedObjects |
Merged tracking objects. |
debug/interpolated_sub_object |
autoware_perception_msgs::TrackedObjects |
Interpolated sub tracking objects. |
Default parameters are set in config/decorative_tracker_merger.param.yaml.
parameter name | description | default value |
---|---|---|
base_link_frame_id |
base link frame id. This is used to transform the tracking object. | “base_link” |
time_sync_threshold |
time sync threshold. If the time difference between two tracking objects is smaller than this value, we consider these two tracking objects are the same object. | 0.05 |
sub_object_timeout_sec |
sub object timeout. If the sub object is not updated for this time, we consider this object is not exist. | 0.5 |
main_sensor_type |
main sensor type. This is used to determine the dominant tracking object. | “lidar” |
sub_sensor_type |
sub sensor type. This is used to determine the sub tracking object. | “radar” |
tracker_state_parameter |
tracker state parameter. This is used to manage the tracklet. |
- the detail of
tracker_state_parameter
is described in tracklet management
File truncated at 100 lines see the full file
Changelog for package autoware_tracking_object_merger
0.47.0 (2025-08-11)
0.46.0 (2025-06-20)
0.45.0 (2025-05-22)
-
Merge remote-tracking branch 'origin/main' into tmp/notbot/bump_version_base
-
chore: perception code owner update (#10645)
- chore: update maintainers in multiple perception packages
* Revert "chore: update maintainers in multiple perception packages" This reverts commit f2838c33d6cd82bd032039e2a12b9cb8ba6eb584.
- chore: update maintainers in multiple perception packages
* chore: add Kok Seang Tan as maintainer in multiple perception packages ---------
-
Contributors: Taekjin LEE, TaikiYamada4
0.44.2 (2025-06-10)
0.44.1 (2025-05-01)
0.44.0 (2025-04-18)
-
Merge remote-tracking branch 'origin/main' into humble
-
feat(autoware_tracker_object_merger): add diagnostics (#10257)
- add diagnostics
- style(pre-commit): autofix
- fix how to check as diag
- style(pre-commit): autofix
- delete unnecesary include row
- change the way to check time
- pre-commit
- chore
- fix warn msg
* change msg string to int Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
- fix msg
* add unit ---------Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
-
Contributors: Masato Saeki, Ryohsuke Mitsudome
0.43.0 (2025-03-21)
- Merge remote-tracking branch 'origin/main' into chore/bump-version-0.43
- chore: rename from [autoware.universe]{.title-ref} to [autoware_universe]{.title-ref} (#10306)
- Contributors: Hayato Mizushima, Yutaka Kondo
0.42.0 (2025-03-03)
- Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
- feat(autoware_utils): replace autoware_universe_utils with autoware_utils (#10191)
- Contributors: Fumiya Watanabe, 心刚
0.41.2 (2025-02-19)
- chore: bump version to 0.41.1 (#10088)
- Contributors: Ryohsuke Mitsudome
0.41.1 (2025-02-10)
0.41.0 (2025-01-29)
-
Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
-
feat(autoware_tracking_object_merger)!: tier4_debug_msgs changed to autoware_internal_debug_msgs in autoware_tracking_object_merger (#9899)
-
feat(autoware_object_merger, autoware_tracking_object_merger): enable anonymized node names to be configurable (#9733) feat: enable anonymized node names to be configurable
-
fix(autoware_tracking_object_merger): fix bugprone-branch-clone
File truncated at 100 lines see the full file
Package Dependencies
System Dependencies
Name |
---|
eigen |
Dependant Packages
Name | Deps |
---|---|
tier4_perception_launch |
Launch files
- launch/decorative_tracker_merger.launch.xml
-
- node_name [default: $(anon decorative_tracker_merger)]
- input/main_object [default: main_object]
- input/sub_object [default: sub_object]
- output [default: merged_object]
- data_association_matrix_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/data_association_matrix.param.yaml]
- merge_options_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger_policy.param.yaml]
- node_param_file_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger.param.yaml]
Messages
Services
Plugins
Recent questions tagged autoware_tracking_object_merger at Robotics Stack Exchange
Package Summary
Tags | No category tags. |
Version | 0.47.0 |
License | Apache License 2.0 |
Build type | AMENT_CMAKE |
Use | RECOMMENDED |
Repository Summary
Description | |
Checkout URI | https://github.com/autowarefoundation/autoware_universe.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2025-08-16 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | planner ros calibration self-driving-car autonomous-driving autonomous-vehicles ros2 3d-map autoware |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
Additional Links
Maintainers
- Yukihiro Saito
- Yoshi Ri
- Taekjin Lee
- Lei Gu
Authors
Tracking Object Merger
Purpose
This package try to merge two tracking objects from different sensor.
Inner-workings / Algorithms
Merging tracking objects from different sensor is a combination of data association and state fusion algorithms.
Detailed process depends on the merger policy.
decorative_tracker_merger
In decorative_tracker_merger, we assume there are dominant tracking objects and sub tracking objects.
The name decorative
means that sub tracking objects are used to complement the main objects.
Usually the dominant tracking objects are from LiDAR and sub tracking objects are from Radar or Camera.
Here show the processing pipeline.
time sync
Sub object(Radar or Camera) often has higher frequency than dominant object(LiDAR). So we need to sync the time of sub object to dominant object.
data association
In the data association, we use the following rules to determine whether two tracking objects are the same object.
- gating
-
distance gate
: distance between two tracking objects -
angle gate
: angle between two tracking objects -
mahalanobis_distance_gate
: Mahalanobis distance between two tracking objects -
min_iou_gate
: minimum IoU between two tracking objects -
max_velocity_gate
: maximum velocity difference between two tracking objects
-
- score
- score used in matching is equivalent to the distance between two tracking objects
tracklet update
Sub tracking objects are merged into dominant tracking objects.
Depends on the tracklet input sensor state, we update the tracklet state with different rules.
state\priority | 1st | 2nd | 3rd |
---|---|---|---|
Kinematics except velocity | LiDAR | Radar | Camera |
Forward velocity | Radar | LiDAR | Camera |
Object classification | Camera | LiDAR | Radar |
tracklet management
We use the existence_probability
to manage tracklet.
- When we create a new tracklet, we set the
existence_probability
to $p_{sensor}$ value. - In each update with specific sensor, we set the
existence_probability
to $p_{sensor}$ value. - When tracklet does not have update with specific sensor, we reduce the
existence_probability
bydecay_rate
- Object can be published if
existence_probability
is larger thanpublish_probability_threshold
and time from last update is smaller thanmax_dt
- Object will be removed if
existence_probability
is smaller thanremove_probability_threshold
and time from last update is larger thanmax_dt
These parameter can be set in config/decorative_tracker_merger.param.yaml
.
tracker_state_parameter:
remove_probability_threshold: 0.3
publish_probability_threshold: 0.6
default_lidar_existence_probability: 0.7
default_radar_existence_probability: 0.6
default_camera_existence_probability: 0.6
decay_rate: 0.1
max_dt: 1.0
input/parameters
topic name | message type | description |
---|---|---|
~input/main_object |
autoware_perception_msgs::TrackedObjects |
Dominant tracking objects. Output will be published with this dominant object stamps. |
~input/sub_object |
autoware_perception_msgs::TrackedObjects |
Sub tracking objects. |
output/object |
autoware_perception_msgs::TrackedObjects |
Merged tracking objects. |
debug/interpolated_sub_object |
autoware_perception_msgs::TrackedObjects |
Interpolated sub tracking objects. |
Default parameters are set in config/decorative_tracker_merger.param.yaml.
parameter name | description | default value |
---|---|---|
base_link_frame_id |
base link frame id. This is used to transform the tracking object. | “base_link” |
time_sync_threshold |
time sync threshold. If the time difference between two tracking objects is smaller than this value, we consider these two tracking objects are the same object. | 0.05 |
sub_object_timeout_sec |
sub object timeout. If the sub object is not updated for this time, we consider this object is not exist. | 0.5 |
main_sensor_type |
main sensor type. This is used to determine the dominant tracking object. | “lidar” |
sub_sensor_type |
sub sensor type. This is used to determine the sub tracking object. | “radar” |
tracker_state_parameter |
tracker state parameter. This is used to manage the tracklet. |
- the detail of
tracker_state_parameter
is described in tracklet management
File truncated at 100 lines see the full file
Changelog for package autoware_tracking_object_merger
0.47.0 (2025-08-11)
0.46.0 (2025-06-20)
0.45.0 (2025-05-22)
-
Merge remote-tracking branch 'origin/main' into tmp/notbot/bump_version_base
-
chore: perception code owner update (#10645)
- chore: update maintainers in multiple perception packages
* Revert "chore: update maintainers in multiple perception packages" This reverts commit f2838c33d6cd82bd032039e2a12b9cb8ba6eb584.
- chore: update maintainers in multiple perception packages
* chore: add Kok Seang Tan as maintainer in multiple perception packages ---------
-
Contributors: Taekjin LEE, TaikiYamada4
0.44.2 (2025-06-10)
0.44.1 (2025-05-01)
0.44.0 (2025-04-18)
-
Merge remote-tracking branch 'origin/main' into humble
-
feat(autoware_tracker_object_merger): add diagnostics (#10257)
- add diagnostics
- style(pre-commit): autofix
- fix how to check as diag
- style(pre-commit): autofix
- delete unnecesary include row
- change the way to check time
- pre-commit
- chore
- fix warn msg
* change msg string to int Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
- fix msg
* add unit ---------Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
-
Contributors: Masato Saeki, Ryohsuke Mitsudome
0.43.0 (2025-03-21)
- Merge remote-tracking branch 'origin/main' into chore/bump-version-0.43
- chore: rename from [autoware.universe]{.title-ref} to [autoware_universe]{.title-ref} (#10306)
- Contributors: Hayato Mizushima, Yutaka Kondo
0.42.0 (2025-03-03)
- Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
- feat(autoware_utils): replace autoware_universe_utils with autoware_utils (#10191)
- Contributors: Fumiya Watanabe, 心刚
0.41.2 (2025-02-19)
- chore: bump version to 0.41.1 (#10088)
- Contributors: Ryohsuke Mitsudome
0.41.1 (2025-02-10)
0.41.0 (2025-01-29)
-
Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
-
feat(autoware_tracking_object_merger)!: tier4_debug_msgs changed to autoware_internal_debug_msgs in autoware_tracking_object_merger (#9899)
-
feat(autoware_object_merger, autoware_tracking_object_merger): enable anonymized node names to be configurable (#9733) feat: enable anonymized node names to be configurable
-
fix(autoware_tracking_object_merger): fix bugprone-branch-clone
File truncated at 100 lines see the full file
Package Dependencies
System Dependencies
Name |
---|
eigen |
Dependant Packages
Name | Deps |
---|---|
tier4_perception_launch |
Launch files
- launch/decorative_tracker_merger.launch.xml
-
- node_name [default: $(anon decorative_tracker_merger)]
- input/main_object [default: main_object]
- input/sub_object [default: sub_object]
- output [default: merged_object]
- data_association_matrix_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/data_association_matrix.param.yaml]
- merge_options_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger_policy.param.yaml]
- node_param_file_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger.param.yaml]
Messages
Services
Plugins
Recent questions tagged autoware_tracking_object_merger at Robotics Stack Exchange
Package Summary
Tags | No category tags. |
Version | 0.47.0 |
License | Apache License 2.0 |
Build type | AMENT_CMAKE |
Use | RECOMMENDED |
Repository Summary
Description | |
Checkout URI | https://github.com/autowarefoundation/autoware_universe.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2025-08-16 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | planner ros calibration self-driving-car autonomous-driving autonomous-vehicles ros2 3d-map autoware |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
Additional Links
Maintainers
- Yukihiro Saito
- Yoshi Ri
- Taekjin Lee
- Lei Gu
Authors
Tracking Object Merger
Purpose
This package try to merge two tracking objects from different sensor.
Inner-workings / Algorithms
Merging tracking objects from different sensor is a combination of data association and state fusion algorithms.
Detailed process depends on the merger policy.
decorative_tracker_merger
In decorative_tracker_merger, we assume there are dominant tracking objects and sub tracking objects.
The name decorative
means that sub tracking objects are used to complement the main objects.
Usually the dominant tracking objects are from LiDAR and sub tracking objects are from Radar or Camera.
Here show the processing pipeline.
time sync
Sub object(Radar or Camera) often has higher frequency than dominant object(LiDAR). So we need to sync the time of sub object to dominant object.
data association
In the data association, we use the following rules to determine whether two tracking objects are the same object.
- gating
-
distance gate
: distance between two tracking objects -
angle gate
: angle between two tracking objects -
mahalanobis_distance_gate
: Mahalanobis distance between two tracking objects -
min_iou_gate
: minimum IoU between two tracking objects -
max_velocity_gate
: maximum velocity difference between two tracking objects
-
- score
- score used in matching is equivalent to the distance between two tracking objects
tracklet update
Sub tracking objects are merged into dominant tracking objects.
Depends on the tracklet input sensor state, we update the tracklet state with different rules.
state\priority | 1st | 2nd | 3rd |
---|---|---|---|
Kinematics except velocity | LiDAR | Radar | Camera |
Forward velocity | Radar | LiDAR | Camera |
Object classification | Camera | LiDAR | Radar |
tracklet management
We use the existence_probability
to manage tracklet.
- When we create a new tracklet, we set the
existence_probability
to $p_{sensor}$ value. - In each update with specific sensor, we set the
existence_probability
to $p_{sensor}$ value. - When tracklet does not have update with specific sensor, we reduce the
existence_probability
bydecay_rate
- Object can be published if
existence_probability
is larger thanpublish_probability_threshold
and time from last update is smaller thanmax_dt
- Object will be removed if
existence_probability
is smaller thanremove_probability_threshold
and time from last update is larger thanmax_dt
These parameter can be set in config/decorative_tracker_merger.param.yaml
.
tracker_state_parameter:
remove_probability_threshold: 0.3
publish_probability_threshold: 0.6
default_lidar_existence_probability: 0.7
default_radar_existence_probability: 0.6
default_camera_existence_probability: 0.6
decay_rate: 0.1
max_dt: 1.0
input/parameters
topic name | message type | description |
---|---|---|
~input/main_object |
autoware_perception_msgs::TrackedObjects |
Dominant tracking objects. Output will be published with this dominant object stamps. |
~input/sub_object |
autoware_perception_msgs::TrackedObjects |
Sub tracking objects. |
output/object |
autoware_perception_msgs::TrackedObjects |
Merged tracking objects. |
debug/interpolated_sub_object |
autoware_perception_msgs::TrackedObjects |
Interpolated sub tracking objects. |
Default parameters are set in config/decorative_tracker_merger.param.yaml.
parameter name | description | default value |
---|---|---|
base_link_frame_id |
base link frame id. This is used to transform the tracking object. | “base_link” |
time_sync_threshold |
time sync threshold. If the time difference between two tracking objects is smaller than this value, we consider these two tracking objects are the same object. | 0.05 |
sub_object_timeout_sec |
sub object timeout. If the sub object is not updated for this time, we consider this object is not exist. | 0.5 |
main_sensor_type |
main sensor type. This is used to determine the dominant tracking object. | “lidar” |
sub_sensor_type |
sub sensor type. This is used to determine the sub tracking object. | “radar” |
tracker_state_parameter |
tracker state parameter. This is used to manage the tracklet. |
- the detail of
tracker_state_parameter
is described in tracklet management
File truncated at 100 lines see the full file
Changelog for package autoware_tracking_object_merger
0.47.0 (2025-08-11)
0.46.0 (2025-06-20)
0.45.0 (2025-05-22)
-
Merge remote-tracking branch 'origin/main' into tmp/notbot/bump_version_base
-
chore: perception code owner update (#10645)
- chore: update maintainers in multiple perception packages
* Revert "chore: update maintainers in multiple perception packages" This reverts commit f2838c33d6cd82bd032039e2a12b9cb8ba6eb584.
- chore: update maintainers in multiple perception packages
* chore: add Kok Seang Tan as maintainer in multiple perception packages ---------
-
Contributors: Taekjin LEE, TaikiYamada4
0.44.2 (2025-06-10)
0.44.1 (2025-05-01)
0.44.0 (2025-04-18)
-
Merge remote-tracking branch 'origin/main' into humble
-
feat(autoware_tracker_object_merger): add diagnostics (#10257)
- add diagnostics
- style(pre-commit): autofix
- fix how to check as diag
- style(pre-commit): autofix
- delete unnecesary include row
- change the way to check time
- pre-commit
- chore
- fix warn msg
* change msg string to int Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
- fix msg
* add unit ---------Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
-
Contributors: Masato Saeki, Ryohsuke Mitsudome
0.43.0 (2025-03-21)
- Merge remote-tracking branch 'origin/main' into chore/bump-version-0.43
- chore: rename from [autoware.universe]{.title-ref} to [autoware_universe]{.title-ref} (#10306)
- Contributors: Hayato Mizushima, Yutaka Kondo
0.42.0 (2025-03-03)
- Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
- feat(autoware_utils): replace autoware_universe_utils with autoware_utils (#10191)
- Contributors: Fumiya Watanabe, 心刚
0.41.2 (2025-02-19)
- chore: bump version to 0.41.1 (#10088)
- Contributors: Ryohsuke Mitsudome
0.41.1 (2025-02-10)
0.41.0 (2025-01-29)
-
Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
-
feat(autoware_tracking_object_merger)!: tier4_debug_msgs changed to autoware_internal_debug_msgs in autoware_tracking_object_merger (#9899)
-
feat(autoware_object_merger, autoware_tracking_object_merger): enable anonymized node names to be configurable (#9733) feat: enable anonymized node names to be configurable
-
fix(autoware_tracking_object_merger): fix bugprone-branch-clone
File truncated at 100 lines see the full file
Package Dependencies
System Dependencies
Name |
---|
eigen |
Dependant Packages
Name | Deps |
---|---|
tier4_perception_launch |
Launch files
- launch/decorative_tracker_merger.launch.xml
-
- node_name [default: $(anon decorative_tracker_merger)]
- input/main_object [default: main_object]
- input/sub_object [default: sub_object]
- output [default: merged_object]
- data_association_matrix_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/data_association_matrix.param.yaml]
- merge_options_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger_policy.param.yaml]
- node_param_file_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger.param.yaml]
Messages
Services
Plugins
Recent questions tagged autoware_tracking_object_merger at Robotics Stack Exchange
Package Summary
Tags | No category tags. |
Version | 0.47.0 |
License | Apache License 2.0 |
Build type | AMENT_CMAKE |
Use | RECOMMENDED |
Repository Summary
Description | |
Checkout URI | https://github.com/autowarefoundation/autoware_universe.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2025-08-16 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | planner ros calibration self-driving-car autonomous-driving autonomous-vehicles ros2 3d-map autoware |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
Additional Links
Maintainers
- Yukihiro Saito
- Yoshi Ri
- Taekjin Lee
- Lei Gu
Authors
Tracking Object Merger
Purpose
This package try to merge two tracking objects from different sensor.
Inner-workings / Algorithms
Merging tracking objects from different sensor is a combination of data association and state fusion algorithms.
Detailed process depends on the merger policy.
decorative_tracker_merger
In decorative_tracker_merger, we assume there are dominant tracking objects and sub tracking objects.
The name decorative
means that sub tracking objects are used to complement the main objects.
Usually the dominant tracking objects are from LiDAR and sub tracking objects are from Radar or Camera.
Here show the processing pipeline.
time sync
Sub object(Radar or Camera) often has higher frequency than dominant object(LiDAR). So we need to sync the time of sub object to dominant object.
data association
In the data association, we use the following rules to determine whether two tracking objects are the same object.
- gating
-
distance gate
: distance between two tracking objects -
angle gate
: angle between two tracking objects -
mahalanobis_distance_gate
: Mahalanobis distance between two tracking objects -
min_iou_gate
: minimum IoU between two tracking objects -
max_velocity_gate
: maximum velocity difference between two tracking objects
-
- score
- score used in matching is equivalent to the distance between two tracking objects
tracklet update
Sub tracking objects are merged into dominant tracking objects.
Depends on the tracklet input sensor state, we update the tracklet state with different rules.
state\priority | 1st | 2nd | 3rd |
---|---|---|---|
Kinematics except velocity | LiDAR | Radar | Camera |
Forward velocity | Radar | LiDAR | Camera |
Object classification | Camera | LiDAR | Radar |
tracklet management
We use the existence_probability
to manage tracklet.
- When we create a new tracklet, we set the
existence_probability
to $p_{sensor}$ value. - In each update with specific sensor, we set the
existence_probability
to $p_{sensor}$ value. - When tracklet does not have update with specific sensor, we reduce the
existence_probability
bydecay_rate
- Object can be published if
existence_probability
is larger thanpublish_probability_threshold
and time from last update is smaller thanmax_dt
- Object will be removed if
existence_probability
is smaller thanremove_probability_threshold
and time from last update is larger thanmax_dt
These parameter can be set in config/decorative_tracker_merger.param.yaml
.
tracker_state_parameter:
remove_probability_threshold: 0.3
publish_probability_threshold: 0.6
default_lidar_existence_probability: 0.7
default_radar_existence_probability: 0.6
default_camera_existence_probability: 0.6
decay_rate: 0.1
max_dt: 1.0
input/parameters
topic name | message type | description |
---|---|---|
~input/main_object |
autoware_perception_msgs::TrackedObjects |
Dominant tracking objects. Output will be published with this dominant object stamps. |
~input/sub_object |
autoware_perception_msgs::TrackedObjects |
Sub tracking objects. |
output/object |
autoware_perception_msgs::TrackedObjects |
Merged tracking objects. |
debug/interpolated_sub_object |
autoware_perception_msgs::TrackedObjects |
Interpolated sub tracking objects. |
Default parameters are set in config/decorative_tracker_merger.param.yaml.
parameter name | description | default value |
---|---|---|
base_link_frame_id |
base link frame id. This is used to transform the tracking object. | “base_link” |
time_sync_threshold |
time sync threshold. If the time difference between two tracking objects is smaller than this value, we consider these two tracking objects are the same object. | 0.05 |
sub_object_timeout_sec |
sub object timeout. If the sub object is not updated for this time, we consider this object is not exist. | 0.5 |
main_sensor_type |
main sensor type. This is used to determine the dominant tracking object. | “lidar” |
sub_sensor_type |
sub sensor type. This is used to determine the sub tracking object. | “radar” |
tracker_state_parameter |
tracker state parameter. This is used to manage the tracklet. |
- the detail of
tracker_state_parameter
is described in tracklet management
File truncated at 100 lines see the full file
Changelog for package autoware_tracking_object_merger
0.47.0 (2025-08-11)
0.46.0 (2025-06-20)
0.45.0 (2025-05-22)
-
Merge remote-tracking branch 'origin/main' into tmp/notbot/bump_version_base
-
chore: perception code owner update (#10645)
- chore: update maintainers in multiple perception packages
* Revert "chore: update maintainers in multiple perception packages" This reverts commit f2838c33d6cd82bd032039e2a12b9cb8ba6eb584.
- chore: update maintainers in multiple perception packages
* chore: add Kok Seang Tan as maintainer in multiple perception packages ---------
-
Contributors: Taekjin LEE, TaikiYamada4
0.44.2 (2025-06-10)
0.44.1 (2025-05-01)
0.44.0 (2025-04-18)
-
Merge remote-tracking branch 'origin/main' into humble
-
feat(autoware_tracker_object_merger): add diagnostics (#10257)
- add diagnostics
- style(pre-commit): autofix
- fix how to check as diag
- style(pre-commit): autofix
- delete unnecesary include row
- change the way to check time
- pre-commit
- chore
- fix warn msg
* change msg string to int Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
- fix msg
* add unit ---------Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
-
Contributors: Masato Saeki, Ryohsuke Mitsudome
0.43.0 (2025-03-21)
- Merge remote-tracking branch 'origin/main' into chore/bump-version-0.43
- chore: rename from [autoware.universe]{.title-ref} to [autoware_universe]{.title-ref} (#10306)
- Contributors: Hayato Mizushima, Yutaka Kondo
0.42.0 (2025-03-03)
- Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
- feat(autoware_utils): replace autoware_universe_utils with autoware_utils (#10191)
- Contributors: Fumiya Watanabe, 心刚
0.41.2 (2025-02-19)
- chore: bump version to 0.41.1 (#10088)
- Contributors: Ryohsuke Mitsudome
0.41.1 (2025-02-10)
0.41.0 (2025-01-29)
-
Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
-
feat(autoware_tracking_object_merger)!: tier4_debug_msgs changed to autoware_internal_debug_msgs in autoware_tracking_object_merger (#9899)
-
feat(autoware_object_merger, autoware_tracking_object_merger): enable anonymized node names to be configurable (#9733) feat: enable anonymized node names to be configurable
-
fix(autoware_tracking_object_merger): fix bugprone-branch-clone
File truncated at 100 lines see the full file
Package Dependencies
System Dependencies
Name |
---|
eigen |
Dependant Packages
Name | Deps |
---|---|
tier4_perception_launch |
Launch files
- launch/decorative_tracker_merger.launch.xml
-
- node_name [default: $(anon decorative_tracker_merger)]
- input/main_object [default: main_object]
- input/sub_object [default: sub_object]
- output [default: merged_object]
- data_association_matrix_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/data_association_matrix.param.yaml]
- merge_options_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger_policy.param.yaml]
- node_param_file_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger.param.yaml]
Messages
Services
Plugins
Recent questions tagged autoware_tracking_object_merger at Robotics Stack Exchange
Package Summary
Tags | No category tags. |
Version | 0.47.0 |
License | Apache License 2.0 |
Build type | AMENT_CMAKE |
Use | RECOMMENDED |
Repository Summary
Description | |
Checkout URI | https://github.com/autowarefoundation/autoware_universe.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2025-08-16 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | planner ros calibration self-driving-car autonomous-driving autonomous-vehicles ros2 3d-map autoware |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
Additional Links
Maintainers
- Yukihiro Saito
- Yoshi Ri
- Taekjin Lee
- Lei Gu
Authors
Tracking Object Merger
Purpose
This package try to merge two tracking objects from different sensor.
Inner-workings / Algorithms
Merging tracking objects from different sensor is a combination of data association and state fusion algorithms.
Detailed process depends on the merger policy.
decorative_tracker_merger
In decorative_tracker_merger, we assume there are dominant tracking objects and sub tracking objects.
The name decorative
means that sub tracking objects are used to complement the main objects.
Usually the dominant tracking objects are from LiDAR and sub tracking objects are from Radar or Camera.
Here show the processing pipeline.
time sync
Sub object(Radar or Camera) often has higher frequency than dominant object(LiDAR). So we need to sync the time of sub object to dominant object.
data association
In the data association, we use the following rules to determine whether two tracking objects are the same object.
- gating
-
distance gate
: distance between two tracking objects -
angle gate
: angle between two tracking objects -
mahalanobis_distance_gate
: Mahalanobis distance between two tracking objects -
min_iou_gate
: minimum IoU between two tracking objects -
max_velocity_gate
: maximum velocity difference between two tracking objects
-
- score
- score used in matching is equivalent to the distance between two tracking objects
tracklet update
Sub tracking objects are merged into dominant tracking objects.
Depends on the tracklet input sensor state, we update the tracklet state with different rules.
state\priority | 1st | 2nd | 3rd |
---|---|---|---|
Kinematics except velocity | LiDAR | Radar | Camera |
Forward velocity | Radar | LiDAR | Camera |
Object classification | Camera | LiDAR | Radar |
tracklet management
We use the existence_probability
to manage tracklet.
- When we create a new tracklet, we set the
existence_probability
to $p_{sensor}$ value. - In each update with specific sensor, we set the
existence_probability
to $p_{sensor}$ value. - When tracklet does not have update with specific sensor, we reduce the
existence_probability
bydecay_rate
- Object can be published if
existence_probability
is larger thanpublish_probability_threshold
and time from last update is smaller thanmax_dt
- Object will be removed if
existence_probability
is smaller thanremove_probability_threshold
and time from last update is larger thanmax_dt
These parameter can be set in config/decorative_tracker_merger.param.yaml
.
tracker_state_parameter:
remove_probability_threshold: 0.3
publish_probability_threshold: 0.6
default_lidar_existence_probability: 0.7
default_radar_existence_probability: 0.6
default_camera_existence_probability: 0.6
decay_rate: 0.1
max_dt: 1.0
input/parameters
topic name | message type | description |
---|---|---|
~input/main_object |
autoware_perception_msgs::TrackedObjects |
Dominant tracking objects. Output will be published with this dominant object stamps. |
~input/sub_object |
autoware_perception_msgs::TrackedObjects |
Sub tracking objects. |
output/object |
autoware_perception_msgs::TrackedObjects |
Merged tracking objects. |
debug/interpolated_sub_object |
autoware_perception_msgs::TrackedObjects |
Interpolated sub tracking objects. |
Default parameters are set in config/decorative_tracker_merger.param.yaml.
parameter name | description | default value |
---|---|---|
base_link_frame_id |
base link frame id. This is used to transform the tracking object. | “base_link” |
time_sync_threshold |
time sync threshold. If the time difference between two tracking objects is smaller than this value, we consider these two tracking objects are the same object. | 0.05 |
sub_object_timeout_sec |
sub object timeout. If the sub object is not updated for this time, we consider this object is not exist. | 0.5 |
main_sensor_type |
main sensor type. This is used to determine the dominant tracking object. | “lidar” |
sub_sensor_type |
sub sensor type. This is used to determine the sub tracking object. | “radar” |
tracker_state_parameter |
tracker state parameter. This is used to manage the tracklet. |
- the detail of
tracker_state_parameter
is described in tracklet management
File truncated at 100 lines see the full file
Changelog for package autoware_tracking_object_merger
0.47.0 (2025-08-11)
0.46.0 (2025-06-20)
0.45.0 (2025-05-22)
-
Merge remote-tracking branch 'origin/main' into tmp/notbot/bump_version_base
-
chore: perception code owner update (#10645)
- chore: update maintainers in multiple perception packages
* Revert "chore: update maintainers in multiple perception packages" This reverts commit f2838c33d6cd82bd032039e2a12b9cb8ba6eb584.
- chore: update maintainers in multiple perception packages
* chore: add Kok Seang Tan as maintainer in multiple perception packages ---------
-
Contributors: Taekjin LEE, TaikiYamada4
0.44.2 (2025-06-10)
0.44.1 (2025-05-01)
0.44.0 (2025-04-18)
-
Merge remote-tracking branch 'origin/main' into humble
-
feat(autoware_tracker_object_merger): add diagnostics (#10257)
- add diagnostics
- style(pre-commit): autofix
- fix how to check as diag
- style(pre-commit): autofix
- delete unnecesary include row
- change the way to check time
- pre-commit
- chore
- fix warn msg
* change msg string to int Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
- fix msg
* add unit ---------Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
-
Contributors: Masato Saeki, Ryohsuke Mitsudome
0.43.0 (2025-03-21)
- Merge remote-tracking branch 'origin/main' into chore/bump-version-0.43
- chore: rename from [autoware.universe]{.title-ref} to [autoware_universe]{.title-ref} (#10306)
- Contributors: Hayato Mizushima, Yutaka Kondo
0.42.0 (2025-03-03)
- Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
- feat(autoware_utils): replace autoware_universe_utils with autoware_utils (#10191)
- Contributors: Fumiya Watanabe, 心刚
0.41.2 (2025-02-19)
- chore: bump version to 0.41.1 (#10088)
- Contributors: Ryohsuke Mitsudome
0.41.1 (2025-02-10)
0.41.0 (2025-01-29)
-
Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
-
feat(autoware_tracking_object_merger)!: tier4_debug_msgs changed to autoware_internal_debug_msgs in autoware_tracking_object_merger (#9899)
-
feat(autoware_object_merger, autoware_tracking_object_merger): enable anonymized node names to be configurable (#9733) feat: enable anonymized node names to be configurable
-
fix(autoware_tracking_object_merger): fix bugprone-branch-clone
File truncated at 100 lines see the full file
Package Dependencies
System Dependencies
Name |
---|
eigen |
Dependant Packages
Name | Deps |
---|---|
tier4_perception_launch |
Launch files
- launch/decorative_tracker_merger.launch.xml
-
- node_name [default: $(anon decorative_tracker_merger)]
- input/main_object [default: main_object]
- input/sub_object [default: sub_object]
- output [default: merged_object]
- data_association_matrix_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/data_association_matrix.param.yaml]
- merge_options_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger_policy.param.yaml]
- node_param_file_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger.param.yaml]
Messages
Services
Plugins
Recent questions tagged autoware_tracking_object_merger at Robotics Stack Exchange
Package Summary
Tags | No category tags. |
Version | 0.47.0 |
License | Apache License 2.0 |
Build type | AMENT_CMAKE |
Use | RECOMMENDED |
Repository Summary
Description | |
Checkout URI | https://github.com/autowarefoundation/autoware_universe.git |
VCS Type | git |
VCS Version | main |
Last Updated | 2025-08-16 |
Dev Status | UNKNOWN |
Released | UNRELEASED |
Tags | planner ros calibration self-driving-car autonomous-driving autonomous-vehicles ros2 3d-map autoware |
Contributing |
Help Wanted (-)
Good First Issues (-) Pull Requests to Review (-) |
Package Description
Additional Links
Maintainers
- Yukihiro Saito
- Yoshi Ri
- Taekjin Lee
- Lei Gu
Authors
Tracking Object Merger
Purpose
This package try to merge two tracking objects from different sensor.
Inner-workings / Algorithms
Merging tracking objects from different sensor is a combination of data association and state fusion algorithms.
Detailed process depends on the merger policy.
decorative_tracker_merger
In decorative_tracker_merger, we assume there are dominant tracking objects and sub tracking objects.
The name decorative
means that sub tracking objects are used to complement the main objects.
Usually the dominant tracking objects are from LiDAR and sub tracking objects are from Radar or Camera.
Here show the processing pipeline.
time sync
Sub object(Radar or Camera) often has higher frequency than dominant object(LiDAR). So we need to sync the time of sub object to dominant object.
data association
In the data association, we use the following rules to determine whether two tracking objects are the same object.
- gating
-
distance gate
: distance between two tracking objects -
angle gate
: angle between two tracking objects -
mahalanobis_distance_gate
: Mahalanobis distance between two tracking objects -
min_iou_gate
: minimum IoU between two tracking objects -
max_velocity_gate
: maximum velocity difference between two tracking objects
-
- score
- score used in matching is equivalent to the distance between two tracking objects
tracklet update
Sub tracking objects are merged into dominant tracking objects.
Depends on the tracklet input sensor state, we update the tracklet state with different rules.
state\priority | 1st | 2nd | 3rd |
---|---|---|---|
Kinematics except velocity | LiDAR | Radar | Camera |
Forward velocity | Radar | LiDAR | Camera |
Object classification | Camera | LiDAR | Radar |
tracklet management
We use the existence_probability
to manage tracklet.
- When we create a new tracklet, we set the
existence_probability
to $p_{sensor}$ value. - In each update with specific sensor, we set the
existence_probability
to $p_{sensor}$ value. - When tracklet does not have update with specific sensor, we reduce the
existence_probability
bydecay_rate
- Object can be published if
existence_probability
is larger thanpublish_probability_threshold
and time from last update is smaller thanmax_dt
- Object will be removed if
existence_probability
is smaller thanremove_probability_threshold
and time from last update is larger thanmax_dt
These parameter can be set in config/decorative_tracker_merger.param.yaml
.
tracker_state_parameter:
remove_probability_threshold: 0.3
publish_probability_threshold: 0.6
default_lidar_existence_probability: 0.7
default_radar_existence_probability: 0.6
default_camera_existence_probability: 0.6
decay_rate: 0.1
max_dt: 1.0
input/parameters
topic name | message type | description |
---|---|---|
~input/main_object |
autoware_perception_msgs::TrackedObjects |
Dominant tracking objects. Output will be published with this dominant object stamps. |
~input/sub_object |
autoware_perception_msgs::TrackedObjects |
Sub tracking objects. |
output/object |
autoware_perception_msgs::TrackedObjects |
Merged tracking objects. |
debug/interpolated_sub_object |
autoware_perception_msgs::TrackedObjects |
Interpolated sub tracking objects. |
Default parameters are set in config/decorative_tracker_merger.param.yaml.
parameter name | description | default value |
---|---|---|
base_link_frame_id |
base link frame id. This is used to transform the tracking object. | “base_link” |
time_sync_threshold |
time sync threshold. If the time difference between two tracking objects is smaller than this value, we consider these two tracking objects are the same object. | 0.05 |
sub_object_timeout_sec |
sub object timeout. If the sub object is not updated for this time, we consider this object is not exist. | 0.5 |
main_sensor_type |
main sensor type. This is used to determine the dominant tracking object. | “lidar” |
sub_sensor_type |
sub sensor type. This is used to determine the sub tracking object. | “radar” |
tracker_state_parameter |
tracker state parameter. This is used to manage the tracklet. |
- the detail of
tracker_state_parameter
is described in tracklet management
File truncated at 100 lines see the full file
Changelog for package autoware_tracking_object_merger
0.47.0 (2025-08-11)
0.46.0 (2025-06-20)
0.45.0 (2025-05-22)
-
Merge remote-tracking branch 'origin/main' into tmp/notbot/bump_version_base
-
chore: perception code owner update (#10645)
- chore: update maintainers in multiple perception packages
* Revert "chore: update maintainers in multiple perception packages" This reverts commit f2838c33d6cd82bd032039e2a12b9cb8ba6eb584.
- chore: update maintainers in multiple perception packages
* chore: add Kok Seang Tan as maintainer in multiple perception packages ---------
-
Contributors: Taekjin LEE, TaikiYamada4
0.44.2 (2025-06-10)
0.44.1 (2025-05-01)
0.44.0 (2025-04-18)
-
Merge remote-tracking branch 'origin/main' into humble
-
feat(autoware_tracker_object_merger): add diagnostics (#10257)
- add diagnostics
- style(pre-commit): autofix
- fix how to check as diag
- style(pre-commit): autofix
- delete unnecesary include row
- change the way to check time
- pre-commit
- chore
- fix warn msg
* change msg string to int Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
- fix msg
* add unit ---------Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Taekjin LEE <<technolojin@gmail.com>>
-
Contributors: Masato Saeki, Ryohsuke Mitsudome
0.43.0 (2025-03-21)
- Merge remote-tracking branch 'origin/main' into chore/bump-version-0.43
- chore: rename from [autoware.universe]{.title-ref} to [autoware_universe]{.title-ref} (#10306)
- Contributors: Hayato Mizushima, Yutaka Kondo
0.42.0 (2025-03-03)
- Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
- feat(autoware_utils): replace autoware_universe_utils with autoware_utils (#10191)
- Contributors: Fumiya Watanabe, 心刚
0.41.2 (2025-02-19)
- chore: bump version to 0.41.1 (#10088)
- Contributors: Ryohsuke Mitsudome
0.41.1 (2025-02-10)
0.41.0 (2025-01-29)
-
Merge remote-tracking branch 'origin/main' into tmp/bot/bump_version_base
-
feat(autoware_tracking_object_merger)!: tier4_debug_msgs changed to autoware_internal_debug_msgs in autoware_tracking_object_merger (#9899)
-
feat(autoware_object_merger, autoware_tracking_object_merger): enable anonymized node names to be configurable (#9733) feat: enable anonymized node names to be configurable
-
fix(autoware_tracking_object_merger): fix bugprone-branch-clone
File truncated at 100 lines see the full file
Package Dependencies
System Dependencies
Name |
---|
eigen |
Dependant Packages
Name | Deps |
---|---|
tier4_perception_launch |
Launch files
- launch/decorative_tracker_merger.launch.xml
-
- node_name [default: $(anon decorative_tracker_merger)]
- input/main_object [default: main_object]
- input/sub_object [default: sub_object]
- output [default: merged_object]
- data_association_matrix_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/data_association_matrix.param.yaml]
- merge_options_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger_policy.param.yaml]
- node_param_file_path [default: $(find-pkg-share autoware_tracking_object_merger)/config/decorative_tracker_merger.param.yaml]