Metamorphic Testing Harness for the Baidu Apollo Perception-Camera Module
2023 IEEE/ACM 8th International Workshop on Metamorphic Testing (MET), July 2023
Yifan Zhang, Dave Towey, Matthew Pike, Jia Cheng Han, George Zhou, Chenghao Yin, Qian Wang, Chen Xie. 2023. Metamorphic Testing Harness for the Baidu Apollo Perception-Camera Module. In 2023 IEEE/ACM 8th International Workshop on Metamorphic Testing (MET). DOI:https://doi.org/10.1109/MET59151.2023.00009
Yifan Zhang and Dave Towey and Matthew Pike and Jia Cheng Han and George Zhou and Chenghao Yin and Qian Wang and Chen Xie. (2023). Metamorphic Testing Harness for the Baidu Apollo Perception-Camera Module. 2023 IEEE/ACM 8th International Workshop on Metamorphic Testing (MET). https://doi.org/10.1109/MET59151.2023.00009
Yifan Zhang and Dave Towey and Matthew Pike and Jia Cheng Han and George Zhou and Chenghao Yin and Qian Wang and Chen Xie. "Metamorphic Testing Harness for the Baidu Apollo Perception-Camera Module." 2023 IEEE/ACM 8th International Workshop on Metamorphic Testing (MET), 2023. https://doi.org/10.1109/MET59151.2023.00009
Yifan Zhang, Dave Towey, Matthew Pike, Jia Cheng Han, George Zhou, Chenghao Yin, Qian Wang, Chen Xie. 2023. Metamorphic Testing Harness for the Baidu Apollo Perception-Camera Module. 2023 IEEE/ACM 8th International Workshop on Metamorphic Testing (MET). doi:10.1109/MET59151.2023.00009
Yifan Zhang and Dave Towey and Matthew Pike and Jia Cheng Han and George Zhou and Chenghao Yin and Qian Wang and Chen Xie, "Metamorphic Testing Harness for the Baidu Apollo Perception-Camera Module," 2023 IEEE/ACM 8th International Workshop on Metamorphic Testing (MET), 2023. doi: 10.1109/MET59151.2023.00009
@inproceedings{met-2023,
title={Metamorphic Testing Harness for the Baidu Apollo Perception-Camera Module},
author={Yifan Zhang and Dave Towey and Matthew Pike and Jia Cheng Han and George Zhou and Chenghao Yin and Qian Wang and Chen Xie},
booktitle={2023 IEEE/ACM 8th International Workshop on Metamorphic Testing (MET)},
year={2023},
doi={10.1109/MET59151.2023.00009}
}
Metamorphic testing, Autonomous driving systems, Baidu Apollo, Perception-camera module, Oracle problem, Automated testing
Abstract
As autonomous driving systems (ADSs) grow in complexity, efficient and reliable testing methodologies become increasingly necessary. This study investigates the use of metamorphic testing (MT) to evaluate the perception-camera module of Baidu Apollo, an open-source ADS platform. Experiments reveal inconsistencies in obstacle detection under variations in brightness within specific regions of driving scenarios, demonstrating the utility of MT in addressing the oracle problem in ADS perception validation. Additionally, this paper presents a metamorphic testing harness designed to streamline ADS testing workflows, improving testing efficiency and organization. An industry case study illustrates the frameworkâs practical application in production environments, highlighting its potential benefits for real-world ADS testing.