An integrated avoiding and approaching human systems for mobile service robots in dynamic social environments

Van Bay Hoang; Dinh Nghia Do; Van Xuan Nguyen; Xuan-Tung Truong

doi:10.15625/2525-2518/15993

Author affiliations

Authors

Van Bay Hoang Le Quy Don Technical University, 236 Hoang Quoc Viet, Bac Tu Liem, Ha Noi, Viet Nam
Dinh Nghia Do Le Quy Don Technical University, 236 Hoang Quoc Viet, Bac Tu Liem, Ha Noi, Viet Nam
Van Xuan Nguyen Le Quy Don Technical University, 236 Hoang Quoc Viet, Bac Tu Liem, Ha Noi, Viet Nam
Xuan-Tung Truong Le Quy Don Technical University, 236 Hoang Quoc Viet, Bac Tu Liem, Ha Noi, Viet Nam https://orcid.org/0000-0003-2353-9909

DOI:

https://doi.org/10.15625/2525-2518/15993

Keywords:

Socially aware navigation framework, mobile service robot, approaching human, timed elastic band technique, motion planning system

Abstract

In this study, we present a socially aware navigation framework for mobile service robots by integrating the systems proposed in our previous studies into a completed mobile robot navigation system, including the human detection and tracking system that is used to detect and track humans; the encoder and laser-based localization and mapping system that is used to determine the position of the robot in the environment; the approaching pose estimation system that is used to estimate the approaching pose of the robot to the human; and the social timed elastic band-based motion planning system that is used to socially navigate the mobile robots to approach the human. In addition, in the paper we describe in detail the motor control system and the design of our mobile robot platform, which is then utilized to conduct experiments in the real-world environments. We verify the feasibility and usefulness of the proposed socially aware robot navigation framework through a series of experiments in a corridor-like environment. The experimental results show that our proposed framework is able to drive the mobile robots to both avoid and approach the humans, providing the safety and comfort for the humans and socially acceptable behaviors for the mobile service robots in the dynamic social environments.

Downloads

Download data is not yet available.

References

Kruse T., Pandey A. K., Alami R., and Kirsch A. - Human-aware robot navigation: A survey, Robotics and Autonomous Systems 61 (2013) 1726-1743. DOI: https://doi.org/10.1016/j.robot.2013.05.007

Rios-Martinez J., Spalanzani A., and Laugier C. - From proxemics theory to socially-aware navigation: A survey, International Journal of Social Robotics, September 2014. DOI: https://doi.org/10.1007/s12369-014-0251-1

Christoforos M., Francesca B., Allan W., Dapeng Z., Pete T., Aaron S., and Jean O. - Core challenges of social robot navigation: A survey,” arXiv:2103.05668v2, 2021, pp. 1-28.

Shiomi M., Zanlungo F., Hayashi K., and Kanda T. - Towards a socially acceptable collision avoidance for a mobile robot navigating among pedestrians using a pedestrian model, International Journal of Social Robotics 6 (3) (2014) 443-455. DOI: https://doi.org/10.1007/s12369-014-0238-y

Chen Y. F., Everett M., Liu M., and How J. P. - Socially aware motion planning with deep reinforcement learning, In: IEEE/RSJ International Conference on Intelligent Robots and Systems, September 2017, pp. 1343-1350. DOI: https://doi.org/10.1109/IROS.2017.8202312

Truong X. T. and Ngo T. D. - Toward socially aware robot navigation in dynamic and crowded environments: A proactive social motion model, IEEE Transactions on Automation Science and Engineering 14 (4) (2017) 1743-1760. DOI: https://doi.org/10.1109/TASE.2017.2731371

Hoang V. B., Nguyen V. H., Nguyen L. A., Quang T. D., and Truong X. T. - Social constraints-based socially aware navigation framework for mobile service robots, In: Proceedings of the 7th Nafosted Conference on Information and Computer Science (NICS), 2020, pp. 84-89. DOI: https://doi.org/10.1109/NICS51282.2020.9335878

Fan T., Long P., Liu W., and Pan J. - Distributed multi-robot collision avoidance via deep reinforcement learning for navigation in complex scenarios, The International Journal of Robotics Research 39 (7) (2020) 856-892. DOI: https://doi.org/10.1177/0278364920916531

Trinh T. Q., Wengefeld T., Mueller S., Vorndran A., Volkhardt M., Scheidig A., and Gross H. - Take a seat, please: Approaching and recognition of seated persons by a mobile robot, In: 50th International Symposium on Robotics, June 2018, pp. 1-8.

Mizumaru K., Satake S., Kanda T., and Ono T. - Stop doing it! approaching strategy for a robot to admonish pedestrians, In: 14th ACM/IEEE International Conference on Human-Robot Interaction, March 2019, pp. 449-457. DOI: https://doi.org/10.1109/HRI.2019.8673017

Truong X. T. and Ngo T. D. - To Approach Humans?: a uniﬁed framework for approaching pose prediction and socially aware robot navigation, IEEE Transactions on Cognitive and Developmental Systems 10 (3) (2017) 557-572. DOI: https://doi.org/10.1109/TCDS.2017.2751963

Yang F. and Peters C. - App-lstm: Data-driven generation of socially acceptable trajectories for approaching small groups of agents, In: Proceedings of the 7th International Conference on Human-Agent In- teraction, 2019, pp. 144-152. DOI: https://doi.org/10.1145/3349537.3351885

Nguyen V. H., Hoang V. B., My C. A., Kien L. M., and Truong X. T. - Toward socially aware trajectory planning system for autonomous mobile robots in complex environments, In: Proceedings of the 7th Nafosted Conference on Information and Computer Science (NICS), 2020, pp. 90-95. DOI: https://doi.org/10.1109/NICS51282.2020.9335845

Siegwart R., Nourbakhsh I. R., and Scaramuzza D. - Introduction to Autonomous Mobile Robots. The MIT Press, February 2011.

Arras K. O., Mozos O. M., and Burgard W. - Using boosted features for the detection of people in 2d range data,” in IEEE International Conference on Robotics and Automation, April 2007, pp. 3402-3407. DOI: https://doi.org/10.1109/ROBOT.2007.363998

Welch G. and Bishop G. - An Introduction to the Kalman Filter. Chapel Hill, NC, USA: Tech. Rep. TR-95-041, University of North Carolina at Chapel Hill, 2006.

PrimeSense NITE, http://www.openni.org. Accessed 6 August 2012.

Nguyen L. A., Dung P. T., Ngo T. D., and Truong X. T. - Improving the accuracy of the autonomous mobile robot localization systems based on the multiple sensor fusion methods, In: International Conference on Recent Advances in Signal Processing, Telecommunications Computing, 2019, pp. 33-37. DOI: https://doi.org/10.1109/SIGTELCOM.2019.8696103

Giorgio Grisetti, Cyrill Stachniss, and Wolfram Burgard - Improved Techniques for Grid Mapping with Rao-Blackwellized Particle Filters, IEEE Transactions on Robotics 23 (2007) 34-46. DOI: https://doi.org/10.1109/TRO.2006.889486

Hart P. E., Nilsson N. J., and Raphael B. - A formal basis for the heuristic determination of minimum cost paths, IEEE Transactions on Systems Science and Cybernetics 4 (2) (1968) 100-107. DOI: https://doi.org/10.1109/TSSC.1968.300136

Kendon A. - Conducting interaction: Patterns of behavior in focused encounters, Cambridge University Press, 1990.

Hall E. T. - The hidden dimension: man’s use of space in public and private, The Bodley Head Ltd, London, 1996.

Rosmann C., Feiten W., Wosch T., Hoffmann F., and Bertram T. - Trajectory modiﬁcation considering dynamic constraints of autonomous robots, In: 7th German Conference on Robotics, May 2012, pp. 1-6.

Rosmann C., Hoffmann F., and Bertram T. - Integrated online trajectory planning and optimization in distinctive topologies, Robotics and Autonomous Systems 88 (2017) 142-153. DOI: https://doi.org/10.1016/j.robot.2016.11.007

Rosmann C., Oeljeklaus M., Hoffmann F., and Bertram T. - Online trajectory prediction and planning for social robot navigation, In: IEEE International Conference on Advanced Intelligent Mechatronics (AIM), 2017, pp. 1255-1260. DOI: https://doi.org/10.1109/AIM.2017.8014190

http://cc-smart.net/vi/san-pham/dcmp500.html

http://cc-smart.net/vi/san-pham/msdah.html

Quigley M., Gerkey B., Conley K., Faust J., Foote T., Leibs J., Berger E., Wheeler R., and A. Ng. - ROS: An open-source Robot Operating System, In: ICRA Workshop on Open Source Software, Vol. 32, 2009, pp. 151-170.

http://wiki.ros.org/teb_local_planner

http:// youtu.be/4RDPuzZglN0

Alahi A., Goel K., Ramanathan V., Robicquet A., Fei-Fei L., and Savarese S. - Social LSTM: Human trajectory prediction in crowded spaces, IEEE Conference on Computer Vision and Pattern Recognition, June 2016, pp. 961-971. DOI: https://doi.org/10.1109/CVPR.2016.110

Rudenko A., Palmieri L., Herman M., Kitani K. M., Gavrila D. M., and Arras K. O. - Human motion trajectory prediction: A survey, https://arxiv.org/abs/1905.06113v3, 2019.