The Impact of Virtual Reality Integration in Robotics: Enhancing Efficiency, Safety, and Human-Robot Interaction
DOI:
https://doi.org/10.70112/arme-2023.12.2.4228Keywords:
Virtual Reality (VR), Robotics, Efficiency, Safety, Human-Robot InteractionAbstract
In this paper, a review of the implementation of Virtual Reality (VR) with robotics and how it has changed various areas is explored. In general, VR improves efficiency and safety in operational work—especially in the energy sector, where it optimizes substation operations (e.g., increasing accuracy by up to 25% due to a higher level of automation). For mechatronics, VR allows advanced digital design, such as virtual prototyping and collaborative simulation, which significantly increase system efficiency. In education, VR technology has increased student engagement and learning outcomes by up to 40%, improving participation in subjects such as natural sciences. VR integration into robotics also enables the testing of various movements and trajectories for safety, resulting in minimal damages incurred during the design phase and increased productivity. VR also enhances human-robot interaction by enabling intuitive control based on better gesture recognition and a 35% increase in precision. In future applications, the remote operation of robots in dangerous environments will greatly improve emergency rescue efficiency and speed. Using VR for substation operations has translated to 25% better accuracy and a similar gain in terms of operational efficiency. By providing a more connected, efficient future in multiple spheres and delivering about 40% fewer accidents during simulations, the fusion of VR with robotics is an overall successful venture.
References
H. Zhu, S. Qiao, Y. Lu, and X. Zhao, “Application of Virtual RealityTechnology Based on Fast Filtering Algorithm in SwitchingOperation of Substation,” in Proc. 2023 2nd Int. Conf. 3D Immersion,Interaction and Multi-Sensory Experiences (ICDIIME), pp. 136-140, 2023.
E. H. Ali Kadry, “Applications of Virtual Reality Technologies in theField of Design and Arts,” Int. J. Multidisciplinary Studies in Art andTechnology, 2023.
G. Yue and H. Yin, “Research on Concurrent Design Method ofElectronic Products and Virtual Prototype Simulation EnvironmentBased on Virtual Reality,” in Proc. 2022 2nd Int. Conf. Networking,Communications and Information Technology (NetCIT), pp. 371-374, 2022.
P. N. Son, “The Current State of Virtual Reality and AugmentedReality Adoption in Vietnamese Education: A Teacher’s Perspectiveon Teaching Natural Sciences,” Int. J. Information and EducationTechnology, 2024.
H. Chen, N. Zhang, D. Chen, J. Gao, V. Sirivesmas, and Y. Wang, “AComparative Study of Virtual Reality Combined with Eye MovementMeasurement in the Design Teaching Process,” J. Electrical Systems,2024.
Z. Xu, Z. X. Zhao, M. H. Wu, J. Liao, and G. Tian, “Virtual RealityBased Robot Graphic Simulation and Virtual ManufacturingSystem,” 1997.
Y. Liu, A. Kukkar, and M. A. Shah, “Study of Industrial InteractiveDesign System Based on Virtual Reality Teaching Technology inIndustrial Robot,” Paladyn, J. Behavioral Robotics, vol. 13,pp. 45-55, 2022.
S. R. Sabbella, S. Kaszuba, F. Leotta, and D. Nardi, “Virtual RealityApplications for Enhancing Human-Robot Interaction: A GestureRecognition Perspective,” in Proc. 23rd ACM Int. Conf. IntelligentVirtual Agents, 2023.
Z. Xuhui, D. Runlin, and L. Yongwei, “VR-based Remote ControlSystem for Rescue Detection Robot in Coal Mine,” in Proc. 201714th Int. Conf. Ubiquitous Robots and Ambient Intelligence (URAI),pp. 863-867, 2017.
L. Yang, X. Yang, and K. He, “The Research on Mobile RobotSimulation and Visualization under Virtual Reality,” in Proc. ICICS,1997 Int. Conf. Information, Communications and Signal Processing.Theme: Trends in Information Systems Engineering and WirelessMultimedia Communications (Cat. 1), vol. 1, pp. 390-396, 1997.
N. Anand and B. tech, “Evolution of Robotics,” 2021.
E. Garcia, M. A. Jiménez, P. G. Santos, and M. A. Armada, “TheEvolution of Robotics Research,” IEEE Robotics & AutomationMagazine, vol. 14, pp. 90-103, 2007.
Z. Xu, Z. X. Zhao, M. H. Wu, J. Liao, and G. Tian, “Virtual RealityBased Robot Graphic Simulation and Virtual ManufacturingSystem,” 1997.
L. Yang, X. Yang, and K. He, “The Research on Mobile RobotSimulation and Visualization under Virtual Reality,” in Proc. ICICS,1997 Int. Conf. Information, Communications and Signal Processing.Theme: Trends in Information Systems Engineering and WirelessMultimedia Communications (Cat. 1), vol. 1, pp. 390-396, 1997.
S. Suzie, R. Kardong-Edgren, S. L. Farra, G. Alinier, and M. H.Young, “Toward a Unified Definition of Virtual Reality,” 2019.
I. Horváth, Á. B. Csapó, B. Berki, A. Sudar, and P. Z. Baranyi,“Definition, Background and Research Perspectives Behind‘Cognitive Aspects of Virtual Reality’ (cVR),” Infocommunications Journal, 2023.
M. M. Pernekulova, A. Sagikyzy, Z. B. Ashirbekova, D.Zhanabayeva, and G. Abdurazakova, “Definition of Virtual Realitythrough Creative Act,” Academic Journal of Interdisciplinary Studies, vol. 10, pp. 176, 2021.
G. Zhen-bang, “Discussing the Definition of Virtual Reality (VR),”Computer Simulation, 2006.
W. R. Sherman and A. B. Craig, Understanding Virtual Reality:Interface, Application, and Design, Morgan Kaufmann, 2018.
P. Fuchs, G. Moreau, and P. Guitton, Virtual Reality: Concepts andTechnologies, CRC Press, 2011.
J. Jerald, The VR Book: Human-Centered Design for Virtual Reality, Morgan & Claypool Publishers, 2015.
R. T. Azuma, “A Survey of Augmented Reality,” Presence:Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 355-385, 1997. doi: 10.1162/pres.1997.6.4.355.
P. Milgram and F. Kishino, “A Taxonomy of Mixed Reality VisualDisplays,” IEICE Trans. Information and Systems, vol. 77, no. 12, pp. 1321-1329, 1994.
C. Anthes, R. J. García-Hernández, M. Wiedemann, and D.Kranzlmüller, “State of the Art of Virtual Reality Technology,” inProc. 2016 IEEE Aerospace Conference, pp. 1-19, 2016. doi:10.1109/AERO.2016.7500674.
H. H. Genç, S. Aydin, and H. Erdal, “Design of Virtual RealityBrowser Platform for Programming of Quantum Computers via VRHeadsets,” in Proc. 2020 Int. Congr. Human-Computer Interaction,Optimization and Robotic Applications (HORA), pp. 1-5, 2020.
F. Zhou, H. B. L. Duh, and M. Billinghurst, “Trends in augmentedreality tracking, interaction and display: A review of ten years ofISMAR,” in Proc. 7th IEEE/ACM Int. Symp. Mixed and AugmentedReality, pp. 193-202, 2008. doi: 10.1109/ISMAR.2008.4637362.
A. Steed and M. F. Oliveira, Networked Graphics: BuildingNetworked Games and Virtual Environments, Morgan Kaufmann,2009.
N. S., “360-Degree Virtual Reality,” Int. Scientific J. Engineering and Management, 2023.
M. Chaabani, Y. Ghozzi, and R. Ktari, “Visualizing Health: VirtualEyewear Try-On Shaping Informed Medical Choices,” in Proc. 2023IEEE Afro-Mediterranean Conf. Artificial Intelligence (AMCAI),pp. 1-9, 2023.
S. Oh and T. Shon, “Digital Forensics for Analyzing Cyber Threats inthe XR Technology Ecosystem within Digital Twins,” Electronics, 2024.
S. Mortezapoor and K. Vasylevska, “Safety and Security Challengesfor Collaborative Robotics in VR,” 2021.
A. H. Shamsuzzoha, P. T. Helo, and T. Kankaanpaa, “DigitalManufacturing Transformation: Integration of Virtual Reality andRobotics for Safer Industrial Operations,” 2019.
D. T. Le, S. Sutjipto, Y. Lai, and G. Paul, “Intuitive Virtual RealityBased Control of a Real-world Mobile Manipulator,” in Proc. 202016th Int. Conf. Control, Automation, Robotics and Vision (ICARCV), pp. 767-772, 2020.
N. N., J. A. S., M. G. A., F. F., and L. A. M., “Optimizing RoboticAutomatic Suturing Through VR-Enhanced Data Generation forReinforcement Learning Algorithms,” in Proc. 2024 IEEE Int. Conf.Artificial Intelligence and eXtended and Virtual Reality (AIxVR), pp.375-381, 2024.
S. Ou, W. Sung, and S. Hsiao, “Development of Intelligent VirtualReality Web-Based Robotics for Manufacturing Applications,” inProc. 2002 IEEE Int. Conf. Industrial Technology (ICIT), vol. 1, pp.348-353, 2002.
Y. Lei, Z. Su, and C. Cheng, “Virtual Reality in Human-RobotInteraction: Challenges and Benefits,” Electronic Research Archive,2023.
T. Inamura and Y. Mizuchi, “SIGVerse: A Cloud-Based VR Platformfor Research on Multimodal Human-Robot Interaction,” Frontiers inRobotics and AI, vol. 8, pp. 549360, 2021. doi: 10.3389/frobt. 2021.549360.
C. Wong, E. Yang, X.-T. Yan, and D. Gu, “An overview of roboticsand autonomous systems for harsh environments,” in Proc. 2017 23rd Int. Conf. Automation and Computing (ICAC), Huddersfield, UK,pp. 1-6, 2017. doi: 10.23919/IConAC.2017.8082020.
J. Suarez and R. R. Murphy, “Hand Gesture Recognition with DepthImages: A Review,” in Proc. 2012 IEEE RO-MAN: 21st IEEE Int.Symp. Robot and Human Interactive Communication, Paris, France,pp. 411-417, 2012. doi: 10.1109/ROMAN.2012.6343787.
H.-B. Kuntze et al., “SENEKA - Sensor Network with Mobile Robots for Disaster Management,” in Proc. 2012 IEEE Conf. Technologiesfor Homeland Security (HST), Waltham, MA, USA, pp. 406-410, 2012. doi: 10.1109/THS.2012.6459883.
R. R. Murphy, “Human-Robot Interaction in Rescue Robotics,” IEEETrans. Systems, Man, and Cybernetics, Part C (Applications andReviews), vol. 34, no. 2, pp. 138-153, May 2004. doi: 10.1109/TSMC C.2004.826267.
W. Burgard, M. Moors, C. Stachniss, and F. E. Schneider,“Coordinated Multi-Robot Exploration,” IEEE Trans. Robotics, vol.21, no. 3, pp. 376-386, June 2005. doi: 10.1109/TRO.2004.839232.
S. Lysenko and A. Kachur, “Challenges Towards VR Technology:VR Architecture Optimization,” in Proc. 2023 13th Int. Conf.Dependable Systems, Services and Technologies (DESSERT), pp. 1-9,2023.
Y. Ouyang et al., “AIoT and VR-Based Technology for RobotsControl in Critical Safety Environments: Challenges andOpportunities,” in Proc. 2024 IEEE Int. Conf. Industrial Technology(ICIT), pp. 1-6, 2024.
F. Covaciu et al., “VR Interface for Cooperative Robots Applied inDynamic Environments,” in Proc. 2018 IEEE Int. Conf. Automation,Quality and Testing, Robotics (AQTR), pp. 1-6, 2018.
A. S. N. Husainy et al., “Robotic Solutions for Air Duct Cleaning: AnOverview of Current Research and Applications,” Asian Review ofMechanical Engineering, vol. 11, no. 2, pp. 27-31, 2022.doi: 10.51983/arme-2022.11.2.3638.
A. S. N. Husainy et al., “Medical Additive Manufacturing:Challenges and Features,” Asian Review of Mechanical Engineering, vol. 12, no. 1, pp. 15-23, 2023. doi: 10.51983/arme-2023.12.1.3658.
J. Bares and D. S. Wettergreen, “Dante II: Technical Description,Results, and Lessons Learned,” The International Journal of RoboticsResearch, vol. 18, pp. 621-649, 1999.
D. M. A. Ahad, R. Basak, and A. Jannat, “Modeling andImplementation of a Mobile Robotic Arm for Industrial Tasks,”American academic & scholarly research journal, vol. 5, pp. 70,2013.
L. W. Thornblade and Y. Fong, “Simulation-Based Training inRobotic Surgery: Contemporary and Future Methods,” JLaparoendosc Adv Surg Tech A, vol. 31, no. 5, pp. 556-560, Apr.2021.
M. V. Mikhailyuk, A. V. Maltsev, A. V. Timokhin, E. V. Strashnov,B.Kryuchkov, and V. Usov, “Virtual Environment Systems forSimulating Robots in Manned Space Flights,” Manned Spaceflight, pp. 61-75, 2020.
S. Singh et al., “Recent progress in local and global traversability forplanetary rovers,” in Proc. 2000 ICRA. Millennium Conference. IEEEInternational Conference on Robotics and Automation. SymposiaProceedings (Cat. No. 00CH37065), vol. 2, pp. 1194-1200, 2000.
M. S. Kadavasal and J. H. Oliver, “Sensor Augmented Virtual RealityBased Teleoperation Using Mixed Autonomy,” J. Comput. Inf. Sci.Eng., vol. 9, 2009.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 The Research Publication
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
