Improving augmented reality with the help of deep learning methods in the tourism industry

Document Type : Original Article

Authors

1 Department of computer engineering, Qom university of technology, Qom, Iran

2 Student, Department of computer science, Islamic Azad University, Naragh Branch, Iran

3 Faculty member, Department of computer science, Islamic Azad University, Naragh Branch, Iran

4 Department of Industrial Engineering, University of Qom, Qom, Iran

Abstract

From an economic point of view, the tourism industry has a special place. Especially in the single-product economy of Iran, it can be used as the best and most optimal alternative to oil. Augmented reality technology is one of the world's newest and most up-to-date applied technologies, highly regarded today. This research focuses on augmented reality and its patterns. This research aims to investigate and develop a practical pattern identification of augmented reality (ar) and its tracking in the tourism industry. Designs are provided by capturing the position and orientation of the device and its location using sensors and Computer vision with screen technology (augmented reality guide). A guide is designed, implemented, and evaluated as an augmented reality application on a mobile phone. The proposed solution has been using deep learning in marker identification. The deep learning architecture used is Yolo, and the proposed method's marker identification results have an accuracy of 68.73 maps

Keywords

Main Subjects

References

[1] Z. Cao, T. Simon, S. E. Wei, Y. Sheikh, Realtime multi-person 2d pose estimation using part affinity fields. In Proceedings of the IEEE Conference on computer vision and pattern recognition, 2017, 7291-7299.
[2] C. Chen, A. Seff, A. Kornhauser, J. Xiao, Deepdriving: Learning affordance for direct perception in autonomous driving. In Proceedings of the IEEE international conference on computer vision, 2015, 2722-2730.
[3] D. Chen, S. Ren, Y. Wei, X. Cao, J.Sun. Joint cascade face detection and alignment. In Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, Proceedings, Part VI 13, 2014, 109-122. Springer International Publishing.
[4] X. Chen, H. Ma, J. Wan, B. Li, T. Xia, Multi-view 3d object detection network for autonomous driving. In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, 2017, 1907-1915.
[5] N. Dalal, B. Triggs, Histograms of oriented gradients for human detection. In 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05), 1, 2005, 886-893.
[6] P. Dollar, C. Wojek, B. Schiele, P. Perona, Pedestrian detection: An evaluation of the state of the art. IEEE transactions on pattern analysis and machine intelligence, 34(4) 2011, 743-761.
[7] A. Dundar, J. Jin, B. Martini, E. Culurciello, Embedded streaming deep neural networks accelerator with applications. IEEE transactions on neural networks and learning systems, 28(7) 2016, 1572-1583.
[8] M. Everingham, The PASCAL visual object classes challenge 2009 (VOC2009) results, 2007.
[9] PF. Felzenszwalb, RB. Girshick, D. McAllester, D. Ramanan. Object detection with discriminatively trained part-based models. IEEE transactions on pattern analysis and machine intelligence, 32(9) 2009, 1627-1645.
[10] R. Girshick, J.Donahue, T.Darrell, J.Malik, Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2014, 580-587.
[11] GE. Hinton, N.Srivastava, A. Krizhevsky, I. Sutskever, RR. Salakhutdinov, Improving neural networks by preventing co-adaptation of feature detectors. arXiv preprint arXiv:1207.0580, 2012.
[12] SH. Hsu, HT. Hung, YQ. Lin, CM. Chang, Defect inspection of indoor components in buildings using deep learning object detection and augmented reality. Earthquake Engineering and Engineering Vibration, 2023, 1-14.
[13] S. Ioffe, C. Szegedy, Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International conference on machine learning, 2015, 448-456.
[14] Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, T. Darrell, Caffe: Convolutional architecture for fast feature embedding. In Proceedings of the 22nd ACM international conference on Multimedia, 2014, 675-678.
[15] H. Jiang, E. Learned-Miller, Face detection with the faster R-CNN. In 2017 12th IEEE international conference on automatic face & gesture recognition, 2017, 650-657.
[16] K. Kavukcuoglu, P. Sermanet, YL. Boureau, K. Gregor, M. Mathieu, Y. Cun, Learning convolutional feature hierarchies for visual recognition. Advances in neural information processing systems, 2010, 23.
[17] H. Kobatake, Y. Yoshinaga, Detection of spicules on mammogram based on skeleton analysis. IEEE Transactions on Medical Imaging, 15(3) 1996, 235-245.
[18] A. Kontogianni, E. Alepis, C. Patsakis. Smart tourism and artificial intelligence: Paving the way to the post-covid-19 era. Advances in Artificial Intelligence-based Technologies: Selected Papers in Honour of Professor Nikolaos G. Bourbakis, 1 2022, 93-109.
[19] A. K rizhevsky, I. Sutskever, G.E. Hinton, Image Net classification with deep convolutional neural networks. Advances in neural information processing systems, 25(2) 2012, 1097-1105.
[20] Y. LeCun, Y. Bengio, G. Hinton, Deep learning, Nature, 521(7553) 2015, 436-444.
[21] W. Li, J. Wang, M. Liu, S. Zhao, X. Ding, Integrated Registration and Occlusion Handling Based on Deep Learning for Augmented Reality Assisted Assembly Instruction. IEEE Transactions on Industrial Informatics, 2022.
[22] C. Liu, H. Zhu, D. Tang, Q. Nie, T. Zhou, L. Wang, Y. Song, Probing an intelligent predictive maintenance approach with deep learning and augmented reality for machine tools in IoT-enabled manufacturing, Robotics and Computer-Integrated Manufacturing, 77 2022, 102357.
[23] N. Liu, J. Han, D. Zhang, S. Wen, T. Liu, Predicting eye fixations using convolutional neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, 362-370.
[24] DG. Lowe, Distinctive image features from scale-invariant keypoints. International journal of computer vision, 60, 2004, 91-110.
[25] W. Luo, L. Zhang, Question text classification method of tourism based on deep learning model. Wireless Communications and Mobile Computing, 2022, 1-9.
[26] S. Murugan, A. Sampathkumar, S. Kanaga Suba Raja, S. Ramesh, R. Manikandan, D. Gupta, Autonomous Vehicle Assisted by Heads up Display (HUD) with Augmented Reality Based on Machine Learning Techniques. In Virtual and Augmented Reality for Automobile Industry: Innovation Vision and Applications, 2022,45-64.
[27] W. Pitts, WS. McCulloch, How we know universals the perception of auditory and visual forms. The Bulletin of mathematical biophysics, 9 1947, 127-147.
[28] V. Puri, S. Mondal, S. Das, VG. Vrana, Blockchain Propels Tourism Industry-An Attempt to Explore Topics and Information in Smart Tourism Management through Text Mining and Machine Learning. In Informatics, 10(1) 2023.
[29] J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on computer vision and pattern recognition, 2016, 779-788.
[30] S. Ren, K. He, R. Girshick, J. Sun, Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 2015, 28.
[31] DE. Rumelhart, GE. Hinton, RJ. Williams, Learning representations by back-propagating errors. nature, 323(6088) 1986, 533-536.
[32] A. Stuhlsatz, J. Lippel, T. Zielke, Feature extraction with deep neural networks by a generalized discriminant analysis. IEEE transactions on neural networks and learning systems, 23(4) 2012, 596-608.
[33] KK. Sung, T. Poggio, Example-based learning for view-based human face detection. IEEE Transactions on pattern analysis and machine intelligence, 20(1) 1998, 39-51.
[34] FM. Wadley, Probit analysis: a statistical treatment of the sigmoidresponse curve, Annals of the Entomological Soc. Of America, 67(4) 1974, 549–553.
[35] R. Wang, F. Bunyak, G. Seetharaman, K. Palaniappan, Static and moving object detection using flux tensor with split Gaussian models. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2014, 414-418.
Mathematics and Computational Sciences
Volume 4, Issue 2
June 2023
Pages 33-45

Files

History

  • Receive Date: 04 May 2023
  • Revise Date: 29 May 2023
  • Accept Date: 31 May 2023

Share

How to cite

Statistics