By: Shilpa Shahapur, Nyamatulla Patel, and Mohammed Ziaullah Choudhari
1-Student, Department of MCA, Secab Institute of Engineering and Technology, Vijayapur, Karnataka, India
2-Associate Professor, Department of MCA, Secab Institute of Engineering and Technology, Vijayapur, Karnataka, India.
3-Associate Professor, Department of Electronics and Communication Engineering, Secab Institute of Engineering and Technology Vijayapur,Karnataka, India.
Traffic sign recognition is a crucial component of intelligent transportation systems, significantly enhancing road safety by aiding both autonomous and human drivers. This paper presents a convolutional neural network-based traffic sign recognition system integrated with voice alerts. Our approach utilizes a deep learning model trained on a comprehensive dataset of traffic signs to accurately identify various road signs in realtime. Upon recognition, the system issues corresponding voice alerts to inform the driver, thus providing a hands-free method of ensuring road awareness. The idea for a system is designed in a modular fashion, with distinct phases encompassing data collection, preprocessing, model training, real-time recognition, and voice alerts. An extensive dataset of road signals pictures is collected and pre-processed to standardize the data’s size and quality. A custom convolutional neural network architecture is then developed to extra hierarchical features from the images and performs accurate classification. The convolutional neural network model is meticulously designed to balance high accuracy with computational efficiency, making it practical for real-world applications. The results from experiments indicate the system’s high reliability and effectiveness across various conditions, underlining its potential to reduce traffic incidents and enhance overall traffic management. This integration of convolutional neural network -driven visual recognition with auditory feedback offers a promising advancement in the field of driver assistance system.
Keywords: CNN, accident detection, road signals, visual recognition, vehicles, deep learning, intelligent transportation systems
Citation:
Refrences:
- De La Escalera A, Moreno LE, Salichs MA, Armingol JM. Road traffic sign detection and classification. IEEE Transac Indust Electron. 1997;44(6):848–59.
- Mathias M, Timofte R, Benenson R, Van Gool L. Traffic sign recognition—how far are we from the solution? In: 2013 International Joint Conference on Neural Networks (IJCNN). 2013, Aug 4. pp. 1–8. IEEE.
- Nguyen H. Fast traffic sign detection approach based on lightweight network and multilayer proposal network. J Sens. 2020;2020(1):8844348.
- Ansari S, Akhdar F, Mandoorah M, Moutaery K. Causes and effects of road traffic accidents in Saudi Arabia. Public health. 2000;114(1):37–9.
- Zhang J, Zou X, Kuang LD, Wang J, Sherratt RS, Yu X. CCTSDB 2021: a more comprehensive traffic sign detection benchmark. Human-cent Comput Inform Sci. 2022;12.
- Shao F, Wang X, Meng F, Rui T, Wang D, Tang J. Real-time traffic sign detection and recognition method based on simplified Gabor wavelets and CNNs. Sensors. 2018;18(10):3192.
- Sukhani K, Shankarmani R, Shah J, Shah K. Traffic sign board recognition and voice alert system using convolutional neural network. In: 2021 2nd International Conference for Emerging Technology (INCET). 2021, May 21. pp. 1–5. IEEE.
- Kaushik B, Sharma R, Dhama K, Chadha A, Sharma S. Performance evaluation of learning models for intrusion detection system using feature selection. J Comp Virol Hack Techn. 2023;19(4):529–48.
- Manawadu M, Wijenayake U. Voice-assisted real-time traffic sign recognition system using convolutional neural network. arXiv preprint arXiv:2404.07807. 2024 Apr 11.
- Dean HN, Jabir KV. Real time detection and recognition of Indian traffic signs using Matlab. Int J Scient Engin Res. 2013;4(5):684–90.
- Shi JH, Lin HY. A vision system for traffic sign detection and recognition. In: 2017 IEEE 26th International Symposium on Industrial Electronics (ISIE). 2017, Jun 19. pp. 1596–1601. IEEE.
- Boujemaa KS, Berrada I, Bouhoute A, Boubouh K. Traffic sign recognition using convolutional neural networks. In: 2017 International Conference on Wireless Networks and Mobile Communications (WINCOM). 2017, Nov 1. pp. 1–6. IEEE.
- Stanley KO, Miikkulainen R. Evolving neural networks through augmenting topologies. Evolut Comp. 2002;10(2):99–127.
- Yadav S, Patwa A, Rane S, Narvekar C. Indian traffic signboard recognition and driver alert system using machine learning. Int J Appl Sci Smart Technol. 2019;1(1):1–0.
- Hong CY, Lin CY, Shih TK. Automatic signboard detection and semi-automatic ground truth generation. In: 2019 Twelfth International Conference on Ubi-Media Computing (Ubi-Media). 2019, Aug 5. pp. 256–61. IEEE.
- Bi Z, Yu L, Gao H, Zhou P, Yao H. Improved VGG model-based efficient traffic sign recognition for safe driving in 5G scenarios. Int J Mach Learn Cybernet. 2021;12:3069–80.
- Cao J, Song C, Peng S, Xiao F, Song S. Improved traffic sign detection and recognition algorithm for intelligent vehicles. Sensors. 2019;19(18):4021.
- Wali SB, Abdullah MA, Hannan MA, Hussain A, Samad SA, Ker PJ, et al. Vision-based traffic sign detection and recognition systems: current trends and challenges. Sensors. 2019;19(9):2093.
- Santos A, Abu PA, Oppus C, Reyes RS. Real-time traffic sign detection and recognition system for assistive driving. 2020;5(4):600–11.
- Loce RP, Bala R, Trivedi M, Wiley J, editors. Computer vision and imaging in intelligent transportation systems. Wiley; 2017.