Loading menu…

Artificial Vision Prototype for People and Vehicle Characteristics Recognition

Artificial Vision Prototype for People and Vehicle Characteristics Recognition

Article Fingerprint

ReserarchID

RVT3P

Artificial Vision Prototype for People and Vehicle Characteristics Recognition Banner

Key Research Insights

Synthesized scholarly intelligence & interactive research assistant
  • English
  • Afrikaans
  • Albanian
  • Amharic
  • Arabic
  • Armenian
  • Azerbaijani
  • Basque
  • Belarusian
  • Bengali
  • Bosnian
  • Bulgarian
  • Catalan
  • Cebuano
  • Chichewa
  • Chinese (Simplified)
  • Chinese (Traditional)
  • Corsican
  • Croatian
  • Czech
  • Danish
  • Dutch
  • Esperanto
  • Estonian
  • Filipino
  • Finnish
  • French
  • Frisian
  • Galician
  • Georgian
  • German
  • Greek
  • Gujarati
  • Haitian Creole
  • Hausa
  • Hawaiian
  • Hebrew
  • Hindi
  • Hmong
  • Hungarian
  • Icelandic
  • Igbo
  • Indonesian
  • Irish
  • Italian
  • Japanese
  • Javanese
  • Kannada
  • Kazakh
  • Khmer
  • Korean
  • Kurdish (Kurmanji)
  • Kyrgyz
  • Lao
  • Latin
  • Latvian
  • Lithuanian
  • Luxembourgish
  • Macedonian
  • Malagasy
  • Malay
  • Malayalam
  • Maltese
  • Maori
  • Marathi
  • Mongolian
  • Myanmar (Burmese)
  • Nepali
  • Norwegian
  • Pashto
  • Persian
  • Polish
  • Portuguese
  • Punjabi
  • Romanian
  • Russian
  • Samoan
  • Scots Gaelic
  • Serbian
  • Sesotho
  • Shona
  • Sindhi
  • Sinhala
  • Slovak
  • Slovenian
  • Somali
  • Spanish
  • Sundanese
  • Swahili
  • Swedish
  • Tajik
  • Tamil
  • Telugu
  • Thai
  • Turkish
  • Ukrainian
  • Urdu
  • Uzbek
  • Vietnamese
  • Welsh
  • Xhosa
  • Yiddish
  • Yoruba
  • Zulu
Reading Preferences
Font Size
Line Spacing
Background
This converted HTML version may contain rendering inconsistencies. Please refer to the PDF for the authoritative version, or click here to provide feedback.

Abstract

In a world increasingly connected with technology and with the growing need for security in all aspects of life, and the need of security in the transport of child in educational establishments is a great challenge. In other areas, the need of security in areas such as hospitals, parking lots, securities transporters, airports, etc. This solution aims to recognize patterns (vehicle plates) and characteristics (facial patterns); one of the main premises of the prototype was the use of free software to create a successful, low cost and easy-to-use solution.

I. INTRODUCTION

The prototype was created to provide an accurate and easy solution in security. With this prototype, different schools can know about different characteristics of drivers and vehicles that provide school route service, providing a validation tool that can be integrate with the mobility registration system. A recognition of facial patterns and features can be made all of this supported by free software recognition libraries, through 128-point feature vectors which makes face representation for comparison. Allowing it to be easy to use and a low cost solution it will be apply in a number of scenarios making it scalable. Enhancing the centralization of data by using a distributed database generating availability and a higher security level.

II. ANALYSIS STAGE

An analysis of the chosen hardware and software architecture is carry out, and the scope and limitations of this are defined for subsequent implementation. The main objective is design an artificial vision prototype for facial recognition of drivers and school route plates for entry and/or exit from the institution.

III. DESIGN STAGE

The recognition of the involved agents with the system is developed and the interaction between these with the prototype. Besides relating the model of hardware and software of the system, it is divide in the Software component and Hardware component.

IV. HARDWARE MODEL

This item is scalable and configurable since inside this prototype is necessary to build a hardware component, which would allow the driver to move into the institution when start the validation circuit of the prototype (IP camera and the rest of the services of facial recognition and registration). This component consists of a circuit with an Arduino card given the capacity of interaction that it can have with the system. It could be easily adapted to systems of sensors, automatic doors, registers and other access devices.

V. SOFTWARE MODEL

The software make the interaction of the system with the final user. The system has components of graphic interface where the administration and the configuration modules will be visualize besides seeing the alerts with each one of the different entries that occur. The development with free and open source technologies such as Python, Java, JSF, Java programming languages were used with free distribution tools for its development such as NetBeans, notepad++, VisualStudioCode, Mysql database engine and Maria DB.

VI. DATABASE MODEL

The database modeling is an important point in the software development since it is from this design that the system's planning and interaction begins in addition to managing the distributed database to maintain the reliability and availability standards required for proper operation. The MARIA DB database engine was used with a GPL license in which the configuration is carry out in order to establish the distributed database.

VII. SYSYTEM AGENTS

User interactions were defined for this system and the specifications may change according to the environment to be used with the Hardware and Software solution.

Table 1: Definition of System Agents.
AgentDescription
AdminResponsible for the administration of alerts, personnel and vehicles authorized to enter to the institution.
WatchmanAgent who receives notifications of unauthorized entry into the institution, person responsible for granting or refusing entry into and/or leaving the institution
DriverAgent that interacts with the system through the Arduino board.

VIII. ARCHITECTURE

It is indispensable to think about a good architecture because it defines a path to begin to build the system. The way in which the components will interact with other systems or libraries and thus achieve the main objective to have a functional prototype ready for implementation. The used libraries and protocols are OpenALPR, OpenCV and RSTP. OpenALPR is an open source library used in automatic license plate pattern recognition written in C++ with links in C#, Java, Node.js, Go and Python. The library analyzes images and video sequences to identify license plate patterns. OpenCV is a free machine vision library originally developed by Intel. It contains more than 500 functions that cover a wide range of areas in the vision process such as facial recognition, camera calibration, stereo vision and robotic vision. RSTP (Real Time Streaming Protocol) is a non-connection-oriented protocol. The server maintains a session associated with an identifier in most cases RTSP uses TCP for player control data and UDP for audio and video data.

IX. LICENSE PLATE RECOGNITION WITH OPENALPR

We use OpenALPR library, which is an open source library that helps the automatic recognition of license plates. It operates for the video stream as follows: The image flow will be constantly extract from the IP camera in MJPEG format through RTSP on a video format, and OpenALPR will start the validation. The agent will start the process automatically and the library processes the flow as fast as possible while searching for plate images. When the plates are detect, the information will be write to a local beanstalk queue as JSON data. The library save the image in a configurable location as a jpeg image and run a separate process that empty the beanstalk queue upload the data to the server via HTTP. This library works with OpenCV for character recognition.

source: https://www.pyimagesearch.com/2018/09/17/ Figure 1: Pipeline for Opencv

X. FACE RECOGNITION

This library built in python from the Dlib toolkit made in C++ contains deep learning algorithms, which allows to model abstractions providing accurate results reaching good accuracy model. There are different methods for face comparison such as the waterfall, which analyzes hundreds of small patterns and characteristics that must match, similar to detecting a fingerprint but this method is not suitable due to its impossibility of detecting profiled faces or low occlusion. Others based on deep metric learning rely on 128-point characteristic vectors making a representation of the face are used in this prototype. The algorithms can be accurate with the right distance threshold between points.

Source: https://encryptedtbn0.gstatic.com/images?q=tbn:AND9GcSOM Figure 2: Dotted vector

The following steps identify the one face: The face detection model identifies the face's location inside the image. The embedding fed modelis use to obtain a vector of facial characteristics of size 128 points. It compares this vector with those of its "friends" and finds the most similar.

Source: https://miro.medium.com/max/700/1*R-ObQiGjDK4Njd5tSQEz5g.png Figure 3: Recognition cycle XI. IMPLEMENTATION STAGE

The infrastructure defined for the system operation as shown in the below figure. Figure 4. Implementation of the prototype

Source: Authors

The prototype has components of hardware y software that interoperate in this form: Arduino Wiring: This code is stored in Arduino's microcontroller to start the request and begin the whole process. It can be replace by the access component that the application requires. Python Code: It is the backend of the application where the processing of the images and comparison of these are located. Java Code: It is the frontend of the system since it provides a friendly interface to the Administrator and Watchman actors that make up the system. To have a better view of the system operation the following diagram has been validate.

Source: Authors

Figure 5: Prototype Overview

XII. HARDWARE AND SOFTWARE INTEGRATION

We make the two components interact with each other and give functionality to the final product and the following elements were defined for its operation: The Hardware model, Job and Web Services and Web Application (JEE).

XIII. TEST STAGE

The accuracy of a project is defined by the test cycle aim to identify achievements and limitations obtained in the development of the prototype. For this is need a vehicle and a person who will carry out the entry simulation to the institution. When analyzing the image the results are:

Source: Authors

Figure 6: Vehicle Plate Identification

A list of ten possible plates with percentage of accuracy are see. We can obtain from 10 to 50 results. The percentage indicates which characters have more similarity to the image of the vehicle plate so getting the right plate. Regarding facial recognition the first thing to have when starting are images with people faces that are intend to be identify and getting two profiles of the person and a front photo in order to ensure greater accuracy in recognition. With this, the algorithm is able to recognize whether the face to be analyze is the desired person. Some guidelines that must be take into account for proper operation such as the light distance, camera resolution and the number of faces that can appear in the image. The algorithm makes the comparison between previously saved images and the take image for the identification. The validation algorithm returns a vector with the analysis response. If true value is return, means that it recognized a match with one of the base images.

Source: https://github.com/openalpr/openalpr Figure 7: Face Recognition Algorithm

XIV. RESULTS STAGE

The prototype's confidence levels may change with conditions of distance, comparative and luminosity. Recognition levels are high when the prototype has the right photo profiles for optimal comparison. In the plate case found that the prototype could be highly adaptive. The OCR not only recognizes the model of the plates that are hand as standard but also recognizes those parameterized in the system.

XV. CURRENT WORKS

To have a more complete overview of the potential of the Open ALPR tool, which uses OpenCv, it is research and is evident that these libraries have a wide use from implementation of face recognition in major airports, and too be a solution for optimal fruit sorting with high quality standards.

XVI. FUTURE WORKS

This application is highly scalable and modular to be use in other works where it can be integrate in a simple way. The version implements pattern recognition and we can will detect plates from various countries, color, vehicle brand and model; and the library for face recognition can be integrate easily.

XVII. CONCLUSIONS

The face recognition effectiveness ranges between 96% and 99% depending on the image type to be analyzed having a higher effectiveness if it has the three angles of the face which are the 128 point feature vectors for OpenCV works and which it makes the comparison.

The Optical Character Recognition (OCR) component has an effectiveness of approximately 94% that depends on factors such as brightness, image capture angle, camera resolution and that the plate does not have any kind of obstruction because there may be a poor character reading.

These two great components integrated to the software component allow a powerful tool with a high rate of effectiveness where it can be evidenced that with the available tools in its free versions can provide very useful solutions in all common life areas.

References

11 Cites in Article
  1. 1. Adrian Rosebrock (2021). OpenCV OCR and text recognition with Tesseract. OpenCV OCR and text recognition with Tesseract
  2. 2. César Vargas-Torres,Jayro Santiago-Paz (2017). Robot seguidor de línea basado en visión artificial con ROS y OpenCV. Revista de Aplicaciones de la Ingeniería, 1-10.
  3. 3. Rodríguez Guerrero,R Vanegas,C Castang,G (2020). Python a su alcance. Páginas, 100-120.
  4. 4. Diego Heras (2017). Clasificador de imágenes de frutas basado en inteligencia artificial. Killkana Técnica, 1(2), 21.
  5. 5. Dan Landau Sternfeld (2019). Sistemas inteligentes de transporte : conteo e identificación de pasajeros mediante identificación por radiofrecuencia. Sic TransCore Sistemas de Identificación y control vehicular
  6. 6. Gorka Zamarreño Aramendia,Elena Cruz‑ruiz,Elena Ruiz Romero De La Cruz (2026). Cine y enoturismo: la representación del patrimonio vitivinícola y su impacto turístic. PASOS. Revista de Turismo y Patrimonio Cultural, 24(1), 213-234.
  7. 7. Dreidy Vásquez,Oscar Jerez,Rodrigo Schrebler,Carlos Carlesi,Danilo Carvajal,Nelson Cáceres,Ricardo Schrebler (2018). 141 Induction Heating of TiO 2 Coating on SS Substrate for Photocatalysis 2016 60 3 Induction Heating Consolidation of TiO 2 Sol-Gel Coating on Stainless Steel Support for Photocatalysis Applications. Periodica Polytechnica Chemical Engineering, 60(3), 141-151.
  8. 8. R Gonzalez,R Woods (2008). Digital Image Processing. Digital Image Processing
  9. 9. M Nixon,A Aguado (2008). Feature Extraction & Image Processing. Feature Extraction & Image Processing
  10. 10. Sathit Nakkrasae (2012). Software component identification specification and classification using formal method and artificial neural networks. Int. Journ. Eng. Innov. Tech. (IJEIT), 1(3)
  11. 11. M Hassoun (1995). Fundamentals of Artificial Neural Networks. Fundamentals of Artificial Neural Networks

Funding

No external funding was declared for this work.

Conflict of Interest

The authors declare no conflict of interest.

Ethical Approval

No ethics committee approval was required for this article type.

Data Availability

Not applicable for this article.

How to Cite This Article

Fanny Suárez Mosquera, Cristian Dangelis Ballén Martínez, Gerardo Alberto Castang Montiel. 2026. "Artificial Vision Prototype for People and Vehicle Characteristics Recognition". Global Journal of Research in Engineering - B: Automotive Engineering GJRE-B Volume 22 (GJRE Volume 22 Issue B1).

More Citation Formats

Download Citation

Enhanced vehicle recognition using AI vision technology for accurate character and object identification.
Journal Specifications

Crossref Journal DOI 10.17406/gjre

Print ISSN 0975-5861

e-ISSN 2249-4596

Keywords
Classification
GJRE-B Classification DDC Code: 387.7 LCC Code: HE9765
Version of record
v1.2

Issue date
July 6, 2022

Language
English
Order Article Reprint
Experience in AR

Explore published articles in an immersive Augmented Reality environment. Our platform converts research papers into interactive 3D books, allowing readers to view and interact with content using AR and VR compatible devices.

Read in 3D

Your published article is automatically converted into a realistic 3D book. Flip through pages and read research papers in a more engaging and interactive format.

Article Matrices
Total Views: 953
Total Downloads: 51
All Trends

Request Access

Please fill out the form below to request access to this research paper. Your request will be reviewed by the editorial or author team.
X

This is the heading

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.

High-quality academic research articles on global topics and journals.

Artificial Vision Prototype for People and Vehicle Characteristics Recognition

Fanny Mosquera
Fanny Mosquera
Cristian Martínez
Cristian Martínez
Gerardo Montiel
Gerardo Montiel