Volume 7, Issue 8, August 2022 International Journal of Innovative Science and Research Technology

ISSN No:-2456-2165

Design & Development of Multifunctional

Robot for Surveillance Applications
1
Dr. Bhagya R., 2Sushmitha B., 3Mallika Gowda L.
1
Associate Professor at Dept of ETE
1,2,3
Department of Telecommunication engineering,
Rashtreeya Vidyalaya College of Engineering, Bengaluru, Karnataka, India

Abstract:- The recent digital revolution has resulted in In addition, human detection of a missing person is
more integration of robots than ever before in various proposed using GPS interfacing with the ESP32
domains such as agriculture, medicine, industry, military, microcontroller. Also, by implementing a setup of
police, and logistics. Autonomous robots are one of the headphones to assist and decide the operation, the
most powerful fields. One of the most potent disciplines is information can be reached to disable it.
autonomous robots. Numerous open-source communities,
where the Raspberry Pi is primarily employed in multi- II. LITERATURE SURVEY
utility or multi-functional robotic projects, would benefit
from this. The robot formerly had both a GSM modem The robot is constructed in such a manner that the user
and a GPS receiver. A robotic system powered by a may controll wirelessly using Wi-Fi technology. A PIR
Raspberry Pi has been proposed to identify intruders and sensor is being used to detect presence of person or obstacle,
alert the control panel. also a camera was linked to the robotic system in order to
capture andidentify the intruder's face. As a result, the robot
Keywords:- Raspberry Pi, ESP32, GPS, GSM, provides security in remote areas which significantly reduces
multifunctionalsurveillance application. human loss [1].

I. INTRODUCTION Sensors and cameras were accustomed detect and

recognize humans, objects, and etc. The vehicle is being
The latest digital rise has led robots to become designed to figure productively in common spaces, like the
integrated over ever into different domains. Robots are military. This robot is use to spot the quantity of terrorists
dedicated to serving, facilitating and enhancing human life. within the building, weapons used, bombs, etc. Raspberry Pi
However, many incidents are occurring, resulting in serious uses the Raspbian software system. The Pi board controls
injuries and devastating impacts like the unnecessary loss of movement and gathers details via sensors and a camera,
human lives. which was want to stream real-time video of the surroundings
to the operator [2].
Single-purpose robots for specific tasks are ineffective,
whereas multi-functional robots are effective in solving Instead of physical surveillance, the system [3] aids in
today's challenges, being cost-effective and increasing an the detection of any spy hiding inside the group. This is
organization's productivity. Autonomous robots are one in possible by utilizing an application that gathers data from
every of the foremost powerful fields. Several systems and surveillance cameras and then applies facial recognition.
techniques are examined are excecuted on the Raspberry Pi. Algorithms for identification and recognition of strangers.
This can help many open-source communities, where the When an intruder is discovered, officials are contacted
Raspberry Pi is generally utilized in multi-utility or multi- quickly and necessary action is taken.
functional robotic applications.
In [4] robot consists of five separate systems, including
In the past, the robot was equipped with a GPS receiver robotic arms for picking and placing items from conveyor
and a GSM modem. Sensor data, GPS coordinates, and belts. A fire sensor detects fires and sounds an alarm in the
images captured are continuously transmitted to the control immediate area. GPS longitude and latitude values are used
station. The real-time position of the robot can be seen on a to pinpoint the exact location of the robotic system. Later
webpage that is accessible from anywhere using Google maps robot, send the same data and transmitted across a network
API. To overcome the challenges, a robotic system based on and it is displayed on the LCD. The system also sends a GSM
Raspberry Pi has been developed to predict intruders and alert message, which is delivered by mobile.
the control room. This system is proposed to usesensors for
face recognition, metal detection, ground depth for robot III. LITERATURE GAP
mobility and fire detection. These autonomous robots have
the added advantage of movement and direct interaction with According to a review of the literature [1–4], the robot
the surrounding environment. was equipped with a GPSreceiver and a GSM modem. Sensor
data, GPS coordinates, and images capturedare continuously
transmitted to the control station. The real-time position of
the robot can be seen on a webpage that is accessible from
anywhere using the Google Maps API. However, in this
project, a multifunctional robot is constructed in such a

IJISRT22AUG207 www.ijisrt.com 1986

Volume 7, Issue 8, August 2022 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
manner that the registered person's precise location can be IV. PROPOSED METHODOLOGY
determined. A set of headphones for the disabled has been
created to send alert messages in text and voice. To ensure The system is constantly scanning the surrounding area
complete security, the proposed robotalso describes various for human facial data. If the identified individual is known,
sensors that send alert messages. the system shows his or her name. When the detected person
is unknown, that is, when the database does not match, the
robot sends an alert message in text and voice.

Fig. 1: Block diagram of smart rescue robot of military application

The schematic diagram of Smart Rescue robot for robot's movement is determined based on the data collected.
military application system is as shownin figure 1. The system senses the environment for gas and fire.
When a temperature sensor detects a dangerous environment
Metal sensor are used to determine whether an object in that resembles a fire, it raises its threshold level. If a gas or
the environment contains metal or not. Ultrasonic sensors are fire is detected, it notifies the operator with the terms "gas
used to measure the distance between obstacles and the detected" or "fire detected".

Fig. 2: Block diagram of location tracking Block Diagram of human interface is shown in the figure 2.

The rescue robot uses cloud communication to connect registered person's location is determined using the GPS
with an ESP32 microcontroller and a GPS module to pinpoint (Global Positioning System), the longitude and latitude of the
the precise location of a known registered person. The registered person are delivered.

IJISRT22AUG207 www.ijisrt.com 1987

Volume 7, Issue 8, August 2022 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
V. WORKING

Fig. 3: Circuit Diagram of multifunctional robot for surveillance application

The circuit diagram of the multifunctional robot for ultrasonic sensor, temperature sensor, IR flame sensor,
surveillance application is shown in figure 3. It consists of the L293D motor driver, power supplyconnected to the 12V, 2A
Raspberry Pi 4, Pi camera, headset, tube type metal detector, adapter, and jumper cables.

A. Interfacing of Pi camera with raspberry Pi

Fig. 4: Pi camera with Raspberry Pi

Figure 4 depicts the Pi camera nodes with connections B. Interfacing of ultrasonic with raspberry Pi
to the Raspberry Pi. The distance between two objects is measured using
ultrasonic sensors. Ultrasonic sensors work in the same way
Connect the ribbon connector on the camera module to as radar sensors do. They generate radio waves, which travel
the Raspberry Pi'sconnector first. Then camera is linked to through the air and return when they encounter an object.
the white connector located near the USB and Ethernet ports. Figure 5 shows the ultrasonic sensor interface with raspberry
The sensor has an 8-megapixel resolution and a focusing lens. pi.

IJISRT22AUG207 www.ijisrt.com 1988

Volume 7, Issue 8, August 2022 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165

Fig. 5: Ultrasonic sensor with raspberry Pi

C. Interfacing of DHT11 with raspberry Pi

Fig. 6: DHT11 with Raspberry Pi

A DHT11 is a digital sensor that combines two Microcontroller converts the analogue signalsfrom these
different sensors into a single unit. The sensor is made up sensors into digital output.Figure 6 shows the interfacing with
of an NTC (Negative Temperature Coefficient) Temperature raspberry pi.
Sensor and a Resistive-type Humidity Sensor. An 8- bit

D. Interfacing of m etal sensor with raspberry Pi

Fig. 7: Metal sensor with Raspberry Pi

The Raspberry Pi is connected to a metal detector by output pins by the sensor and picked up by the Pi's onboard
means of a specialised amplifier.The amplifier receives transponders, amplifiers and other components. Figure 7
measurable input from the metal sensor. Data is sent to the shows the metal sensor interface with raspberry pi.

IJISRT22AUG207 www.ijisrt.com 1989

Volume 7, Issue 8, August 2022 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
E. Interfacing of Flame sensor with raspberry Pi

Fig. 8: Flame sensor with Raspberry P

Infrared flame sensors detect flames, fires, or lights with range, the infrared flame sensor is very popular. The flame
wavelengths ranging from 760nm to 1100nm. Because of sensor connected to the RaspberryPi is shown in figure 8.
their low power and low cost, ease of use, and wide detection

F. Interfacing of L293D with raspberry Pi

Fig. 9: L293D with Raspberry Pi

An H-bridge IC is another name for the L293D motor G. Interfacing of GPS with ESP32
driver IC. It is made up oftwo H-bridges, one for each motor. GPS receivers determine their position in relation to a
They are used to change the polarity of the output, allowing network of satellites.They are user defined to know where
DC motors to be controlled in both directions. the GPS satellites are at any given time.

It makes use of u-low-power blox's NEO-6M GPS

module, which is battery-powered and inexpensive.

Fig. 10: GPS with ESP32

IJISRT22AUG207 www.ijisrt.com 1990

Volume 7, Issue 8, August 2022 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
VI. FLOWCHART

Fig. 11: Flowchart for Face Recognition

Figure 11 shows the flowchart for face recognition alert message. In addition, to register a person into a
is implemented using a Python algorithm. At first, the face directory, their face can be manually added and recorded into
recognition process determines whether a person is known or the database.
unknown. If the individual is unknown, the system issues an

Fig. 12: Flowchart for entire Robotic System

Figure 12 shows the flow chart for entire robotic system used to measure the distance between obstacles and the
Metal sensor are used to determinewhether an object in the robot's movement is determined based on the data collected.
environment contains metal or not. Ultrasonic sensors are

IJISRT22AUG207 www.ijisrt.com 1991

Volume 7, Issue 8, August 2022 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165

Fig. 13: Flowchart for human tracking

Figure 13 shows the flowchart for human tracking. The latitude of the registered person are delivered using the
rescue robot uses cloud communication to connect with an Global Positioning System.
ESP32 microcontroller and a GPS module. The longitude and

VII. RESULTS

Fig. 14: Unusual event detects

Initially environment's temperature and humidity are measure distance. Thesystem sends an alert message if an
first measured as shown in the figure 14. During the initial obstacle is detected. If the robot comes into contact with fire
movement of the robot, an ultrasonic sensor is used to the system also sends an alert and voice message.

Fig. 15: Metal detected

Figure 15 shows when the robot comes into contact The voice message is used to help disabled people , so that
with metal. The system sendsa text and voice alert message. everyone can use it.

Fig. 16: Firebase Station Software

IJISRT22AUG207 www.ijisrt.com 1992

Volume 7, Issue 8, August 2022 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
In firebase realtime database distance measured from of the robot stops. The latitude and longitude values are
the ultrasonic sensor as well as the location is continously displayed. The main reason for using Firebase is to observe
loop, it changes according to environment as shown in the the robot in action in real time.
figure 16. If there are any obstacle is detected the movement

Fig. 19: Location tracked of ESP32 user

The degree of latitude and longitude is displayed on the Figure 18 shows the detection of “Known” and “
realtime firebase station. The precise location of the ESP32 Unknown” people based on the directory created and stored
user can be traced using these degrees on an internet browser. in the data.

Fig. 18: Detection of known and unknown person

VIII. CONCLUSION REFERENCES

India's total number of missing children remained [1.] R. Kanagaraj, M. M. Amsaveni, S. Binsha & S. Chella
untraced increased from 48,972 to 1,08,234 during 2019- Keerthana, “Raspberry Pi- Based Spy Robot with
2020. Many incidents had occurred, resulting in serious Facial Recognition”, 2022 Proceedings of Third
injuries and devastating consequences such as the untimely International Conference on Intelligent Computing,
death of person. Information and Control Systems. Advances in
Intelligent Systems and Computing, vol 1415.
To overcome this issue, The precise location of the [2.] Aniket.A.More, Akshay.V.Jadhav & Sweta Patil,
registered user is being tracked using gps module interfaced “Surveillance Robot for Defence Environment”, 2019
with ESP32. IJRAR- International Journal of Research and
Analytical Reviews, VOLUME 6 I ISSUE 2 I APRIL
The surveillance robot system with facial recognition is – JUNE 2019] e ISSN 2348 –1269, Print ISSN 2349-
constantly examining the surrounding environment. When 5138.
the robot detects the items, it overcomes them and continues [3.] T. Bhupathi, A. Chittala and V. V. Mani, “A Video
forward. The robot can detect fire in its surroundings. Surveillance based Security Model for Military
A robot platform with a hard and fast four wheel Bases”, 2021 International Conference on Recent
structure chassis and an electrical system supported the Trends on Electronics, Information, Communication
Raspberry Pi and Microcontroller. The created platform fits & Technology (RTEICT), 2021, pp. 517-522, doi:
several basic design objectives for this stage of development, 10.1109/RTEICT52294.2021.9573572.
like being a low-cost solution, highly reliable and extendable [4.] R. Hasan, S. Asif Hussain, S. Azeemuddin
application, but it also investigated alternative algorithms of Nizamuddin and S. Mahmood, "An Autonomous
mapping, navigation, obstacle detection. Robot for Intelligent Security Systems," 2018 9th
IEEE Control and System Graduate Research
Colloquium (ICSGRC), 2018, pp. 201- 206, doi:
10.1109/ICSGRC.2018.8657642.

IJISRT22AUG207 www.ijisrt.com 1993

Volume 7, Issue 8, August 2022 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
[5.] M. Therasa. M. E (Ph.D), G. Kiran Prakash, V. Vinoth
Kumar, G. Sam Sunder, “Design and Implementation
of IoT Based wireless Multifunctional Robot for
Military Applications”, 2020 International Journal of
All Research Education and Scientific Methods
(IJARESM), ISSN: 2455-6211 Volume 8, Issue 9,
September-2020
[6.] Miss. Salunkhe Disha M, Miss. Jagtap Ashwini U,
Miss. Ghodekar Darshana R, Asst. Prof. Shelke
Poonam V, “Wireless Multifunctional Robot for
Military Applications”, 2018 International Research
Journal of Engineering and Technology (IRJET) e-
ISSN: 2395- 0056 Volume: 05 Issue: 03-Mar-2018
[7.] Joshi, S. A., Tondarkar, A., Solanke, K., & Jagtap, R.,
“Surveillance Robot for Military Application”, 2018
International Journal of Engineering and Computer
Science, 7(05), 23939–23944.
[8.] F. Faisal and S. A. Hossain, "Smart Security System
Using Face Recognition on Raspberry Pi," 2019 13th
International Conference on Software, Knowledge,
Information Management and Applications (SKIMA),
2019, pp. 1-8, doi:
10.1109/SKIMA47702.2019.8982466.
[9.] D. S. S. Mahesh, T. M. Reddy, A. S. Yaswanth, C.
Joshitha and S. S. Reddy, "Facial Detection and
Recognition System on Raspberry pi with Enhanced
Security," 2020 International Conference on
Emerging Trends in Information Technology and
Engineering (ic-ETITE), 2020, pp. 1-5, doi:
10.1109/ic-ETITE47903.2020.130.
[10.] N. Mustakim, N. Hossain, M. M. Rahman, N. Islam,
Z. H. Sayem and M. A. Z. Mamun, "Face Recognition
System Based on Raspberry Pi Platform," 2019 1st
International Conference on Advances in Science,
Engineering and Robotics Technology (ICASERT),
2019, pp. 1-4, doi: 10.1109/ICASERT.2019.89.

IJISRT22AUG207 www.ijisrt.com 1994