Development of a First-aid Smart Assistant Device using IoT Technology and Augmented Reality
Cheng Zhi Ying
Published: October 07, 2021.
Abstract
The objective of this project was to build a system software that could assist any first responder irrespective of their background in first-aid. It employed a combination of Internet of Things (IoT) technologies to dial for emergency medical assistance and make a diagnosis of the treatment needed. An Image Recognition (IR) service was trained using IBM Watson to assess the casualty’s primary condition. Training phrases were fed into Dialogflow to construct a voice and text-based conversational interface for Google Assistant’s Artificial Intelligence (AI) to give a secondary diagnosis. Vuforia’s Augmented Reality (AR) engine in Unity was then enlisted via Target Detection to display a virtual assistant applying first-aid on the casualty. The components were amalgamated using the AI’s autonomous control over the IR and AR applications to create the end-to-end system software. Lastly, XCode, an app-building engine, developed the components into prototype mobile applications. Future prototyping could assist first responders during an actual emergency and complement the Singapore Civil Defence Force’s efforts of promoting high
standards of first-aid.
Keywords: Internet of Things; Augmented Reality; Artificial Intelligence; Deep machine learning; First-aid