Cambridge: AI-Based ‘No-Touch Touchscreen’ Could Reduce Risk of Pathogen Spread From Surfaces
July 31, 2020 | University of CambridgeEstimated reading time: 3 minutes
A ‘no-touch touchscreen’ developed for use in cars could also have widespread applications in a post-COVID-19 world, by reducing the risk of transmission of pathogens on surfaces.
Touchscreens and other interactive displays are something most people use multiple times per day, but they can be difficult to use while in motion, whether that’s driving a car or changing the music on your phone while you’re running
Simon Godsill | University of Cambridge News Office
The patented technology, known as ‘predictive touch’, was developed by engineers at the University of Cambridge as part of a research collaboration with Jaguar Land Rover. It uses a combination of artificial intelligence and sensor technology to predict a user’s intended target on touchscreens and other interactive displays or control panels, selecting the correct item before the user’s hand reaches the display.
More and more passenger cars have touchscreen technology to control entertainment, navigation or temperature control systems. However, users can often miss the correct item – for example due to acceleration or vibrations from road conditions – and have to reselect, meaning that their attention is taken off the road, increasing the risk of an accident.
In lab-based tests, driving simulators and road-based trials, the predictive touch technology was able to reduce interaction effort and time by up to 50% due to its ability to predict the user’s intended target with high accuracy early in the pointing task.
As lockdown restrictions around the world continue to ease, the researchers say the technology could also be useful in a post-COVID-19 world. Many everyday consumer transactions are conducted using touchscreens: ticketing at rail stations or cinemas, ATMs, check-in kiosks at airports, self-service checkouts in supermarkets, as well as many industrial and manufacturing applications. Eliminating the need to actually touch a touchscreen or other interactive display could reduce the risk of spreading pathogens – such as the common cold, influenza or even coronavirus – from surfaces.
In addition, the technology could also be incorporated into smartphones, and could be useful while walking or jogging, allowing users to easily and accurately select items without the need for any physical contact. It even works in situations such as a moving car on a bumpy road, or if the user has a motor disability which causes a tremor or sudden hand jerks, such as Parkinson’s disease or cerebral palsy.
“Touchscreens and other interactive displays are something most people use multiple times per day, but they can be difficult to use while in motion, whether that’s driving a car or changing the music on your phone while you’re running,” said Professor Simon Godsill from Cambridge’s Department of Engineering, who led the project. “We also know that certain pathogens can be transmitted via surfaces, so this technology could help reduce the risk for that type of transmission.”
The technology uses machine intelligence to determine the item the user intends to select on the screen early in the pointing task, speeding up the interaction. It uses a gesture tracker, including vision-based or RF-based sensors, which are increasingly common in consumer electronics; contextual information such as user profile, interface design, environmental conditions; and data available from other sensors, such as an eye-gaze tracker, to infer the user’s intent in real time.
“This technology also offers us the chance to make vehicles safer by reducing the cognitive load on drivers and increasing the amount of time they can spend focused on the road ahead. This is a key part of our Destination Zero journey,” said Lee Skrypchuk, Human Machine Interface Technical Specialist at Jaguar Land Rover.
It could also be used for displays that do not have a physical surface such as 2D or 3D projections or holograms. Additionally, it promotes inclusive design practices and offers additional design flexibilities, since the interface functionality can be seamlessly personalised for given users and the display size or location is no longer constrained by the user ability to reach-touch.
“Our technology has numerous advantages over more basic mid-air interaction techniques or conventional gesture recognition, because it supports intuitive interactions with legacy interface designs and doesn’t require any learning on the part of the user,” said Dr Bashar Ahmad, who led the development of the technology and the underlying algorithms with Professor Godsill. “It fundamentally relies on the system to predict what the user intends and can be incorporated into both new and existing touchscreens and other interactive display technologies.”
This software-based solution for contactless interactions has reached high technology readiness levels and can be seamlessly integrated into existing touchscreens and interactive displays, so long as the correct sensory data is available to support the machine learning algorithm.
This article originally appeared on the website of the University of Cambridge. Read the original article here.
Suggested Items
SMC Korea 2024 to Highlight Semiconductor Materials Trends and Innovations on Industry’s Path to $1 Trillion
04/24/2024 | SEMIWith Korea a major consumer of semiconductor materials and advanced materials a key driver of innovation on the industry’s path to $1 trillion, industry leaders and experts will gather at SMC (Strategic Materials Conference) Korea 2024 on May 29 at the Suwon Convention Center in Gyeonggi-do, South Korea to provide insights into the latest materials developments and trends. Registration is open.
Orbex Secures £16.7m Investment for Rocket ‘Ramp Up’ Period
04/24/2024 | OrbexThe UK spaceflight company Orbex has received £16.7m from six backers in an update to its Series C funding round.
Real Time with... IPC APEX EXPO 2024: Going Vertical: SCHMID's Advanced Solutions for Printed Circuit Boards
04/24/2024 | Real Time with...IPC APEX EXPOEditor Marcy LaRont chats with Bob Ferguson, the president of SCHMID, about advanced solutions for PCBs and the equipment they are highlighting at this year's show. He delves into vertical no-touch handling systems and the prospect of achieving sub-10-micron lines. Inspired by SCHMID's technology, Bob expresses excitement about where the industry is today.
Real Time with... IPC APEX EXPO 2024: Advancements in Laser Depaneling with LPKF
04/24/2024 | Real Time with...IPC APEX EXPOJake Benz, LPKF sales manager for North America, discusses the company's advancements in laser depaneling. LPKF has introduced a green wavelength laser for processing rigid FR-4 circuit boards, bringing significant gains in processing speeds to market. The company transitioned from IR CO2 to UV wavelength due to heat and burning issues.
Adura Solutions Exhibits at Del Mar 2024
04/24/2024 | Adura SolutionsSumit Tomar, CEO of Adura Solutions, has announced that his company will be exhibiting at this year’s Del Mar Electronics and Manufacturing Show to be held at the Del Mar Fairgrounds, San Diego, California, April 24-25.