Control of a servomotor using hand gestures

Опубликовано: 25 Август 2021
на канале: Sandro Quintero
294
10

Our current HMIs will not be around forever… How would a next gen HMI look like?

Here's a quick proof of concept developed in #python using #opencv.

I have seen many toddlers who can't even read or speak using complex gadgets like an iPad. How!? Intuitive design!!

There are of course many things to consider like safety, latency, ambien noise, harsh environments, etc.

Vision
Microphone with audio feedback
Touch

What did I use?
Python running openCV and a Modbus TCP library
Standard USB webcam
Festo CMMT-ST drive
Festo EMMS-ST motor
CODESYS (on a Festo PLC but could've also been a RaspberryPi)

10, 20 or 30 years from now, how are HMIs going to look like?