RF-Sign: Position-Independent Sign Language Recognition Using Passive RFID Tags.

Nowadays, sign language is becoming increasingly important in people’s daily life. Existing solutions are often based on wireless signals (e.g., acoustic, visible, and WiFi) or wearable sensors to recognize gestures, but they suffer from vulnerability to environmental influences, poor security, and high energy consumption, which prevent them from accurately capturing finger micro-movements. In this paper, we propose RF-Sign, which uses passive radio-frequency identification (RFID) tags to capture multiple finger micro-movements simultaneously to enable sign language support. In particular, two main issues are studied. One is the problem of positional differences when users make the same gesture, and the other is the problem of segmenting consecutive gestures using only empirical thresholding methods and ignoring the existence of differences in thresholds for different gestures. For position differences, we propose position models to normalize the hand’s horizontal rotation angle and radial distance. For segmenting consecutive gestures, we use the received signal strength (RSS) trend of the reference tag to represent the finger micro-movements state. The experimental results show that the average accuracy reaches 92.81% under different angles, distances and other conditions.