| Literature DB >> 35009884 |
Balaji Dontha1, Kyoung Swearingen2, Scott Swearingen2, Susan E Thrane3, Asimina Kiourti1.
Abstract
We report new classes of wearable sensors that monitor touch between fully-abled and disabled players in order to empower collaborative digital gaming between the two. Our approach relies on embroidered force-sensitive resistors (FSRs) embedded into armbands, which outperform the state-of-the-art in terms of sensitivity to low applied forces (0 to 5 N). Such low forces are of key significance to this application, given the diverse physical abilities of the players. With a focus on effective gameplay, we further explore the sensor's touch-detection performance, study the effect of the armband fabric selection, and optimize the sensor's placement upon the arm. Our results: (a) demonstrate a 4.4-times improvement in sensitivity to low forces compared to the most sensitive embroidered FSR reported to date, (b) confirm the sensor's ability to empower touch-based collaborative digital gaming for individuals with diverse physical abilities, and (c) provide parametric studies for the future development of diverse sensing solutions and game applications.Entities:
Keywords: collaborative digital gaming; conductive threads; embroidery; force-sensitive resistor; wearable sensors
Mesh:
Year: 2022 PMID: 35009884 PMCID: PMC8749883 DOI: 10.3390/s22010342
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.576
Comparison of the reported solution compared to previously reported embroidered FSR.
| Ref. | Application | Dynamic Range Explored | Sensitivity 1 (Change in Resistance) from 0 to 5 N | E-Thread Resistivity (Ω/m) |
|---|---|---|---|---|
| This work | Collaborative gaming | <5 N | >8000 | 1.9 |
| [ | Driving gloves | 0–20 N | 80 | 127 |
| [ | Object Recognition | 0–30 N | 1000 | 200 (Ω/m2) |
| [ | Respiration/Posture Monitoring | 0.56–56.7 N | 40 | - |
| [ | Mobility Detection | 0–5 N | 1800 | 120 |
1 The calculation of the sensitivity is explained in Section 3.3.
Figure 1(a) Mechanism of gameplay using wearable sensors functionalized with FSRs; (b) block diagram of the proposed wearable sensor communicating wirelessly with a mobile device.
Figure 2(a) Armband prototype with embedded FSR; (b) wearable sensor showing the casing for the ESP32 and the wristband with the FSR.
Figure 3FSR designs explored in this work: (a) off-the-shelf FSR; (b) thru-mode FSR with woven conductive fabric; (c) thru-mode FSR with embroidered e-threads.
Figure 4Fabrics tested for the embedding of the FSR and the realization of the wristband for touch-based collaborative digital gaming.
Figure 5Embroidery Process with a Brother 4500D Embroidery Machine, outlining the formation of a thru-mode embroidered FSR. (a) embroidery machine; (b) embroidery process; (c) thru-mode embroidered FSR.
Performance of off-the-shelf FSR for different types of touches when placed on the forearm.
| Value in ESP32 GPIO/Touch Pin Register | ||||||
|---|---|---|---|---|---|---|
| Direct Skin | Fabric 1 | Fabric 2 | Fabric 3 | Fabric 4 | ||
| no touch | (a) | 15–18 | 23–24 | 26–27 | 26–27 | 24–26 |
| 1-finger touch | (b) | 0–2 | 1–3 | 1–2 | 1–2 | 1–2 |
| 2-finger touch | (c) | 0–1 | 1–2 | 1–2 | 0–1 | 1–2 |
| palmar side of hand touch | (d) | 0–1 | 1–2 | 1–3 | 0–2 | 1–2 |
| dorsal side of hand touch | (e) | 0–2 | 1–3 | 1–3 | 1–2 | 1–3 |
| Max. change in register value | (c)–(a) | 14–18 | 21–23 | 24–26 | 25–27 | 22–25 |
Performance of the off-the-shelf FSR for one-finger touch when placed on different locations.
| Value in ESP32 GPIO/Touch Pin Register | |||||||
|---|---|---|---|---|---|---|---|
| Direct Skin | Fabric 1 | Fabric 2 | Fabric 3 | Fabric 4 | |||
| forearm | no touch | (a) | 15–18 | 23–24 | 26–27 | 26–27 | 24–26 |
| 1-finger touch | (b) | 0–2 | 1–3 | 1–2 | 1–2 | 1–2 | |
| palmar side of hand | no touch | (c) | 13–16 | 24–25 | 26–27 | 28–29 | 27–28 |
| 1-finger touch | (d) | 0–1 | 1–2 | 0–2 | 1–2 | 1–2 | |
| dorsal side of hand | no touch | (e) | 24–25 | 24–26 | 25–27 | 26–27 | 26–28 |
| 1-finger touch | (f) | 0–2 | 0–2 | 0–1 | 1–3 | 1–2 | |
| Max. change in register value | 22–25 (e)–(f) | 22–26 (e)–(f) | 24–27 (c)–(d) | 26–28 (c)–(d) | 25–27 (c)–(d) | ||
Figure 6Sensitivity of the embroidered FSR up to 10 N.
Performance comparison of the three FSRs shown in Figure 3.
| Value in ESP32 GPIO/Touch Pin Register | ||||
|---|---|---|---|---|
| Off-the-Shelf FSR | Woven Fabric FSR | Embroidered FSR | ||
| no touch | (a) | 26–27 | 19–21 | 57–58 |
| 1-finger touch | (b) | 1–2 | 0–2 | 0–1 |
| 2-finger touch | (c) | 0–1 | 0–1 | 0–1 |
| palmar side of hand touch | (d) | 0–2 | 0–1 | 0–1 |
| dorsal side of hand touch | (e) | 1–2 | 0–1 | 0–1 |
| Max. change in register value | (a)–(c) | 25–27 | 18–21 | 56–58 |
Error calculation for different touch patterns.
| Off-the-Shelf FSR | Woven Fabric FSR | Embroidered FSR | |||||
|---|---|---|---|---|---|---|---|
| Trials | No. of Touches Registered | % Error | No. of Touches Registered | % Error | No. of Touches Registered | % Error | |
| 1-finger precision touch | 50 | 48 | 4% | 47 | 6% | 49 | 2% |
| 2-finger precision touch | 50 | 49 | 2% | 46 | 8% | 49 | 2% |
| 1-finger partial touch | 50 | 45 | 10% | 46 | 8% | 47 | 6% |
| 2-finger partial touch | 50 | 43 | 14% | 44 | 12% | 48 | 4% |
| random palm touch | 50 | 49 | 2% | 47 | 6% | 49 | 2% |
| center of palm touch | 50 | 26 | 48% | 36 | 28% | 42 | 16% |
Effect of the e-thread density on the performance of embroidered FSRs.
| Value in ESP32 GPIO/Touch Pin Register | |||
|---|---|---|---|
| 1 e-Thread/mm | 4 e-Threads/mm | 7 e-Threads/mm | |
| no touch | 43–44 | 49–50 | 39–41 |
| 1-finger touch | 19–21 | 0–1 | 0–1 |
| Max. change in register value | 22–25 | 48–50 | 38–41 |