| Literature DB >> 30100928 |
Carlos Alonso-Martinez1, Marcos Faundez-Zanuy1, Jiri Mekyska2.
Abstract
Existing literature about online handwriting analysis to support pathology diagnosis has taken advantage of in-air trajectories. A similar situation occurred in biometric security applications where the goal is to identify or verify an individual using his signature or handwriting. These studies do not consider the distance of the pen tip to the writing surface. This is due to the fact that current acquisition devices do not provide height formation. However, it is quite straightforward to differentiate movements at two different heights (a) short distance: height lower or equal to 1 cm above a surface of digitizer, the digitizer provides x and y coordinates; (b) long distance: height exceeding 1 cm, the only information available is a time stamp that indicates the time that a specific stroke has spent at long distance. Although short distance has been used in several papers, long distances have been ignored and will be investigated in this paper. In this paper, we will analyze a large set of databases (BIOSECUR-ID, EMOTHAW, PaHaW, OXYGEN-THERAPY, and SALT), which contain a total amount of 663 users and 17,951 files. We have specifically studied (a) the percentage of time spent on-surface, in-air at short distance, and in-air at long distance for different user profiles (pathological and healthy users) and different tasks; (b) the potential use of these signals to improve classification rates. Our experimental results reveal that long distance movements represent a very small portion of the total execution time (0.5% in the case of signatures and 10.4% for uppercase words of BIOSECUR-ID, which is the largest database). In addition, significant differences have been found in the comparison of pathological versus control group for letter "l" in PaHaW database (p = 0.0157) and crossed pentagons in SALT database (p = 0.0122).Entities:
Keywords: Biometrics; Handwriting; In-air trajectories
Year: 2017 PMID: 30100928 PMCID: PMC6061233 DOI: 10.1007/s12559-017-9501-5
Source DB: PubMed Journal: Cognit Comput ISSN: 1866-9956 Impact factor: 5.418
Fig. 1Intuos Pro L digitizing tablet and pen
Fig. 2Azimuth and altitude angles of the pen with respect to the plane of the writing surface
Fig. 3On-surface (top) and in-air (bottom) trajectories from two executions of two crossed pentagons
Fig. 4Time stamp difference of consecutive samples for an example of accepted file from PaHaW database task write lektorka word twice
Fig. 5Time stamp difference of consecutive samples for an example of discarded file from PaHaW database task write lektorka word twice
BIOSECUR-ID database. Time in absolute units and relative time in parenthesis
| Time | Strokes | |||||
|---|---|---|---|---|---|---|
| Task | On-surface | In-airS | In-airL | On-surface | In-airS | In-airL |
| Genuine signature | 2857.6 (79.6%) | 715.4 (19.9%) | 17.5 (0.5%) | 6.62 | 5.94 | 0.32 |
| Skilled forgeries | 5447.9 (68.5%) | 2373.4 (29.9%) | 128.5 (1.6%) | 6.58 | 6.21 | 0.63 |
| Lower case words | 110,445.1 (55.9%) | 76,454 (38.7%) | 10,644.4 (5.4%) | 335.01 | 367.16 | 33.16 |
| Numbers | 3677.3 (53.6%) | 3071.1 (44.7%) | 117.0 (1.7%) | 11.66 | 11.46 | 0.79 |
| Uppercase words | 73,608.8 (54.4%) | 47,756.2 (35.3%) | 14,073.4 (10.4%) | 313.49 | 343.29 | 30.81 |
EMOTHAW database. Time in absolute units and relative time in parenthesis
| Time | Strokes | |||||
|---|---|---|---|---|---|---|
| Task | On-surface | In-airS | In-airL | On-surface | In-airS | In-airL |
| a. Depression | ||||||
| Two-pentagon | 11394.0 (55.5%) | 7755.8 (37.7%) | 1393.3 (6.8%) | 9.26 | 13.15 | 9.47 |
| House | 18765.4 (53.6%) | 13933.1 (39.8%) | 2329.4 (6.7%) | 23.74 | 33.00 | 20.97 |
| Capital letters | 15789.4 (51.0%) | 13112.3 (42.4%) | 2050.1 (6.6%) | 59.79 | 65.91 | 12.15 |
| Loops with left hand | 10183.9 (97.7%) | 215.8 (2.1%) | 21.3 (0.2%) | 1.26 | 0.41 | 0.21 |
| Loops with right hand | 8542.7 (98.9%) | 58.6 (0.7%) | 39.3 (0.4%) | 1.18 | 0.21 | 0.06 |
| Clock | 14228.8 (45.0%) | 14905.2 (47.2%) | 2468.7 (7.8%) | 27.35 | 36.91 | 21.44 |
| Sentence | 15288.8 (60.4%) | 8052.4 (31.8%) | 1958.5 (7.8%) | 41.24 | 47.41 | 11.09 |
| b. Stress | ||||||
| Two-pentagon | 11283.0 (55.0%) | 7768.6 (37.9%) | 1444.1 (7.1%) | 9.41 | 13.89 | 11.39 |
| House | 18868.4 (52.5%) | 14378.6 (40.0%) | 2685.6 (7.5%) | 25.45 | 35.14 | 21.32 |
| Capital letters | 15732.3 (50.1%) | 13555.7 (43.1%) | 2135.2 (6.8%) | 60.80 | 67.09 | 12.04 |
| Loops with left hand | 10648.5 (97.3%) | 233.5 (2.1%) | 66.6 (0.6%) | 1.59 | 0.77 | 0.95 |
| Loops with right hand | 9264.1 (99.3%) | 40.0 (0.4%) | 23.9 (0.3%) | 1.13 | 0.14 | 0.04 |
| Clock | 14481.5 (44.8%) | 14934.1 (46.2%) | 2896.2 (9.0%) | 27.63 | 37.80 | 21.41 |
| Sentence | 15756.6 (59.4%) | 8539.8 (32.2%) | 2215.8 (8.4%) | 42.55 | 48.95 | 10.84 |
| c. Anxiety | ||||||
| Two-pentagon | 11474.7 (57.3%) | 7135.2 (35.6%) | 1420.7 (7.1%) | 8.70 | 12.75 | 10.16 |
| House | 18871.9 (53.6%) | 13683.5 (38.8%) | 2672.7 (7.6%) | 23.77 | 32.89 | 18.95 |
| Capital letters | 16010.0 (50.9%) | 13356.9 (42.5%) | 2082.7 (6.6%) | 60.48 | 66.39 | 10.96 |
| Loops with left hand | 10248.4 (96.9%) | 224.3 (2.1%) | 103.0 (1.0%) | 1.57 | 0.79 | 0.96 |
| Loops with right hand | 8793.2 (99.3%) | 35.6 (0.4%) | 23.9 (0.3%) | 1.11 | 0.13 | 0.04 |
| Clock | 14175.3 (46.5%) | 13487.9 (44.3%) | 2811.3 (9.2%) | 26.27 | 35.48 | 19.54 |
| Sentence | 15676.5 (59.9%) | 8402.2 (32.1%) | 2107.5 (8.0%) | 41.96 | 48.14 | 10.38 |
| d. Control | ||||||
| Two-pentagon | 10256.0 (49.7%) | 8670.5 (42.1%) | 1684.9 (8.2%) | 10.13 | 15.27 | 12.91 |
| House | 17468.1 (49.0%) | 15150.2 (42.5%) | 3044.5 (8.5%) | 26.63 | 36.23 | 22.27 |
| Capital letters | 15699.2 (48.9%) | 13721.2 (42.8%) | 2677.1 (8.3%) | 61.46 | 67.84 | 11.68 |
| Loops with left hand | 9737.1 (98.5%) | 133.3 (1.3%) | 17.7 (0.2%) | 1.18 | 0.30 | 0.41 |
| Loops with right hand | 8992.1 (98.4%) | 123.2 (1.3%) | 23.9 (0.3%) | 1.07 | 0.09 | 0.04 |
| Clock | 12365.6 (38.9%) | 16180.8 (50.9%) | 3229.5 (10.2%) | 27.13 | 37.25 | 22.63 |
| Sentence | 15660.0 (53.6%) | 9539.6 (32.6%) | 4024.3 (13.8%) | 42.41 | 49.43 | 11.43 |
PAHAW database. Time in absolute units and relative time in parenthesis
| Time | Strokes | |||||
|---|---|---|---|---|---|---|
| Task | On-surface | In-airS | In-airL | On-surface | In-airS | In-airL |
| a. Control | ||||||
| Spiral | 18,665.8 (98.6%) | 171.5 (0.9%) | 103.2 (0.5%) | 1.40 | 1.97 | 1.94 |
| Letter | 8077.8 (57.6%) | 3868.3 (27.6%) | 2069.6 (14.8%) | 5.21 | 18.16 | 15.50 |
| Bigram | 10,545.9 (71.2%) | 2998.4 (20.2%) | 1274.3 (8.6%) | 5.13 | 14.03 | 11.00 |
| Word | 12,309.1 (69.2%) | 3513.0 (19.7%) | 1977.7 (11.1%) | 5.29 | 15.11 | 11.82 |
| Word | 14,931.2 (73.0%) | 3238.1 (15.9%) | 2279.8 (11.1%) | 7.00 | 16.97 | 12.00 |
| Word | 13,071.5 (74.4%) | 3356.7 (19.1%) | 1139.4 (6.5%) | 8.08 | 18.08 | 11.82 |
| Word | 8757.5 (83.8%) | 1512.5 (14.5%) | 179.0 (1.7%) | 5.29 | 8.47 | 4.50 |
| Sentence | 14,481.3 (58.4%) | 7457.9 (30.1%) | 2844.6 (11.5%) | 15.24 | 31.87 | 19.34 |
| b. Parkinson patients | ||||||
| Spiral | 24,057.4 (95.4%) | 618.3 (2.4%) | 536.6 (2.2%) | 2.03 | 6.78 | 7.31 |
| Letter | 8928.1 (63.8%) | 4132.5 (29.5%) | 939.1 (6.7%) | 5.51 | 16.08 | 12.59 |
| Bigram | 12,143.2 (69.1%) | 4094.1 (23.3%) | 1330.4 (7.6%) | 5.57 | 17.08 | 13.76 |
| Word | 14,702.7 (69.6%) | 4093.1 (19.4%) | 2330.9 (11.0%) | 5.76 | 19.22 | 15.54 |
| Word | 17,716.2 (76.3%) | 36,045.0 (15.5%) | 1890.1 (8.2%) | 7.22 | 17.97 | 12.49 |
| Word | 14,690.6 (75.8%) | 3808.9 (19.6%) | 891.1 (4.6%) | 8.86 | 18.11 | 11.00 |
| Word | 9784.0 (79.8%) | 2115.7 (17.2%) | 365.6 (3.0%) | 6.76 | 11.30 | 5.86 |
| Sentence | 16,176.5 (58.2%) | 8252.3 (29.9%) | 3300.1 (11.9%) | 16.57 | 36.81 | 23.62 |
OXIGEN-THERAPY database. Time in absolute units and relative time in parenthesis
| Time | Strokes | |||||
|---|---|---|---|---|---|---|
| Task | On-surface | In-airS | In-airL | On-surface | In-airS | In-airL |
| a. Before O2 | ||||||
| House | 32,699.0 (49.6%) | 22,184.8 (33.7%) | 11,033.8 (16.7%) | 28.88 | 131.13 | 141.29 |
| Clock | 20,144.0 (40.2%) | 21,824.0 (43.6%) | 8104.3 (16.2%) | 27.25 | 94.13 | 79.00 |
| b. After O2 | ||||||
| House | 26,572.1 (53.6%) | 18,429.1 (37.1%) | 4606.5 (9.3%) | 27.70 | 74.57 | 51.96 |
| Clock | 16,619.8 (46.4%) | 16,007.8 (44.7%) | 3197.6 (8.9%) | 25.21 | 57.21 | 37.29 |
SALT database. Time in absolute units and relative time in parenthesis
| Time | Strokes | |||||
|---|---|---|---|---|---|---|
| Task | On-surface | In-airS | In-airL | On-surface | In-airS | In-airL |
| a. DCLI | ||||||
| Crossed pentagons | 18,292.8 (60.2%) | 8497.3 (27.9%) | 3612.6 (11.9%) | 10.00 | 20.33 | 27.50 |
| Spiral | 8219.3 (99.0%) | 26.75 (0.3%) | 60.8 (0.7%) | 1.42 | 1.75 | 2.25 |
| 3D house | 33,503.83 (52.0%) | 19,388.6 (30.1%) | 11,534.3 (17.9%) | 29.50 | 49.17 | 50.42 |
| Clock | 18,931.9 (31.2%) | 24,807.2 (40.9%) | 16,917.0 (27.9%) | 26.67 | 52.17 | 70.50 |
| Spontaneous sentence | 16,500.3 (48.8%) | 14,322.9 (42.4%) | 2966.5 (8.8%) | 40.67 | 47.75 | 15.33 |
| Sentence copied | 26,535.4 (49.3%) | 21,918.3 (40.7%) | 5404.9 (10.0%) | 57.58 | 69.08 | 29.58 |
| Sentence dictation | 20,710.7 (59.1%) | 11,717.8 (33.4%) | 2633.0 (7.5%) | 43.25 | 50.08 | 16.33 |
| b. Alzheimer | ||||||
| Crossed pentagons | 21,535.4 (48.4%) | 15,430.1 (34.6%) | 7555.4 (17.0%) | 14.05 | 28.00 | 48.14 |
| Spiral | 11,312.2 (88.7%) | 1108.8 (8.7%) | 327.2 (2.6%) | 1.71 | 1.67 | 2.52 |
| 3D house | 40,341.6 (47.3%) | 30,465.8 (35.8%) | 14,386.2 (16.9%) | 31.55 | 55.23 | 75.77 |
| Clock | 24,524.7 (36.1%) | 33,060.4 (48.6%) | 10,420.8 (15.3%) | 29.36 | 48.41 | 50.95 |
| Spontaneous sentence | 19,555.9 (48.6%) | 17,090.1 (42.4%) | 3606.1 (9.0%) | 37.23 | 44.05 | 17.09 |
| Sentence copied | 34,023.8 (45.1%) | 33,451.3 (44.4%) | 7951.2 (10.5%) | 54.32 | 69.50 | 35.95 |
| Sentence dictation | 26,640.6 (52.7%) | 20,723.6 (41.0%) | 3189.6 (6.3%) | 44.27 | 54.86 | 20.45 |
| c. Control | ||||||
| Crossed pentagons | 17,077.7 (50.1%) | 13,085.8 (38.4%) | 3918.6 (11.5%) | 11.88 | 36.47 | 36.65 |
| Spiral | 6198.3 (91.0%) | 426.6 (5.4%) | 251.3 (3.6%) | 1.63 | 3.06 | 2.94 |
| 3D house | 29,170.5 (43.3%) | 26,094.5 (38.7%) | 12,152.4 (18.0%) | 30.82 | 72.24 | 68.12 |
| Clock | 18,986.1 (30.2%) | 31,299.1 (49.8%) | 12,547.1 (20.0%) | 29.94 | 71.38 | 71.06 |
| Spontaneous sentence | 14,990.5 (43.8%) | 14,648.8 (42.8%) | 4566.4 (13.4%) | 35.41 | 56.88 | 31.12 |
| Sentence copied | 24,684.2 (45.5%) | 23,968.8 (44.1%) | 5654.8 (10.4%) | 53.59 | 78.00 | 37.53 |
| Sentence dictation | 19,531.1 (56.9%) | 13,131.1 (38.2%) | 1676.5 (4.9%) | 38.71 | 50.24 | 16.76 |
EMOTHA (Mann-Whitney U test)
| Task |
|
|
|
|
|
|
|---|---|---|---|---|---|---|
| a. Depression/control | ||||||
| Two-pentagon | 0.4316 | 0.3082 | 0.0589 | 0.1374 | 0.0731 | 0.0561 |
| House | 0.7329 | 0.0495 | 0.5002 | 0.0315 | 0.0774 | 0.4217 |
| Capital letters | 0.5771 | 0.5771 | 0.8744 | 0.0904 | 0.2317 | 0.5994 |
| Loops with left hand | 0.7613 | 0.2380 | 0.1292 | 0.2954 | 0.2742 | 0.1542 |
| Loops with right hand | 0.6592 | 0.5316 | 0.7322 | 0.5067 | 0.5005 | 0.7322 |
| Clock | 0.1267 | 0.6293 | 0.2196 | 0.6641 | 0.7739 | 0.9688 |
| Sentence | 0.8992 | 0.3273 | 0.1849 | 0.3794 | 0.2870 | 0.5764 |
| b. Anxiety/control | ||||||
| Two-pentagon | 0.2429 | 0.1020 | 0.1678 | 0.1546 | 0.1010 | 0.1505 |
| House | 0.4564 | 0.0417 | 0.4086 | 0.0652 | 0.1777 | 0.2550 |
| Capital letters | 0.3770 | 0.6374 | 0.3503 | 0.1731 | 0.1888 | 0.7751 |
| Loops with left hand | 0.7711 | 0.1575 | 0.1723 | 0.1560 | 0.1429 | 0.2017 |
| Loops with right hand | 0.9374 | 1 | 1 | 0.9822 | 0.9762 | 1 |
| Clock | 0.0414 | 0.1540 | 0.2410 | 0.4462 | 0.5801 | 0.8294 |
| Sentence | 0.7234 | 0.4259 | 0.1296 | 0.5392 | 0.3971 | 0.2913 |
| c. Stress/control | ||||||
| Two-pentagon | 0.5665 | 0.4886 | 0.3429 | 0.6173 | 0.4131 | 0.3678 |
| House | 0.5221 | 0.2565 | 0.4705 | 0.5562 | 0.7621 | 0.9188 |
| Capital letters | 0.4741 | 0.9907 | 0.7934 | 0.2769 | 0.4367 | 0.4662 |
| Loops with left hand | 0.3859 | 0.1625 | 0.2801 | 0.1466 | 0.1498 | 0.3173 |
| Loops with right hand | 0.4795 | 0.7184 | 1 | 0.6875 | 0.6875 | 1 |
| Clock | 0.0241 | 0.7401 | 0.4670 | 0.6199 | 0.6496 | 0.6623 |
| Sentence | 0.6819 | 0.5753 | 0.1011 | 0.7034 | 0.5335 | 0.4764 |
T time on-surface, T time in-airS, T time in-airL, Strokes strokes on-surface, Strokes strokes in-airs, Strokes strokes in-airL
PaHaW (Mann-Whitney U test)
| Task |
|
|
|
|
|
|
|---|---|---|---|---|---|---|
| a. Parkinson/control | ||||||
| Spiral | 0.3947 | 0.5621 | 0.0939 | 0.2857 | 0.0919 | 0.0949 |
| Letter | 0.4614 | 0.5529 | 0.0157 | 0.2390 | 0.3611 | 0.2718 |
| Bigram | 0.3015 | 0.0403 | 0.5671 | 0.0090 | 0.1173 | 0.1710 |
| Word | 0.3015 | 0.3166 | 0.6601 | 0.2941 | 0.2453 | 0.4385 |
| Word | 0.5166 | 0.9440 | 0.3019 | 0.8111 | 0.6928 | 0.4744 |
| Word | 0.3878 | 0.7226 | 0.4025 | 0.3778 | 0.9239 | 0.7963 |
| Word | 0.5780 | 0.1776 | 0.2836 | 0.0630 | 0.1287 | 0.2538 |
| Sentence | 0.2000 | 0.5850 | 0.9612 | 0.3229 | 0.2720 | 0.5773 |
T time on-surface, T time in-airS, T time in-airL, Strokes strokes on-surface, Strokes strokes in-airs, Strokes strokes in-airL
OXYGEN THERAPY (Mann-Whitney U test)
| Task |
|
|
|
|
|
|
|---|---|---|---|---|---|---|
| a. Pre/post O2 | ||||||
| House | 0.8968 | 0.8764 | 0.9174 | 0.9174 | 0.8968 | 0.8968 |
| Clock | 0.9218 | 0.8936 | 0.9077 | 0.8665 | 0.8795 | 0.8795 |
T time on-surface, T time in-airS, T time in-airL, Strokes strokes on-surface, Strokes strokes in-airs, Strokes strokes in-airL
SALT (Mann-Whitney U test)
| Task |
|
|
|
|
|
|
|---|---|---|---|---|---|---|
| a. Alzheimer/control | ||||||
| Crossed pentagons | 0.0303 | 0.1609 | 0.0122 | 0.3941 | 0.6604 | 0.0891 |
| Spiral | 0.0063 | 0.5132 | 0.1995 | 0.9185 | 0.1338 | 0.1869 |
| 3D house | 0.0677 | 0.1370 | 0.1297 | 0.3493 | 0.7533 | 0.0720 |
| Clock | 0.1071 | 0.1984 | 0.1785 | 0.5526 | 0.2033 | 0.6256 |
| Spontaneous sentence | 0.1878 | 0.0524 | 0.9210 | 0.3875 | 0.8316 | 0.8761 |
| Sentence copied | 0.0096 | 0.1080 | 0.1096 | 0.5612 | 0.3954 | 0.2629 |
| Sentence dictation | 0.0132 | 0.0721 | 0.0920 | 0.2510 | 0.3953 | 0.1604 |
| b. MCI/control | ||||||
| Crossed pentagons | 0.1915 | 0.4925 | 0.1915 | 0.2758 | 0.1688 | 0.5643 |
| Spiral | 0.0968 | 0.5358 | 0.0865 | 0.4290 | 0.0889 | 0.0973 |
| 3D house | 0.2069 | 0.5500 | 0.3879 | 0.6729 | 0.7734 | 0.5206 |
| Clock | 0.4437 | 0.9445 | 0.0738 | 1 | 0.8892 | 0.2854 |
| Spontaneous sentence | 0.5500 | 0.8421 | 0.9119 | 0.4124 | 0.5496 | 0.6094 |
| Sentence copied | 0.1501 | 0.4384 | 0.7735 | 0.2777 | 0.6260 | 0.8075 |
| Sentence dictation | 0.3640 | 0.7398 | 0.2878 | 0.3407 | 0.4784 | 0.5203 |
T time on-surface, T time in-airS, T time in-airL, Strokes strokes on-surface, Strokes strokes in-airs, Strokes strokes in-airL