Abstract
Our paper introduces the idea of exploiting the phonological properties manually assigned by sign language users to classify videos of people performing signs by regressing a 3D mesh. We establish a new baseline for this problem based on the statistical distribution of 725 different signs. Our best-performing models achieve a micro-averaged F1-score of 58% for the major location class and 70% for the sign type using statistical and deep learning algorithms, compared to their corresponding baselines of 35% and 39%.
Original language | English |
---|---|
Title of host publication | 2022 IEEE International Conference on Acoustics, Speech and Signal Processing, 22-27 May 2022, Singapore |
Publication status | Accepted/In press - 22 Jan 2022 |
Fingerprint
Dive into the research topics of 'PHONOLOGY RECOGNITION IN AMERICAN SIGN LANGUAGE'. Together they form a unique fingerprint.Projects
-
RAI: Centre for Robotics and Artificial Intelligence
Cangelosi, A., Lennox, B., Weightman, A., Dennis, L., Dixon, C., Fisher, M., Herrmann, G., Dickson, A., Lanzon, A., Stancu, A., Saiani, A., Freitas, A., Nini, A., Voronkov, A., Brass, A., Vijayaraghavan, A., Parslew, B., crowther, W., Grieve, B., Adorno, B., Jay, C., Wang, C. C. L., Todd, C., Soutis, C., Arsene, C., Dresner, D., Barrett, E., Gowen, E., Arvin, F., Podd, F., Brown, G., Reger, G., Cooper, G., Mairs, H., Yin, H., Kinloch, I., Eleftheriou, I., Li, J., Carrasco Gomez, J., Ainsworth, J., Sinha, J., Ozanyan, K., Smith, K., Twomey, K., Margetts, L., Ren, L., Zhang, L., Cordeiro, L., Rattray, M., Bissett, M., Elliot, M., Alvarez, M., Luján, M., Nabawy BSc, MSc, PhD, MRAeS, SMAIAA, FHEA, M., Peek, N., Marjanovic, O., Dorn, O., Dudek, P., Green, P., Connolly, P., Da Silva Bartolo, P. J., Gardner, P., Martin, P., Potluri, V., Curtis, R., Schmidt, R., Banach, R., Batista-Navarro, R. T., Kaski, S., Midson, S., Watson, S., Holm, S., Furber, S., Schlegel, V., Mirihanage, W., Mansell, W., Pan, W., Sampson, W., Sellers, W., Yang, W., Cai, P., Sun, Y., Alharthi, A., Macario Rojas, A., Serhan, B., Yu, C., Abara, D., Lopez Pulgarin, E., Faruq, F., Tavella, F., Semeraro, F., Liu, G., Fang, G., Niu, H., Taylor, H., Zhu, H., Collenette, J., Amano, K., Lo, K. C. J., Raggioli, L., Romeo, M., Ruocco, M., Ghaffari Saadat, M., Walmsley, M., Mubarik, A., Vinanzi, S., Su, Y., Mcaleese, H., Stringer, P., Stoican, R., Ye, R., Kurawa, S. S., Zhang, T., Krywonos, W., Xu, Y., Tian, Y., Henderson, A., Morley, D., Tallentire, J., Clayton, J., Hawthornthwaite, S. & Carlson, J.
Project: Research