Home Page
Link to Project Information Link to Demo Link to Team Info Link to Publications Send us Email


Automatic generation of nonmanual signals in depictions of simple declarative sentences in American Sign Language
General Project Description

People born deaf are an invisible and underserved population. They lack access not only to spoken language but to written language as well. They use American Sign Language, not English, as their first language. American Sign Language (ASL) is an independent language in its own right and is at least as different from English as any foreign language. For those born deaf, English is a second language, and their literacy is quite low. Current studies show that the average reading level for deaf high school seniors is between the third and fourth grade. Deafness is not only a barrier of sound, but a barrier of language and communication.

A prerequisite to a general effective voice-activated display of ASL is the ability to create well-formed, understandable declarative sentences automatically. Previous efforts have created a method for properly conjugating agreement verbs in declarative sentences, but the work only addresses the motion and configuration of the hands and arms. It did not consider the role of nonmanual signals, which are aspects of ASL that are not expressed on the hands.

The functions of nonmanual signals are varied and wide-ranging, affecting the structure of ASL at the phonemic, morphological, syntactic and semantic level. This study will examine the types of nonmanual signals used in simple, declarative sentences in ASL, and develop a methodology to portray them as 3D animations.

Milestones
  • A motion study of nonmanual signals in simple declarative sentences. Although there is a previous linguistic study of nonmanual signals in ASL sentences, its results do not provide enough detail for implementation purposes.
    Status: Completed.

  • A geometric characterization of the observed motions. The motions comprising the nonmanual signals will need to be quantified and characterized with respect to the signer’s body.
    Status: Completed

  • An implementation of the mathematics as animation. The geometric characterization from milestone two will provide the algorithms and data for automatically creating 3D animations of the declarative sentences.
    Status: Completed

Link to Project Information Link to Demo Link to Team Info Link to Publications Send us Email

Copyright 2002, DePaul University CTI
Original pages by MaryJo Davidson.
This page by Lindsay Semler and Lesley Carhart, 2006.