User Tools

Site Tools


projects

This is an old revision of the document!


Proposed Projects

Below is a list of 4080 projects proposed by faculty members. More projects may be added once they come in (normally in late August). Please contact the supervisor directly you are in interested in a project. You can also contact faculty members individually to discuss possible projects. Click here to see a list of faculty members, their research areas and their contact information.

Estimating emotional state from a speech audio signal

Supervisor: Michael Jenkin

Contact: jenkin@eecs.yorku.ca

When a robot interacts with a human it can be very helpful if the robot can estimate the emotional state of the person to whom it is talking. This estimation can be made in a number of ways, from the choice of words used, the visual cues obtained from a camera pointed at the person, and through an analysis if the speech signal obtained from a microphone listening to the speaker. This project is concerned with this last task. This project will apply modern recurrent neural networks, and in particular LSTM to the problem. The project will involve three major phases

(i) Background work: Understanding the problem of estimating speech emotion from the audio signal and a review of approaches to date. Identifying and obtaining access to appropriate datasets for training and evaluations.

(ii) Basic implementation: Based on the results of above, implement an existing LSTM-based approach to the problem and evaluate on the dataset identified above.

(iii) Integration with a social robot system (SENTRYNet) so that the robot can utilize this information in the development of dialog when interacting with speakers.

Required skills: General EECS408x prerequisites, Good knowledge of Python. Ability to work independently.

projects.1596214403.txt.gz · Last modified: 2020/07/31 16:53 by aan

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki