Machine Learning
Expression-Based Music Recommendation
Android app that reads facial expression through the camera and recommends music matching the detected mood. Basis for a published paper.
Overview
An Android application integrating CNN-based facial expression recognition. It performs real-time emotion detection through the device camera and maps detected moods to music recommendations. The underlying model was published in IRJET in 2021.
Role
I built the Flutter application and integrated the CNN model, including the work to get it running fast enough on the phone itself.
The hard part
Running the model on the phone in real time. It had to be trimmed down for mobile, which meant giving up some accuracy to keep it responsive on ordinary Android hardware rather than a test device.
Architecture
Flutter application with the expression recognition model running on-device. Detected emotion categories drive the recommendation step.
Stack
- Flutter
- CNN
- Python
- Computer Vision