Skip to content

memotions/machine-learning

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Memotions Machine Learning

Memorize Your Emotions! ☺️

Memotions is a mental wellness app designed to support Indonesian users of all ages through personalized journaling, machine learning, and gamification features, such as streaks and achievements. The app utilizes machine learning models to perform Natural Language Processing (NLP) tasks. Our key models include:

  • Mood Classification: Accurately identifying the user's mood based on their journal entries.
  • Personalized Suggestion: Offering tailored recommendations to improve mental well-being.

Dataset

For our mood classification model, the dataset consists of over 380,000 rows of labeled text in Bahasa Indonesia. The labels are divided into five classes: sad, happy, neutral, anger, and fear. This dataset was compiled from the following public sources:

English Dataset
Indonesian Dataset I | Indonesian Dataset II

On the other hand, the dataset for fine-tuning the Gemini 1.0 Pro model consists of 50 rows of synthetic data generated using AI, with additional manual customizations to align with our specific tasks.

All the dataset can be found on the datasets folder.

Machine Learning Model

Mood Classification Model

This model processes user journal entries and classifies them into five categories: sad, happy, neutral, angry, and scared. Each entry is preprocessed into indexed and padded tensors before making predictions.

  • Architectures : Bidirectional LSTM
  • Number of epochs : 9
  • Total parameters : 4,017,503
  • Learning rate : 9e-5

Personalized Suggestion Model

This model is designed to provide one-paragraph suggestions based on users' entries. It has been developed with a focus on understanding and responding to user input, fine-tuned using Gemini 1.0 Pro, tuned and deployed via Vertex AI.

  • Number of epochs : 3
  • Learning rate multiplier : 0.1
  • Adapter size : 16

Results

Mood Classification Model

The model achieved an accuracy of 80.1% and F1 score of 80.3% on the test dataset. Below, we provide the learning graph and the confusion matrix for all classes.

Personalized Suggestion Model

The model experienced fluctuating loss at each training step, ultimately ending with a value of 1.86. Below, we provide the corresponding graph.

About

This repository is dedicated to storing the development of the Memotions machine learning models.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •