Making learning personal, accessible, and inclusive across learning disabilities and language barriers. Interacting with learning material, supporting academics, social interactions, and daily life.
- Frontend: React, CSS
- Backend: Flask
- Database: MongoDB Atlas
- AI Models: LLaMA 3.2, OpenAI Whisper
- Frameworks: LangChain, Ollama, RAG
As international students, we've faced language barriers that often hinder understanding core concepts. A single unfamiliar term during a lecture can derail comprehension entirely. For students with learning disabilities like dyslexia or ADHD, the challenges are even more pronounced—long lectures and complex readings can feel insurmountable.
These shared struggles inspired us to reimagine learning as an interactive and accessible experience for everyone. EdQty was born to break down language barriers and cater to diverse learning needs, empowering students to grasp concepts confidently and effectively.
Our vision is simple yet profound: academic progress should never be hindered by linguistic or learning challenges. EdQty fosters inclusivity and support, promoting engagement and success for a diverse student community.
EdQty is a revolutionary learning tool designed to eliminate educational barriers for international students and individuals with learning disabilities. It combines cutting-edge technology with thoughtful accessibility features to create a truly inclusive learning environment.
-
Real-Time Multilingual Translation, Captioning, and Summarization:
Instantly translates, captions, and summarizes videos, lectures, and other content into your preferred language for seamless understanding. -
Interactive AI Q&A for Deeper Understanding:
Ask specific questions, request simplified explanations, or explore connections across topics interactively. -
Saved Database of Summaries and Notes:
Organize and revisit study materials in a personal repository. -
Enhanced Note-Taking and Annotation:
Highlight key content, add personalized notes, and link directly to related materials. -
Daily Life and Social Assistance:
Real-time translations for menus, signs, and product labels with cultural insights to navigate new environments effortlessly. -
Time-Stamped Video Q&A:
Pause and engage with content at any specific timestamp to enhance learning and retention. -
Flashcards, Quizzes, and Adaptive Summaries:
Generate learning aids dynamically as you explore content, reinforcing understanding on the go. -
Potential Additions:
Visualization aids for complex concepts through imagery and animations.
For our demo, we combined the power of modern AI with robust frameworks:
-
Generative AI Models:
Used LLaMA 3.2 for natural language processing and conversational AI, and OpenAI's Whisper for accurate audio-to-text conversion. -
LangChain Framework:
Managed workflows and coordinated interactions between AI models. -
Database:
MongoDB Atlas served as our personalized learning data lake, storing uploaded materials and maintaining conversational context. -
Frontend and Backend:
Built a seamless, interactive experience using React (frontend) and Flask (backend).
-
Steep Learning Curve:
None of us had prior experience with React, requiring us to learn and adapt on the fly. -
Integration:
Connecting the front-end and back-end demanded patience, determination, and countless Google searches. -
Time Constraints:
Building a fully functional app in just 24 hours tested our endurance and creativity.
-
Full-Stack MVP:
From idea to a working demo in just 24 hours, solving a real-life problem. -
Team Growth:
Every member, regardless of skill level, contributed and learned during the process. -
Accessibility Focus:
Created meaningful, targeted features to ensure inclusivity and support for diverse learners.
-
Teamwork is Key:
Dividing tasks by strengths and supporting each other fostered a collaborative, productive environment. -
User-Centered Design:
Thoughtful feature refinement made us deeply consider the needs and experiences of our audience. -
Full-Stack Development Skills:
Tackled the challenge of integrating front-end and back-end functionalities effectively.
The MVP is just the beginning. Here's what we envision:
-
Enhanced Cultural and Social Interaction features:
Improve accuracy to resonate with a diverse global audience. -
Interactive Features:
Add dynamic graphs, animations, and integrations with platforms like Quizlet and Zoom. -
User Discovery:
Conduct research to refine our understanding of user needs and preferences. -
Scaling and Optimization:
Make the app more robust, engaging, and accessible.
Our ultimate goal is to build a tool that transforms learning into an inclusive, enjoyable, and effective experience for everyone.
To explore or contribute to EdQty, clone this repository and follow the setup instructions below:
- Node.js
- Python 3
- MongoDB Atlas account
- API keys for LLaMA 3.2 or any LLM / Meta Llama 3.2 set up locally using Ollama
-
Clone the repo:
git clone https://github.com/your-repo/edqty.git cd edqty -
Install dependencies:
cd frontend npm install -
Configure environment variables for API keys and MongoDB.
-
Start the app:
python app.py npm start