fix: web build #2164

Rutik7066 · 2025-04-07T16:03:54Z

Changes

Updated Flutter web loading strategy
Package Version fixes
Added createUniversalSocket helper functions for web and io compatibility.
Implemented OmiFile file wrapper abstractions for web and IO compatibility. It uses Index db under the hood on the web and IO file on native platforms.
Removed all dart:io usage.
Added conditional execution for Analytics and Support packages that do not or partially support web.
Updated file uploading to utilize the http package, and modified other client code to also use http in place of IO.

/claim #2008

skywinder

Please check comments, the PR should be clean for merge in prod.

Please also add demo video and instructions how to run it for local tests.

skywinder · 2025-04-10T00:07:58Z

app/lib/backend/http/shared.dart

+    url = "https://cors-anywhere.herokuapp.com/$url";
+    headers["Origin"] = 'http://localhost:53844';


1/ Looks you forgot to remove hardcoded things here?

skywinder · 2025-04-10T00:10:39Z

app/lib/backend/auth.dart

+      clientId: "1031333818730-l9meebge7tpc0qmquvq6t5qpoe09o1ra.apps.googleusercontent.com",
+    ).signIn();


its already in app/setup/prebuilt/google-services.json - why do we need it here? this hardcode is not prod ready.

skywinder · 2025-04-10T00:14:19Z

backend/utils/stt/streaming.py

+    # Soniox's 'multi'
+    if language in soniox_multi_languages:
+        return STTService.soniox, 'multi', 'stt-rt-preview'
+
+    ## Deepgram's 'multi'
+    #if language in deepgram_multi_languages:
+    #    return STTService.deepgram, 'multi', 'nova-3'


does it realtes to this PR?

skywinder · 2025-04-10T00:14:56Z

sdks/python/README.md

+<!-- This file is auto-generated from docs/docs/docs/developer/sdk/python.mdx. Do not edit manually. -->
+# 🎧 Omi Python SDK 
+
+This SDK connects to an **Omi wearable device** over **Bluetooth**, decodes the **Opus-encoded audio**, and transcribes it in **real time using Deepgram**.


how did you autogenerate this readme? I believe it's not relate to this PR as well. please check this others and below

…n to static

…sistency This commit replaces all direct `Platform` checks with the custom `PlatformUtil` utility to ensure consistent platform detection across the application. This change improves maintainability and reduces redundancy in platform-specific logic.

Rutik7066 · 2025-04-11T17:43:10Z

Please check comments, the PR should be clean for merge in prod.

Please also add demo video and instructions how to run it for local tests.

Sure, once I complete File handling then I will let you know and update the video demo as well

Rutik7066 · 2025-04-13T21:04:19Z

output.mp4

@skywinder Here is the working video of the PR
Here is how to test the PR

Setup CORS proxy

npm i local-cors-proxy
lcp --proxyUrl=https://backend-dt5lrfkkoa-uc.a.run.app/ --credentials

Change env

API_BASE_URL=http://localhost:8010/proxy/

Run app

flutter run -d chrome

Note: Due to CORS, images do not fetch

skywinder

Overall, that’s a good next step. You made the change I asked for.

I left a few things to consider.

But there are quite a lot of other changes too, so we need to test it more and wait for a review from the people who work with the backend.

So bring attetion to @thinhx , since there is a lot of api modifications, which i'm not familiar yet.

skywinder · 2025-04-14T15:37:37Z

app/lib/backend/auth.dart

@@ -110,7 +110,9 @@ Future<UserCredential?> signInWithGoogle() async {
  try {
    debugPrint('Signing in with Google');
    // Trigger the authentication flow
-    final GoogleSignInAccount? googleUser = await GoogleSignIn(scopes: ['profile', 'email']).signIn();
+    final GoogleSignInAccount? googleUser = await GoogleSignIn(scopes: ['profile', 'email'],
+      // clientId: "1031333818730-l9meebge7tpc0qmquvq6t5qpoe09o1ra.apps.googleusercontent.com",


what does this comment mean should it be in prod?

skywinder · 2025-04-14T15:40:22Z

app/lib/backend/auth.dart

+    // To reduce unnecessary invoking of getIdToken() on web 
+    IdTokenResult? tokenResult = await FirebaseAuth.instance.currentUser?.getIdTokenResult();
+    SharedPreferencesUtil().authToken = await FirebaseAuth.instance.currentUser?.getIdToken()?? '';
+    SharedPreferencesUtil().tokenExpirationTime =  tokenResult?.expirationTime?.millisecondsSinceEpoch ?? 0 ;
+


I like this change in general...

But the code guru, @thinhx, will probably ask to separate this into another PR—to keep the web version PR clean and do this as a separate PR.

getIdToken() token doesn't work on web properly. Sometime it returns null. But surprisingly i found that it works perfect if it called is same function where we do sign in. So it is necessary for web.

skywinder · 2025-04-14T15:55:11Z

app/lib/pages/chat/widgets/voice_recorder_widget.dart

+    // try {
+    //   final transcript = await transcribeVoiceMessage(audioFile);
+    //   if (mounted) {
+    //     setState(() {
+    //       _transcript = transcript;
+    //       _state = RecordingState.transcribeSuccess;
+    //       _isProcessing = false;
+    //     });
+    //     if (transcript.isNotEmpty) {
+    //       widget.onTranscriptReady(transcript);
+    //     }
+    //   }
+    // } catch (e) {
+    //   debugPrint('Error processing recording: $e');
+    //   if (mounted) {
+    //     setState(() {
+    //       _state = RecordingState.transcribeFailed;
+    //       _isProcessing = false;
+    //     });
+    //   }
+    //   AppSnackbar.showSnackbarError('Failed to transcribe audio');
+    // }


for that code i'm not sure if it's needed or not for the further dev. so let @mdmohsin7 or @thinhx to decide on this.

I forgot to undo this 😅

Rutik7066 · 2025-04-16T11:23:05Z

@skywinder I apologize for the delayed updates; I was unwell. I have now made the requested changes.

algora-pbc bot added the 🙋 Bounty claim label Apr 7, 2025

algora-pbc bot mentioned this pull request Apr 7, 2025

Make omi work in browser (for coding) #2008

Open

Rutik7066 marked this pull request as ready for review April 8, 2025 09:11

Rutik7066 force-pushed the web-support-1 branch from a5ac6ba to 7e20158 Compare April 9, 2025 21:58

skywinder requested changes Apr 10, 2025

View reviewed changes

Rutik7066 force-pushed the web-support-1 branch from 7e20158 to c61e0de Compare April 10, 2025 09:51

Rutik7066 added 9 commits April 10, 2025 15:45

latest flutter web loading strategy & change flutter_sound_web versio…

7329aaf

…n to static

refactor: intercom abstracted and disabled on web

b0dcd9e

refactor: flutter_foreground

7e8621c

fix: google sign in

96f9abc

refactor: add CORS proxy and improve web platform checks

c2c202a

small fix

ef02af6

added web ^1.1.1

bd71cea

feat: cross platform web socket

88e9584

Rutik7066 force-pushed the web-support-1 branch from c61e0de to 88e9584 Compare April 10, 2025 10:16

Rutik7066 added 2 commits April 11, 2025 02:39

fix: some run errors

83082e7

fix: Chat Page

c31c84d

Rutik7066 force-pushed the web-support-1 branch from 7ec1f4a to c31c84d Compare April 11, 2025 12:43

Rutik7066 and others added 2 commits April 11, 2025 18:14

Merge branch 'BasedHardware:main' into web-support-1

2d86964

refactor: Replaced io File with XFile for image and file upload

a2e1688

Rutik7066 added 3 commits April 12, 2025 21:49

fixes: made file handling web compatible

3a5d579

fixes: web compatiable mutlipart request

5c00cdd

refactor: removed unused 'dart:io' and other imports

658e85a

Rutik7066 requested a review from skywinder April 13, 2025 21:04

skywinder reviewed Apr 14, 2025

View reviewed changes

fixes

e31a9fc

Rutik7066 requested a review from skywinder April 16, 2025 11:23

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

fix: web build #2164

fix: web build #2164

Rutik7066 commented Apr 7, 2025 •

edited

Loading

skywinder left a comment

skywinder Apr 10, 2025

skywinder Apr 10, 2025

skywinder Apr 10, 2025

skywinder Apr 10, 2025

Rutik7066 commented Apr 11, 2025

Rutik7066 commented Apr 13, 2025

skywinder left a comment

skywinder Apr 14, 2025

skywinder Apr 14, 2025

Rutik7066 Apr 14, 2025

skywinder Apr 14, 2025

Rutik7066 Apr 14, 2025

Rutik7066 commented Apr 16, 2025

		url = "https://cors-anywhere.herokuapp.com/$url";
		headers["Origin"] = 'http://localhost:53844';

		clientId: "1031333818730-l9meebge7tpc0qmquvq6t5qpoe09o1ra.apps.googleusercontent.com",
		).signIn();

fix: web build #2164

Are you sure you want to change the base?

fix: web build #2164

Conversation

Rutik7066 commented Apr 7, 2025 • edited Loading

skywinder left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Rutik7066 commented Apr 11, 2025

Rutik7066 commented Apr 13, 2025

skywinder left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Rutik7066 commented Apr 16, 2025

Rutik7066 commented Apr 7, 2025 •

edited

Loading