Skip to content

Conversation

gjmooney
Copy link
Contributor

Adds AR capability to visualize 3d models on a cube marker.

brain_stem

@maartenbreddels
Copy link
Owner

Whow, I missed the notifications for this, really really cool!
I've wanted to do this for many many years, but never got to it.
However, I'm not sure ipywebrtc is the place for this particular widget.
I do wonder if we can have the marker detector and the renderer separately. In principle the only thing we need is the 4x4 matrix array (which we can jslink to say ipyvolume, ipygany etc) and a way to blend the background of the webcam with the render output.

What do you think of that?

@maartenbreddels
Copy link
Owner

Related: widgetti/ipyvolume#397

@SylvainCorlay
Copy link

Let's talk about it. It was a nice place to experiment though :)

@gjmooney
Copy link
Contributor Author

gjmooney commented Mar 4, 2024

However, I'm not sure ipywebrtc is the place for this particular widget.
I do wonder if we can have the marker detector and the renderer separately. In principle the only thing we need is the 4x4 matrix array (which we can jslink to say ipyvolume, ipygany etc) and a way to blend the background of the webcam with the render output.

What do you think of that?

I think as long as there's a way to to get a reference to the scene that has the markers, and pass that into the renderer it should work. So having them separate should be possible.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants